-- Logs begin at Sat 2022-08-06 11:49:54 UTC, end at Sat 2022-08-06 13:22:09 UTC. -- Aug 06 12:22:07.493280 dv-cinder-851996-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 12:22:07.502524 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 12:22:07.504519 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 12:22:07 2022] *** Aug 06 12:22:07.504519 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 12:22:07.504519 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 12:22:07.504519 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: nodename: dv-cinder-851996-3-iscsi Aug 06 12:22:07.504519 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: machine: x86_64 Aug 06 12:22:07.504519 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: clock source: unix Aug 06 12:22:07.504519 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: pcre jit disabled Aug 06 12:22:07.504519 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: detected number of CPU cores: 4 Aug 06 12:22:07.504519 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: current working directory: / Aug 06 12:22:07.504519 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: detected binary path: /usr/bin/uwsgi-core Aug 06 12:22:07.505242 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: your processes number limit is 47680 Aug 06 12:22:07.505242 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: your memory page size is 4096 bytes Aug 06 12:22:07.505242 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: detected max file descriptor number: 2048 Aug 06 12:22:07.505242 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: lock engine: pthread robust mutexes Aug 06 12:22:07.505242 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: thunder lock: enabled Aug 06 12:22:07.505242 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 12:22:07.505242 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 12:22:07.543635 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: Python main interpreter initialized at 0x5585137829c0 Aug 06 12:22:07.543635 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: python threads support enabled Aug 06 12:22:07.543635 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: your server socket listen backlog is limited to 100 connections Aug 06 12:22:07.543635 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: your mercy for graceful operations on workers is 90 seconds Aug 06 12:22:07.543954 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 12:22:07.544029 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: *** Operational MODE: preforking *** Aug 06 12:22:07.544283 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: *** uWSGI is running in multiple interpreter mode *** Aug 06 12:22:07.544283 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: spawned uWSGI master process (pid: 103121) Aug 06 12:22:07.544485 dv-cinder-851996-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 06 12:22:07.548333 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: spawned uWSGI worker 1 (pid: 103122, cores: 1) Aug 06 12:22:07.548333 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: spawned uWSGI worker 2 (pid: 103123, cores: 1) Aug 06 12:22:07.548333 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 12:22:08.201354 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 12:22:08.210345 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 12:22:09.282919 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 12:22:09.282919 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: from cryptography.utils import int_from_bytes Aug 06 12:22:09.283569 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 12:22:09.283569 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: from cryptography.utils import int_from_bytes Aug 06 12:22:09.283687 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 12:22:09.283687 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: from cryptography.utils import int_from_bytes Aug 06 12:22:09.284050 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 12:22:09.284050 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: from cryptography.utils import int_from_bytes Aug 06 12:22:11.773549 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 12:22:11.774110 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 12:22:11.774210 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 12:22:11.774550 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 12:22:11.774642 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 12:22:11.774723 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 12:22:11.774877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 12:22:11.774965 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 12:22:11.775235 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 12:22:11.775329 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.775487 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 12:22:11.775588 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.775856 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.775949 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.776170 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.776273 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.776516 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.776625 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.776818 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.776902 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.777132 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.777224 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.777445 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.777537 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.777761 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.777845 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.778621 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.778732 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.778886 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.779036 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.779185 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.779284 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-3-iscsi {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.779498 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.779598 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.779799 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.779897 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-3-iscsi {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.780108 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.780204 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.780435 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.780539 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.780736 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.780837 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.781051 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.781150 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.781345 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.781445 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.781663 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.781829 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.781967 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.782264 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.782462 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.782574 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.782771 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.782870 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.783069 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.783283 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.783384 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.783460 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.783693 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.783792 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.784003 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.784102 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.784321 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.784482 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.784643 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.784786 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.784929 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.785083 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.785255 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.785395 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-3-iscsi {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.785561 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.785713 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.785914 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.786061 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-3-iscsi {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.786226 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.786382 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.786562 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.786699 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.786842 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.786990 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.787204 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.787345 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.787517 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.787659 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.787834 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.787976 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.788133 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.788274 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.788477 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.788630 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.788848 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.789006 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.789143 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.789294 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.789443 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.789579 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.789727 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.789864 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.790000 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.790133 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.790275 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.790428 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.790576 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.790832 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.790977 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.791113 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.791247 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.791389 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.791526 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.791661 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.791795 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.791929 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.792071 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.792214 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.792387 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.792526 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.792661 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.792810 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.792959 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.793098 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.793233 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.793369 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.793518 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.793665 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.793825 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.793970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.794114 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.794255 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.794408 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.794552 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.794689 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.794840 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.794977 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.795112 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.795247 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.795389 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.795536 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.795670 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.795810 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.795946 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.796080 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.796224 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.796406 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.796556 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.796699 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.796841 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.796983 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.797119 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.797255 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.797406 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.797547 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.797689 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.797833 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.797974 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.798108 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.798241 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.798377 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.798578 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.798735 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.798879 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.799015 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.799148 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.799297 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.799441 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.799586 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.799727 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.799876 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.800011 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.800152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.800322 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.800477 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.800644 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.800937 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.801080 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.801214 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.801368 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.801505 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.801639 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.801774 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.801774 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.802035 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.802181 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.802317 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.802453 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.802593 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.802736 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.802870 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.803027 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.803163 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.803298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.803431 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.803567 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.803708 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.803852 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.803987 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.804121 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.804262 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.804440 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.804587 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.804730 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.804875 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.805009 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.805142 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.805276 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.805417 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.805559 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.805738 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.805889 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.806032 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.806168 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.806314 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.806463 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.806603 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.806756 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.806899 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.807035 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.807185 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.807322 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.807463 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.807597 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.807732 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.807874 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.808010 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.808152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.808288 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.808479 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.808624 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.808760 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.808910 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.809048 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.809194 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.809329 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.809463 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.809750 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.809900 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.810037 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.810180 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.810316 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.810451 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.810595 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.810738 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.811026 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.811172 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.811309 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.811444 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.811588 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.811724 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.811859 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.811995 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.812129 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.812265 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.812456 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.812595 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.812731 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.812865 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.813011 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.813153 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.813298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.813434 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.813580 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.813723 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.813859 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.814002 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.814212 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.814361 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.814497 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.814632 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.814773 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.814917 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.815061 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.815204 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.815340 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.815486 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.815621 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.815764 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.815906 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.816042 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.816195 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.816359 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.816515 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.816667 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.816803 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.816938 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.817088 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.817226 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.817360 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.817502 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:22:11.817638 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.817773 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.817914 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.818061 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.818207 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.818343 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.818485 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.818620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.818754 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.818896 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.819043 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.819179 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.819322 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.819457 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.819598 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.819743 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.819890 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.820059 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.820202 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.820408 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.820562 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.820707 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.820843 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.821111 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.821256 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.821394 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.821548 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.821693 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.821846 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.821983 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.822117 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.822251 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.822393 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.822536 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.822679 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.822820 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.822956 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.823091 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.823225 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.823404 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.823560 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.823720 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.823862 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.824046 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.824196 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.824381 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.824525 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.824694 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.825324 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.825539 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.825683 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.825849 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.825992 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.826141 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.826277 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.826446 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.826591 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.826745 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.826888 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.827071 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.827221 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.827379 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.827541 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.827679 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.827813 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.827983 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.828134 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.828674 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.828835 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.828974 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.829110 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.829251 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.829387 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.829522 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.829665 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.829815 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.829952 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.830087 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.830230 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.830375 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.830520 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.830670 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.830808 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.830943 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.831208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.831371 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.831517 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.831654 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.831801 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.831941 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.832076 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.832229 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.832392 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.832531 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.832665 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.832800 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.832936 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.833086 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.833235 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.833371 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.833506 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.833650 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.833792 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.833943 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.834095 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.834240 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.834376 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.834511 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.834653 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.834797 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.834940 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.835084 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.835226 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.835370 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.835524 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.835662 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.835797 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.835946 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.836083 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.836225 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.836500 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.836643 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.836803 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.836952 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.837089 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.837224 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.837366 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.837511 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.837646 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.837780 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.837925 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.838060 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.838204 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.838340 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.838475 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.838610 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.838751 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.838899 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.839043 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.839186 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.839322 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.839467 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.839619 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.839764 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.839900 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.840036 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.840170 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.840334 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.841057 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.841348 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.841502 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.841640 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.841774 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.841910 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.842054 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.842201 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.842337 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.842472 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.842614 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.842750 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.842897 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.843035 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.843169 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.843310 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.843447 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.843582 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.843724 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.843861 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.844004 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.844141 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.844275 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.844455 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.844603 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.844741 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.844899 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.845046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.845182 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.845325 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.845470 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.845606 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.845742 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.845887 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.846023 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.846166 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.846303 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.846438 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.846573 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.846716 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.846860 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.847014 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.847151 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.847286 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.847428 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.847575 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.847711 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.847858 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.847995 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.848131 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.848266 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.848439 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.848590 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.848728 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.848863 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.848998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.849132 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.849274 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.849428 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.849574 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.849720 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.849864 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.850008 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.850143 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.850290 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.850427 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.850562 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.850706 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.850885 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.851029 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.851195 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.851484 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.851627 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.851764 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.851900 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.852035 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.852178 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.852376 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.852531 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.852668 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.852804 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.852952 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.853091 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.853226 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.853370 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.853519 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.853661 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.853805 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.853942 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.854078 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.854212 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.854347 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.854481 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.854625 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.854785 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.854936 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.855071 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.855216 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.855385 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.855664 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.855817 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.855957 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.856120 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.856256 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.856442 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.856581 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.856716 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.856865 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.857006 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.857152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.857296 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.857433 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.857568 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.857710 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.857854 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.857991 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.858158 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.858310 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.858446 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.858581 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.858763 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.858905 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.859062 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.859199 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.859361 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.859502 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.859663 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.859810 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.859981 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.860132 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.860275 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.860475 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.860613 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.860760 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.860897 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.861043 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.861181 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.861317 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.861588 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.861754 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.861898 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.862040 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.862181 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.862324 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.862466 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.862617 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.863029 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.863174 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.863326 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.863480 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.863624 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.863778 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.863922 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.864064 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.864206 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.864372 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.864602 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.864749 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.864892 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.865033 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.865175 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.865328 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.865484 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.865628 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.865770 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.865917 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.866060 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.866201 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.866351 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.866494 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.866635 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.866776 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.866924 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.867079 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.867229 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.867371 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.867521 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.867664 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.867804 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.867953 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.868096 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.868238 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.868426 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.868571 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.868721 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.868879 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.869039 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.869182 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.869332 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.869473 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.869616 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.869766 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.869909 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.870058 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.870201 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.870341 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.870482 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.870633 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.870776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.870927 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.871069 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.871211 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.871361 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.871504 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.871820 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.871973 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.872118 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.872260 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.872449 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.872596 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.872740 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.872881 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.873033 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.873183 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.873338 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.873487 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.873636 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.873781 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.873922 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.874071 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.874225 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.874368 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.874509 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.874650 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.874792 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.874951 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.875094 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.875235 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.875377 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.875518 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.875660 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.875813 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.875958 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.876099 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.876248 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.876426 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.876426 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.876720 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.876864 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.877017 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.877166 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.877310 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.877459 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.877610 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.877753 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.877895 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.877895 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.878183 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.878337 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.878481 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.878633 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.878775 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.878922 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.879074 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.879229 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.879372 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.879522 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.879665 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.879806 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.879947 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.880089 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.880240 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.880407 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.880507 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.880610 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.880750 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.880846 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.881058 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.881164 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.881364 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.881454 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.881664 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.881748 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.881970 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.882066 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.882261 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.882360 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.882559 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.882647 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.882862 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.882962 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.883159 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.883254 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.883458 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.883546 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.883751 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.883846 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.884051 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.884137 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.884375 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.884488 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.884674 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.884770 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.884970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.885064 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.885266 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.885352 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.885565 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.885653 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.885883 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.885969 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.886186 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.886274 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.886490 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.886579 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.886790 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.886884 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.887089 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.887220 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.887922 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.888012 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.888238 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.888339 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.888599 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.888706 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.888905 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.888993 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.889205 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.889298 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.889511 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.889607 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.889814 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.889902 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.890112 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.890208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.890417 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.890514 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.890719 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.890818 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.891020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.891107 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.891321 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.891415 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.891620 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.891707 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.891915 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.892001 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.892211 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.892320 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.892545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.892635 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.892848 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.892934 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.893144 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.893243 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.893440 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.893534 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.893742 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.893829 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.894039 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.894126 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.894349 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.894439 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.894635 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.894724 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.894931 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.895019 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.895228 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.895321 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.895524 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.895617 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.895820 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.895907 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.896116 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.896203 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.896441 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.896548 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.896742 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.896831 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.897036 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.897123 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.897344 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.897451 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.897644 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.897731 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.897939 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.898032 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.898235 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.898330 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.898537 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.898623 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.898832 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.898918 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.899128 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.899230 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.899430 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.899517 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.899727 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.899811 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.900025 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.900116 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.900339 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.900427 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.900641 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.900739 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.900942 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.901032 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.901239 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.901328 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.901537 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.901623 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.901836 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.901928 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.902130 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.902225 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.902426 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.902526 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.902723 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.902810 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.903580 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.903700 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.903884 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.904000 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.904189 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.904279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.904513 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.904600 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.904811 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.904911 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.905108 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.905202 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.905401 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.905488 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.905699 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.905792 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.906017 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.906114 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.906322 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.906409 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.906622 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.906711 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.906924 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.907022 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.907222 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.907357 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.907585 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.907674 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.907890 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.907978 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.908198 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.908361 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.908523 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.908663 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.908834 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.908978 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.909141 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.909295 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.909448 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.909603 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.909748 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.909914 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.910046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.910224 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.910364 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.910526 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.910670 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.910836 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.910979 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.911143 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.911293 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.911456 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.911611 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.911758 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.911928 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.912062 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.912226 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.912404 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.912554 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.912714 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.912859 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.913023 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.913161 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.913341 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.913464 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.913659 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.913768 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.913976 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.914065 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.914278 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.914367 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.914585 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.914682 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.914893 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.914981 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.915197 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.915285 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.915504 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.915600 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.915809 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.915899 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.916110 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.916205 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.916429 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.916601 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.916747 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.916834 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.917050 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.917137 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.917350 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.917495 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.917653 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.917740 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.917951 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.918037 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.918255 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.918351 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.918578 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.918671 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.918904 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.918991 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.919216 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.919305 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.919521 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.919608 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.919829 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.919918 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.920133 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.920222 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.920466 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.920567 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.920771 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.920867 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.921082 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.921195 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.921384 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.921505 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.921795 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.921890 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.922101 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.922238 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.922407 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.922527 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.922711 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.922814 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.923009 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.923107 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.923308 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.923403 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.923612 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.923724 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.923927 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.924014 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.924226 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.924342 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.924550 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.924651 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.924848 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.924939 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.925164 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.925251 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.925464 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.925552 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.925779 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.925878 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.926117 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.926204 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.926422 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.926511 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.926725 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.926812 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.927027 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.927152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.927349 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.927458 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.927651 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.927765 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.927974 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.928082 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.928409 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.928503 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.928720 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.928808 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.929022 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.929122 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.929331 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.929419 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.929636 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.929723 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.929956 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.930053 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.930274 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.930375 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.930578 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.930666 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.930888 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.930977 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.931193 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.931296 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.931510 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.931598 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.931816 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.931901 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.932123 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.932218 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.932464 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.932556 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.932773 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.932864 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.933086 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.933182 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.933390 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.933477 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.933710 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.933798 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.934030 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.934119 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.934378 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.934477 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.934677 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.934771 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.934982 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.935092 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.935282 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.935412 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.935581 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.935720 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.935898 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.936039 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.936198 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.936385 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.936532 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.936693 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.936847 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.937004 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.937152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.937298 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.937424 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.937603 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.937725 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.937913 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.938040 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.938234 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.938341 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.938538 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.938657 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.938847 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.938963 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.939157 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.939278 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.939464 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.939591 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.939769 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.939890 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.940072 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.940202 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.940415 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.940529 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.940721 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.940831 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.941042 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.941139 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.941353 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.941442 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.941670 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.941766 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.941987 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.942083 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.942289 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.942385 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.942609 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.942697 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.942917 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.943017 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.943221 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.943308 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.943521 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.943608 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.943821 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.943917 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.944140 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.944230 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.944470 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.944560 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.944788 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.944877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.945089 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.945177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.945387 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.945476 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.945690 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.945780 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.945987 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.946082 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.946284 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.946372 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.946583 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.946673 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.946885 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.946979 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.947183 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.947271 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.947479 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.947568 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.947774 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.947868 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.948088 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.948184 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.948407 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.948499 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.948708 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.948794 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.949009 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.949108 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.949309 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.949399 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.949620 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.949727 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.950439 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.950542 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.950738 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.950826 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.951056 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.951151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.951357 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.951455 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.951672 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.951762 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.951975 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.952063 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.952278 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.952409 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.952972 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.953076 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.953158 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.953238 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.953238 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.953412 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.953495 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.953574 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.953798 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.953887 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.954106 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.954195 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.954409 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.954496 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.954718 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.954805 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.955025 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.955120 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.955333 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.955420 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.955646 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.955851 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.955941 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.956179 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.956278 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.956513 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.956605 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.956824 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.956913 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.957132 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.957221 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.957441 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.957528 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.957748 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.957838 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.958055 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.958274 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.958361 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.958602 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.958691 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.958915 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.959011 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.959225 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.959313 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.959533 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.959629 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.959844 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.959977 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.960155 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.960243 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.960489 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.960581 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.960797 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.960885 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.961102 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.961200 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.961408 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.961495 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.961728 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.961814 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.962044 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.962145 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.962342 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.962430 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.962650 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.962785 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.962959 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.963056 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.963267 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.963353 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.963570 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.963658 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.963873 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.963963 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.964177 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.964272 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.964508 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.964599 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.964812 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.964903 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.965115 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.965203 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.965966 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.966075 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.966289 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.966380 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.966599 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.966688 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.966909 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.967010 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.967220 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.967310 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.967524 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.967611 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.967828 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.967971 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.968135 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.968222 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.968483 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.968667 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.968795 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.968975 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.969114 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.969301 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.969444 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.969619 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.969761 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.969936 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.970073 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.970242 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.970383 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.970551 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.970694 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.970872 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.971172 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.971259 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.971473 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.971569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.971776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.971871 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.972077 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.972164 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.972395 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.972504 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.972713 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.972847 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.973015 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.973154 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.973313 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.973411 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.973625 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.973714 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.973926 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.974013 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.974259 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.974446 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.974567 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.974783 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.974871 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.975093 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.975188 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.975413 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.975504 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.975730 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.975818 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.976039 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.976135 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.976361 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.976452 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.976681 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.976885 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.976986 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.977226 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.977315 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.977539 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.977635 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.977855 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.977987 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.978156 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.978245 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.978453 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.978543 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.978756 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.978852 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.979059 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.979147 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.979354 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.979448 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.979655 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.979751 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.979950 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.980036 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.980264 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.980372 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.980586 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.980690 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.980887 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.980982 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.981207 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.981293 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.981512 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.981606 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.981808 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.981896 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.982107 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.982194 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.982406 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.982493 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.982701 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.982788 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.983005 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.983091 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.983301 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.983399 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.983600 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.983686 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.983896 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.983982 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.984195 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.984283 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.984514 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.984601 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.984814 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.984901 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.985109 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.985199 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.985414 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.985500 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.985708 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.985803 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.986011 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.986098 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.986313 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.986400 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.986620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.986715 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.986923 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.987019 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.987228 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.987316 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.987529 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.987625 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.988112 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.988204 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.988442 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.988534 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.988791 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.988980 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.989103 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.989310 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.989421 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.989631 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.989754 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.992953 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993083 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993156 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993240 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993310 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993404 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993474 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993547 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993615 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993681 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993761 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993841 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993909 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.993909 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994028 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994094 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994159 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994237 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994307 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994373 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994438 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994504 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994578 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994654 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994721 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994787 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994853 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994919 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.994996 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995064 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995129 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995201 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995268 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995348 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995440 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995510 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995584 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995652 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995723 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.995975 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.996066 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.996322 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.996426 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.996509 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.996577 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.997899 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.997995 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.998122 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.998197 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.998273 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.998342 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.998420 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.998488 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.998560 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.998627 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:11.999487 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000055 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000130 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000198 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000264 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000353 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000437 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000508 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000591 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000670 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000755 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000836 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000836 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.000991 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.001067 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.001141 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.001513 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.001605 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.001684 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.001753 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.001826 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.001894 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.002201 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.002297 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.002471 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.002568 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.002755 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.002842 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.003083 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.003189 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.003387 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.003479 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.003709 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.003800 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.004043 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.004142 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.004367 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.004470 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.004689 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.004780 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.004988 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.005077 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.005288 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.005378 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.005586 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.005685 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.005893 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.006052 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.006206 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.006305 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.006511 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.006603 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.006810 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.006903 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.007108 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.007212 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.007411 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.007515 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.007707 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.007796 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.008007 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.008095 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.008329 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.008436 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.008621 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.008710 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.008922 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.009010 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.009220 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.009315 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.009515 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.009603 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.009812 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.009899 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.010109 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.010211 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.010404 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.010491 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.010700 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.010789 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.010996 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.011084 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.011293 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.011379 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.011588 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.011675 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.011883 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.011978 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.012178 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.012273 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.013054 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.013146 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.013356 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.013446 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.013656 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.013744 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.013961 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.014057 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.014262 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.014362 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.014560 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.014649 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.014858 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.014954 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.015157 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.015244 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.015456 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.015553 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.015769 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.015865 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.016078 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.016205 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.016403 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.016495 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.016720 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.016820 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.017025 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.017113 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.017331 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.017418 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.017634 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.017737 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.017937 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.018025 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.018241 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.018328 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.018546 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.018636 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.018853 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.018941 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.019174 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.019260 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.019477 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.019567 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.019783 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.019869 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.020090 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.020178 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.020420 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.020518 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.020726 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.020814 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.021130 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.021350 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.021438 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.021657 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.021746 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.021961 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.022058 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.022265 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.022352 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.022571 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.022660 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.022875 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.022972 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.023183 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.023270 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.023486 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.023616 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.023828 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.023931 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.024098 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.024187 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.024428 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.024517 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.024736 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.024826 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.025043 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.025132 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.025348 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.025435 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.025657 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.025745 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.025963 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.026060 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.026272 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.026382 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.026575 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.026671 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.026885 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.026974 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.027205 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.027306 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.027524 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.027661 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.027828 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.027936 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.028154 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.028251 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.028416 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 12:22:12.028508 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.028836 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.029147 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.029485 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.029807 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.030118 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.030426 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.030728 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:22:12.030967 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 12:22:12.181774 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Registered counter for database nova_api Aug 06 12:22:12.183773 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO dbcounter [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Registered counter for database nova_api Aug 06 12:22:12.204246 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:22:12.206002 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG oslo_db.sqlalchemy.engines [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:22:12.210815 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:22:12.212791 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG dbcounter [-] [103122] Writer thread running {{(pid=103122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:22:12.266078 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.context [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),061923a9-3e0d-4e1d-84a5-ebe9694ea1ee(cell1) {{(pid=103123) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 12:22:12.268101 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.context [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),061923a9-3e0d-4e1d-84a5-ebe9694ea1ee(cell1) {{(pid=103122) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 12:22:12.269989 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:22:12.270465 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:22:12.272062 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:22:12.272830 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:22:12.273202 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG oslo_concurrency.lockutils [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:22:12.273305 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:22:12.273740 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG oslo_concurrency.lockutils [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:22:12.275243 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG oslo_concurrency.lockutils [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:22:12.275352 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:22:12.275983 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG oslo_concurrency.lockutils [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:22:12.276477 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG oslo_concurrency.lockutils [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:22:12.277264 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Registered counter for database nova_cell0 Aug 06 12:22:12.279712 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG oslo_concurrency.lockutils [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:22:12.282307 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO dbcounter [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Registered counter for database nova_cell0 Aug 06 12:22:12.282793 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Registered counter for database nova_cell1 Aug 06 12:22:12.290033 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:22:12.290927 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO dbcounter [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Registered counter for database nova_cell1 Aug 06 12:22:12.292290 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:22:12.297256 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:22:12.299887 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:22:12.300029 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG oslo_db.sqlalchemy.engines [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:22:12.305533 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG dbcounter [-] [103122] Writer thread running {{(pid=103122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:22:12.306678 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG oslo_db.sqlalchemy.engines [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:22:12.442951 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO dbcounter [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Registered counter for database nova_cell0 Aug 06 12:22:12.445097 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG dbcounter [-] [103122] Writer thread running {{(pid=103122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:22:12.449735 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_db.sqlalchemy.engines [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:22:12.453989 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO dbcounter [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Registered counter for database nova_cell0 Aug 06 12:22:12.454360 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writer thread running {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:22:12.462837 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG oslo_db.sqlalchemy.engines [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:22:12.467079 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG dbcounter [-] [103122] Writer thread running {{(pid=103122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:22:12.794741 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 12:22:12.795364 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: WARNING keystonemiddleware.auth_token [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 12:22:12.802078 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 12:22:12.802505 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: WARNING keystonemiddleware.auth_token [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 12:22:13.142198 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: WARNING keystonemiddleware.auth_token [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 12:22:13.142395 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 12:22:13.148012 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: WARNING keystonemiddleware.auth_token [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 12:22:13.148189 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: WARNING keystonemiddleware.auth_token [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 12:22:13.153849 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585137829c0 pid: 103122 (default app) Aug 06 12:22:13.154034 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585137829c0 pid: 103123 (default app) Aug 06 12:22:13.155889 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:22:13.157097 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-6d218544-197e-4d26-aca5-5852f51e8712 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Aug 06 12:22:13.157506 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Sat Aug 6 12:22:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:28.744242 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:28.745489 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Aug 06 12:23:28.746127 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:28.762507 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG dbcounter [-] [103122] Writing DB stats nova_api:SELECT=3 {{(pid=103122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:23:28.763444 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG dbcounter [-] [103122] Writing DB stats nova_cell0:SELECT=3 {{(pid=103122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:23:28.764362 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG dbcounter [-] [103122] Writing DB stats nova_cell1:SELECT=3 {{(pid=103122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:23:28.765618 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG dbcounter [-] [103122] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:23:29.603039 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-a917a817-6fd6-44e8-ae2e-f3f48d3c48d6 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:29.635645 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-a917a817-6fd6-44e8-ae2e-f3f48d3c48d6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.883288 Aug 06 12:23:29.641624 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Aug 6 12:23:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:23:31.906593 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:31.907596 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-2328a41d-1b27-405e-b3e3-023a5bebde97 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 06 12:23:31.907997 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:32.404518 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-b6b53d2a-d664-4d18-a071-9d61963bf816 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "vcpus": 1, "name": "cirros256"}} {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:32.425302 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 12:23:32.425302 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: warnings.warn(msg) Aug 06 12:23:32.456515 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-b6b53d2a-d664-4d18-a071-9d61963bf816 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.539123 Aug 06 12:23:32.460612 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Aug 6 12:23:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:23:32.472115 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=3 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:23:32.473451 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell1:SELECT=3 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:23:32.474449 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell0:SELECT=3 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:23:32.475599 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:23:32.691977 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-a851fb45-e25c-49eb-8714-d229cd0089fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:32.696975 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 12:23:32.696975 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 06 12:23:32.769881 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-a851fb45-e25c-49eb-8714-d229cd0089fc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.304343 Aug 06 12:23:32.770736 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1336 bytes} [Sat Aug 6 12:23:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:23:34.960772 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-b6b53d2a-d664-4d18-a071-9d61963bf816 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:34.961797 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-b6b53d2a-d664-4d18-a071-9d61963bf816 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 06 12:23:34.962352 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:35.625038 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-6b91e7b3-1c3d-4912-92e5-ebff61bea80e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:35.644547 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 12:23:35.644547 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 06 12:23:35.669311 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-6b91e7b3-1c3d-4912-92e5-ebff61bea80e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.701135 Aug 06 12:23:35.669968 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Aug 6 12:23:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:23:35.682686 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-255acd47-2381-408e-b55e-18e5e7f2047b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:35.685864 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 12:23:35.685864 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: warnings.warn(msg) Aug 06 12:23:35.720802 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-255acd47-2381-408e-b55e-18e5e7f2047b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041833 Aug 06 12:23:35.721553 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1336 bytes} [Sat Aug 6 12:23:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:23:37.943257 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-6b91e7b3-1c3d-4912-92e5-ebff61bea80e admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:37.945442 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-6b91e7b3-1c3d-4912-92e5-ebff61bea80e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 06 12:23:37.945442 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:38.352601 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-eaf55129-e1fd-4ca1-a14e-9b573d0eed5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:38.371475 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-eaf55129-e1fd-4ca1-a14e-9b573d0eed5c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.420768 Aug 06 12:23:38.372244 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Aug 6 12:23:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:23:38.384213 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-c0df5976-1a78-474b-8eb5-88edc0b9366f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:38.409401 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-c0df5976-1a78-474b-8eb5-88edc0b9366f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028841 Aug 06 12:23:38.409997 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1336 bytes} [Sat Aug 6 12:23:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:23:40.598953 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-eaf55129-e1fd-4ca1-a14e-9b573d0eed5c admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:40.599978 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-eaf55129-e1fd-4ca1-a14e-9b573d0eed5c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 06 12:23:40.600574 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:41.007962 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-d84012b3-c581-4b1f-95bc-41eb5280a3bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "id": "d3"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:41.029118 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-d84012b3-c581-4b1f-95bc-41eb5280a3bf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422569 Aug 06 12:23:41.029657 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Aug 6 12:23:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:23:41.041553 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-0402f7c0-4a1f-4544-889d-2f55bbe1888e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:41.070049 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-0402f7c0-4a1f-4544-889d-2f55bbe1888e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031612 Aug 06 12:23:41.070622 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1336 bytes} [Sat Aug 6 12:23:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:23:43.284686 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-d84012b3-c581-4b1f-95bc-41eb5280a3bf admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:43.285691 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-d84012b3-c581-4b1f-95bc-41eb5280a3bf admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 06 12:23:43.286086 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:43.703923 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-1f379cbb-700d-46b0-9128-7b590e0886ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:43.723620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-1f379cbb-700d-46b0-9128-7b590e0886ad admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430575 Aug 06 12:23:43.724269 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Aug 6 12:23:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:23:43.737088 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-13fe9fc0-421e-4d06-a10f-64fe94cb41f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:43.761764 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-13fe9fc0-421e-4d06-a10f-64fe94cb41f8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028550 Aug 06 12:23:43.762464 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1336 bytes} [Sat Aug 6 12:23:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:23:46.149531 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-1f379cbb-700d-46b0-9128-7b590e0886ad admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:46.150727 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-1f379cbb-700d-46b0-9128-7b590e0886ad admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Aug 06 12:23:46.151147 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:46.563842 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-6c3d89a2-ba76-467c-b065-d6c2d56a022a admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:46.588133 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-6c3d89a2-ba76-467c-b065-d6c2d56a022a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.430466 Aug 06 12:23:46.588569 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Aug 6 12:23:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:23:49.357719 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-1f379cbb-700d-46b0-9128-7b590e0886ad admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:49.358725 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-1f379cbb-700d-46b0-9128-7b590e0886ad admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 06 12:23:49.359126 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:49.779199 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-7602d8e9-10d3-46a7-b6cf-44155cc683ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "disk": 1, "id": "1", "name": "m1.tiny"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:49.797829 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-7602d8e9-10d3-46a7-b6cf-44155cc683ec admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.431037 Aug 06 12:23:49.798376 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Aug 6 12:23:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:23:49.810738 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-672b77be-315c-4bf3-8411-ee1fd59c531d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:49.835206 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-672b77be-315c-4bf3-8411-ee1fd59c531d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028106 Aug 06 12:23:49.835774 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1333 bytes} [Sat Aug 6 12:23:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:23:52.040011 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-7602d8e9-10d3-46a7-b6cf-44155cc683ec admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:52.041076 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-7602d8e9-10d3-46a7-b6cf-44155cc683ec admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 06 12:23:52.041480 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:52.431293 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-aa52db35-42e5-4155-a10f-9ce43b6e5b55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "swap": 0}} {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:52.450014 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-aa52db35-42e5-4155-a10f-9ce43b6e5b55 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.402474 Aug 06 12:23:52.450569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Aug 6 12:23:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:23:52.462620 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-44b8d1df-43d6-4b75-bd49-55e32ce18a6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:52.487789 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-44b8d1df-43d6-4b75-bd49-55e32ce18a6a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029007 Aug 06 12:23:52.488369 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1333 bytes} [Sat Aug 6 12:23:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:23:54.667260 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-aa52db35-42e5-4155-a10f-9ce43b6e5b55 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:54.668334 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-aa52db35-42e5-4155-a10f-9ce43b6e5b55 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 06 12:23:54.668738 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:55.057256 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-c4324f0a-4aff-4d4b-8de0-92025bf18dae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "ram": 4096, "disk": 40}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:55.079207 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-c4324f0a-4aff-4d4b-8de0-92025bf18dae admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.404354 Aug 06 12:23:55.079934 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Aug 6 12:23:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:23:55.091710 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-32df6033-4ae2-46df-8d33-518809037b1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:55.119937 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-32df6033-4ae2-46df-8d33-518809037b1f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031740 Aug 06 12:23:55.120933 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1333 bytes} [Sat Aug 6 12:23:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:23:57.359189 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-c4324f0a-4aff-4d4b-8de0-92025bf18dae admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:23:57.360489 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-c4324f0a-4aff-4d4b-8de0-92025bf18dae admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 06 12:23:57.360894 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:23:57.792840 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-2691ec91-7c66-4f83-b435-308315e2f601 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "ram": 8192, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:57.814796 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-2691ec91-7c66-4f83-b435-308315e2f601 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446866 Aug 06 12:23:57.815447 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Aug 6 12:23:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:23:57.829666 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-81f78230-3f57-44d2-98d9-952dc7921e9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:23:57.855856 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-81f78230-3f57-44d2-98d9-952dc7921e9c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031941 Aug 06 12:23:57.866657 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1333 bytes} [Sat Aug 6 12:23:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:24:00.065227 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-2691ec91-7c66-4f83-b435-308315e2f601 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:00.066836 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-2691ec91-7c66-4f83-b435-308315e2f601 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Aug 06 12:24:00.067234 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:24:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:24:00.502614 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-cfa4dce4-de52-4839-bf3e-aa2c9e4c1832 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:24:00.522589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-cfa4dce4-de52-4839-bf3e-aa2c9e4c1832 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449151 Aug 06 12:24:00.523231 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Aug 6 12:24:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:24:00.536094 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-12198c83-afb5-4e78-8618-f50e668efe92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:24:00.542682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG dbcounter [-] [103122] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:24:00.564492 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-12198c83-afb5-4e78-8618-f50e668efe92 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032756 Aug 06 12:24:00.565177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1333 bytes} [Sat Aug 6 12:24:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:24:20.181658 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-cfa4dce4-de52-4839-bf3e-aa2c9e4c1832 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:20.182692 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-cfa4dce4-de52-4839-bf3e-aa2c9e4c1832 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 06 12:24:20.183094 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:24:20.574677 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-a1c04fbb-3806-4270-819c-3f0375abf215 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:20.592747 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-a1c04fbb-3806-4270-819c-3f0375abf215 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403513 Aug 06 12:24:20.593215 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Aug 6 12:24:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:24:21.643808 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-cfa4dce4-de52-4839-bf3e-aa2c9e4c1832 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:21.644867 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-cfa4dce4-de52-4839-bf3e-aa2c9e4c1832 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 06 12:24:21.645862 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:24:22.161021 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-0ccd58b1-df6d-4e36-a327-22023aa27ce7 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:22.166472 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.wsgi [None req-0ccd58b1-df6d-4e36-a327-22023aa27ce7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-0ccd58b1-df6d-4e36-a327-22023aa27ce7 admin admin] Request method failure captured: Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Accept: application/json Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Accept-Encoding: gzip, deflate Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Connection: keep-alive Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Content-Length: 0 Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Host: 10.222.0.20 Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Openstack-Api-Version: compute 2.90 Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Openstack-System-Scope: None Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: User-Agent: python-novaclient Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Auth-Token: gAAAAABi7l11h2raBZy0b1h758lnR4tzIPGQOarPdA0ZItgIhIX9TzmjiBsbYJf6IRShi_1O7OrrURD7AHfbv5nR3oowoXI33XOfwF2QuyODbfljkE7LYUMzsWSxfxo662_c4ouC6MNBedRZ2XrT7nXDq6piTEjhHmaZ1__AfA61f_8ly0klesM Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Domain-Id: None Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Domain-Name: None Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Identity-Status: Confirmed Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Is-Admin-Project: True Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Domain-Id: default Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Domain-Name: Default Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Name: admin Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Role: member,admin,reader Aug 06 12:24:22.169682 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Roles: member,admin,reader Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Tenant: admin Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Tenant-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Tenant-Name: admin Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User: admin Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Domain-Id: default Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Domain-Name: Default Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Id: c9de148de73e459eb6456afdaf9fe213 Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Name: admin Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: method: > Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: exception: Flavor 42 could not be found. Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: action_args: {'id': '42'} Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:24:22.171105 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:22.172877 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:22.174208 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-0ccd58b1-df6d-4e36-a327-22023aa27ce7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:24:22.175370 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-0ccd58b1-df6d-4e36-a327-22023aa27ce7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389128 Aug 06 12:24:22.175370 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Aug 6 12:24:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 12:24:22.181314 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-fc8068fe-8959-43ce-8510-f01db35f22a5 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:22.185413 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:24:22.204057 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-fc8068fe-8959-43ce-8510-f01db35f22a5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026224 Aug 06 12:24:22.204627 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Aug 6 12:24:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:24:22.214133 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-d7194ad1-2b5a-432d-8b2b-42b6b575bd8a admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:22.238191 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-d7194ad1-2b5a-432d-8b2b-42b6b575bd8a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027616 Aug 06 12:24:22.238727 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Aug 6 12:24:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:24:22.248593 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-bbf908fc-d947-4ae2-ab28-065300302215 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:22.255484 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.wsgi [None req-bbf908fc-d947-4ae2-ab28-065300302215 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-bbf908fc-d947-4ae2-ab28-065300302215 admin admin] Request method failure captured: Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Accept: application/json Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Accept-Encoding: gzip, deflate Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Connection: keep-alive Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Content-Length: 0 Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Host: 10.222.0.20 Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Openstack-Api-Version: compute 2.90 Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Openstack-System-Scope: None Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: User-Agent: python-novaclient Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Auth-Token: gAAAAABi7l11h2raBZy0b1h758lnR4tzIPGQOarPdA0ZItgIhIX9TzmjiBsbYJf6IRShi_1O7OrrURD7AHfbv5nR3oowoXI33XOfwF2QuyODbfljkE7LYUMzsWSxfxo662_c4ouC6MNBedRZ2XrT7nXDq6piTEjhHmaZ1__AfA61f_8ly0klesM Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Domain-Id: None Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Domain-Name: None Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Identity-Status: Confirmed Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Is-Admin-Project: True Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Domain-Id: default Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Domain-Name: Default Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Name: admin Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Role: member,admin,reader Aug 06 12:24:22.258776 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Roles: member,admin,reader Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Tenant: admin Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Tenant-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Tenant-Name: admin Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User: admin Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Domain-Id: default Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Domain-Name: Default Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Id: c9de148de73e459eb6456afdaf9fe213 Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Name: admin Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: method: > Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: exception: Flavor 42 could not be found. Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: action_args: {'id': '42'} Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:24:22.260152 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:22.260998 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:22.262151 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-bbf908fc-d947-4ae2-ab28-065300302215 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:24:22.263147 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-bbf908fc-d947-4ae2-ab28-065300302215 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015088 Aug 06 12:24:22.263147 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Aug 6 12:24:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 12:24:23.268956 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-d7194ad1-2b5a-432d-8b2b-42b6b575bd8a admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:23.269981 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-d7194ad1-2b5a-432d-8b2b-42b6b575bd8a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 06 12:24:23.270378 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:24:23.792200 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-620515c7-19b9-4946-bf9f-8943aa222708 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:23.797555 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.wsgi [None req-620515c7-19b9-4946-bf9f-8943aa222708 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-620515c7-19b9-4946-bf9f-8943aa222708 admin admin] Request method failure captured: Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Accept: application/json Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Accept-Encoding: gzip, deflate Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Connection: keep-alive Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Content-Length: 0 Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Host: 10.222.0.20 Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Openstack-Api-Version: compute 2.90 Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Openstack-System-Scope: None Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: User-Agent: python-novaclient Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Auth-Token: gAAAAABi7l13CKYTWteIonpiS2OAVFVEbGFVfsJ1yuQxrGR3WWQc_qdlkQdNuy1YGPxu_5l16QhGZ95XuH74FFKADX3OY6O3kU5fUNYmtxjtPLIbiG2Y4p41ETRrQus8TuuChY2OO_rpwYp8vbcVGrOW9owAgtEFikV3R3RKY44lp59uoWFHFOM Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Domain-Id: None Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Domain-Name: None Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Identity-Status: Confirmed Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Is-Admin-Project: True Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Domain-Id: default Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Domain-Name: Default Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Name: admin Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Role: member,admin,reader Aug 06 12:24:23.799046 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Roles: member,admin,reader Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Tenant: admin Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Tenant-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Tenant-Name: admin Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User: admin Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Domain-Id: default Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Domain-Name: Default Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Id: c9de148de73e459eb6456afdaf9fe213 Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Name: admin Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: method: > Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: exception: Flavor 84 could not be found. Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: action_args: {'id': '84'} Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:24:23.800589 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:23.801545 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:23.802940 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-620515c7-19b9-4946-bf9f-8943aa222708 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:24:23.804179 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-620515c7-19b9-4946-bf9f-8943aa222708 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393831 Aug 06 12:24:23.804179 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Aug 6 12:24:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 12:24:23.810126 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-f0182fa7-e0d2-40d6-9a5a-d7194bedd1b0 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:23.825298 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-f0182fa7-e0d2-40d6-9a5a-d7194bedd1b0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018712 Aug 06 12:24:23.825816 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Aug 6 12:24:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:24:23.835552 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-7a512965-4eaa-47de-a333-d0ee2d82c0fa admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:23.850070 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-7a512965-4eaa-47de-a333-d0ee2d82c0fa admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018658 Aug 06 12:24:23.850582 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Aug 6 12:24:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:24:23.859342 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-e6b4e910-4928-4354-a537-03b1e987ad1a admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:23.864708 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.wsgi [None req-e6b4e910-4928-4354-a537-03b1e987ad1a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-e6b4e910-4928-4354-a537-03b1e987ad1a admin admin] Request method failure captured: Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Accept: application/json Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Accept-Encoding: gzip, deflate Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Connection: keep-alive Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Content-Length: 0 Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Host: 10.222.0.20 Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Openstack-Api-Version: compute 2.90 Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Openstack-System-Scope: None Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: User-Agent: python-novaclient Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Auth-Token: gAAAAABi7l13CKYTWteIonpiS2OAVFVEbGFVfsJ1yuQxrGR3WWQc_qdlkQdNuy1YGPxu_5l16QhGZ95XuH74FFKADX3OY6O3kU5fUNYmtxjtPLIbiG2Y4p41ETRrQus8TuuChY2OO_rpwYp8vbcVGrOW9owAgtEFikV3R3RKY44lp59uoWFHFOM Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Domain-Id: None Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Domain-Name: None Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Identity-Status: Confirmed Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Is-Admin-Project: True Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Domain-Id: default Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Domain-Name: Default Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Name: admin Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Role: member,admin,reader Aug 06 12:24:23.866177 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Roles: member,admin,reader Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Tenant: admin Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Tenant-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Tenant-Name: admin Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User: admin Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Domain-Id: default Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Domain-Name: Default Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Id: c9de148de73e459eb6456afdaf9fe213 Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Name: admin Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: method: > Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: exception: Flavor 84 could not be found. Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: action_args: {'id': '84'} Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:24:23.867620 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:23.868756 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:23.870020 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-e6b4e910-4928-4354-a537-03b1e987ad1a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:24:23.871347 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-e6b4e910-4928-4354-a537-03b1e987ad1a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011549 Aug 06 12:24:23.871347 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Aug 6 12:24:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 12:24:24.830786 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-7a512965-4eaa-47de-a333-d0ee2d82c0fa admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:24.831811 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-7a512965-4eaa-47de-a333-d0ee2d82c0fa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 06 12:24:24.832203 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:24:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:24:25.346837 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-a2e60f6d-4961-451a-8427-df74bacf432c admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:25.352493 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.wsgi [None req-a2e60f6d-4961-451a-8427-df74bacf432c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-a2e60f6d-4961-451a-8427-df74bacf432c admin admin] Request method failure captured: Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Accept: application/json Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Accept-Encoding: gzip, deflate Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Connection: keep-alive Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Content-Length: 0 Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Host: 10.222.0.20 Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Openstack-Api-Version: compute 2.90 Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Openstack-System-Scope: None Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: User-Agent: python-novaclient Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Auth-Token: gAAAAABi7l14VSVelqugvofg6n5C6L32BLel1-ZW3VsuxokT39tyDyaMr8j7AX1dKlADIVTfPN3eLwybU-1rkX67jC2evdAoK3K1ZiTjVZnxLTpVwOyRieUeNeg_xQqgQhzkxDzr5mbysRRJZjg3RXeYVR0-Gp0k0PjANTyV24vjTtbBjVD8M2w Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Domain-Id: None Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Domain-Name: None Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Identity-Status: Confirmed Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Is-Admin-Project: True Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Domain-Id: default Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Domain-Name: Default Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Project-Name: admin Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Role: member,admin,reader Aug 06 12:24:25.353970 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Roles: member,admin,reader Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Tenant: admin Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Tenant-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-Tenant-Name: admin Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User: admin Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Domain-Id: default Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Domain-Name: Default Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Id: c9de148de73e459eb6456afdaf9fe213 Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: X-User-Name: admin Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: method: > Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: exception: Flavor 451 could not be found. Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: action_args: {'id': '451'} Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:24:25.355569 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:25.356529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: ERROR nova.api.openstack.wsgi Aug 06 12:24:25.357604 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-a2e60f6d-4961-451a-8427-df74bacf432c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:24:25.358639 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-a2e60f6d-4961-451a-8427-df74bacf432c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386247 Aug 06 12:24:25.358639 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Aug 6 12:24:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 12:24:25.365113 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-988718ba-31ee-483d-b79b-a0ca101d38cb admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:25.380003 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-988718ba-31ee-483d-b79b-a0ca101d38cb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017889 Aug 06 12:24:25.380538 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Aug 6 12:24:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:24:25.389799 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:25.404800 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018704 Aug 06 12:24:25.405313 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Aug 6 12:24:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:24:25.414167 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-1c846d2f-c909-42fe-96c6-45319b1c6b3f admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:25.419255 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.wsgi [None req-1c846d2f-c909-42fe-96c6-45319b1c6b3f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-1c846d2f-c909-42fe-96c6-45319b1c6b3f admin admin] Request method failure captured: Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Accept: application/json Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Accept-Encoding: gzip, deflate Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Connection: keep-alive Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Content-Length: 0 Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Host: 10.222.0.20 Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Openstack-Api-Version: compute 2.90 Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Openstack-System-Scope: None Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: User-Agent: python-novaclient Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Auth-Token: gAAAAABi7l14VSVelqugvofg6n5C6L32BLel1-ZW3VsuxokT39tyDyaMr8j7AX1dKlADIVTfPN3eLwybU-1rkX67jC2evdAoK3K1ZiTjVZnxLTpVwOyRieUeNeg_xQqgQhzkxDzr5mbysRRJZjg3RXeYVR0-Gp0k0PjANTyV24vjTtbBjVD8M2w Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Domain-Id: None Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Domain-Name: None Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Identity-Status: Confirmed Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Is-Admin-Project: True Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Domain-Id: default Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Domain-Name: Default Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Project-Name: admin Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Role: member,admin,reader Aug 06 12:24:25.420822 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Roles: member,admin,reader Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad154ab2bd64d7e8e712fcec9e1c94f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Tenant: admin Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Tenant-Id: 7ad154ab2bd64d7e8e712fcec9e1c94f Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-Tenant-Name: admin Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User: admin Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Domain-Id: default Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Domain-Name: Default Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Id: c9de148de73e459eb6456afdaf9fe213 Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: X-User-Name: admin Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: method: > Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: exception: Flavor 451 could not be found. Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: action_args: {'id': '451'} Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:24:25.422298 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:25.423120 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: ERROR nova.api.openstack.wsgi Aug 06 12:24:25.424279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-1c846d2f-c909-42fe-96c6-45319b1c6b3f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:24:25.425520 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-1c846d2f-c909-42fe-96c6-45319b1c6b3f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011422 Aug 06 12:24:25.425520 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Aug 6 12:24:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 06 12:24:26.390749 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:26.391742 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 06 12:24:26.392130 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:24:26.906173 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-56f4c7a7-b107-4e77-8bdb-9929fc867309 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:24:26.925784 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-56f4c7a7-b107-4e77-8bdb-9929fc867309 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.397061 Aug 06 12:24:26.926966 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Aug 6 12:24:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:24:27.885062 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:27.886058 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 06 12:24:27.886461 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:24:28.402429 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-f8228def-4ce9-4f37-9a8b-f6f625d89e21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:24:28.421577 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-f8228def-4ce9-4f37-9a8b-f6f625d89e21 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.397539 Aug 06 12:24:28.422113 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Aug 6 12:24:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:24:29.380845 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:29.381848 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 06 12:24:29.382241 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:24:29.895808 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-7324c5c5-a455-4679-805c-79c5bca9c1f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:24:29.913967 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-7324c5c5-a455-4679-805c-79c5bca9c1f8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.394839 Aug 06 12:24:29.914497 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Aug 6 12:24:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:24:30.898493 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:30.899663 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Aug 06 12:24:30.900064 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:24:31.417852 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-de8ed9e1-c6b0-4b05-be89-0fc40d7a50c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:24:31.436568 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-de8ed9e1-c6b0-4b05-be89-0fc40d7a50c0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.399847 Aug 06 12:24:31.437279 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Aug 6 12:24:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:24:32.511766 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:32.512842 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001948 Aug 06 12:24:32.513264 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:24:33.148854 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-e0556a80-4998-48a5-aa3f-c26c2d0fd863 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:24:33.169309 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-e0556a80-4998-48a5-aa3f-c26c2d0fd863 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.516043 Aug 06 12:24:33.169833 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Sat Aug 6 12:24:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:25:23.880388 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:25:23.881386 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-97802b2a-a2cd-4c02-affc-bf3ed52dfbf7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Aug 06 12:25:23.881805 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 931 bytes} [Sat Aug 6 12:25:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:25:23.892251 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:25:24.277954 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-d6bf28e1-cf24-4eff-8a34-3b3fbc103306 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:25:24.298611 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-d6bf28e1-cf24-4eff-8a34-3b3fbc103306 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410860 Aug 06 12:25:24.299146 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Aug 6 12:25:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:25:24.325300 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-a29cccba-c3bf-4900-8896-f1d8b7c1fbad admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:25:24.329707 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG dbcounter [-] [103122] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:25:24.338653 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-a29cccba-c3bf-4900-8896-f1d8b7c1fbad admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018874 Aug 06 12:25:24.339658 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1283 bytes} [Sat Aug 6 12:25:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:25:24.352146 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-95d079be-992a-432a-b3f4-ce248dd256fe admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:25:24.359710 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-95d079be-992a-432a-b3f4-ce248dd256fe admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011711 Aug 06 12:25:24.360221 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1286 bytes} [Sat Aug 6 12:25:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:25:24.372287 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-8d988aec-5cbe-4919-9812-7e384518e336 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:25:24.380493 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-8d988aec-5cbe-4919-9812-7e384518e336 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011631 Aug 06 12:25:24.381008 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1286 bytes} [Sat Aug 6 12:25:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:25:24.392578 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-d8d341a2-0f53-4419-a15c-523f01d8adfc admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:25:24.399939 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-d8d341a2-0f53-4419-a15c-523f01d8adfc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010909 Aug 06 12:25:24.400493 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1283 bytes} [Sat Aug 6 12:25:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:28:13.151258 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-8d988aec-5cbe-4919-9812-7e384518e336 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:28:13.152263 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-8d988aec-5cbe-4919-9812-7e384518e336 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 06 12:28:13.152685 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:28:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:28:13.291670 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=6 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:28:13.450307 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-c7a378b4-db2b-494c-85b2-d9bc542218ce admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:28:13.452921 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 12:28:13.452921 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 06 12:28:13.454038 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c7a378b4-db2b-494c-85b2-d9bc542218ce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:28:13.454512 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c7a378b4-db2b-494c-85b2-d9bc542218ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:28:13.454939 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c7a378b4-db2b-494c-85b2-d9bc542218ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:28:13.455654 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c7a378b4-db2b-494c-85b2-d9bc542218ce admin admin] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:28:13.456097 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c7a378b4-db2b-494c-85b2-d9bc542218ce admin admin] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:28:13.456536 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-c7a378b4-db2b-494c-85b2-d9bc542218ce admin admin] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:28:13.490900 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-c7a378b4-db2b-494c-85b2-d9bc542218ce admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200303 Aug 06 12:28:13.491454 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Aug 6 12:28:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:28:14.320534 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-8d988aec-5cbe-4919-9812-7e384518e336 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:28:14.321529 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-8d988aec-5cbe-4919-9812-7e384518e336 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 06 12:28:14.321919 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:28:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:28:14.514290 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-14de79cc-bf33-44d7-b933-ccc2e86a0759 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:28:14.516744 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 12:28:14.516744 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 06 12:28:14.517842 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-14de79cc-bf33-44d7-b933-ccc2e86a0759 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:28:14.518317 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-14de79cc-bf33-44d7-b933-ccc2e86a0759 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:28:14.518743 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-14de79cc-bf33-44d7-b933-ccc2e86a0759 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:28:14.519451 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-14de79cc-bf33-44d7-b933-ccc2e86a0759 admin admin] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:28:14.519892 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-14de79cc-bf33-44d7-b933-ccc2e86a0759 admin admin] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:28:14.520328 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-14de79cc-bf33-44d7-b933-ccc2e86a0759 admin admin] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:28:14.539764 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-14de79cc-bf33-44d7-b933-ccc2e86a0759 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076897 Aug 06 12:28:14.540319 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Aug 6 12:28:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:28:25.785419 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-8d988aec-5cbe-4919-9812-7e384518e336 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:28:25.786416 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-8d988aec-5cbe-4919-9812-7e384518e336 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Aug 06 12:28:25.786801 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:28:25.933741 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell0:SELECT=4 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:28:25.934447 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_cell1:SELECT=4 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:28:25.935040 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG dbcounter [-] [103123] Writing DB stats nova_api:SELECT=8 {{(pid=103123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:28:25.982043 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-58acfbb7-4faa-43c6-ae7b-4e64301ab629 admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:28:25.984449 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 12:28:25.984449 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 06 12:28:25.985594 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-58acfbb7-4faa-43c6-ae7b-4e64301ab629 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:28:25.986011 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-58acfbb7-4faa-43c6-ae7b-4e64301ab629 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:28:25.986433 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-58acfbb7-4faa-43c6-ae7b-4e64301ab629 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:28:25.987143 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-58acfbb7-4faa-43c6-ae7b-4e64301ab629 admin admin] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:28:25.987582 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-58acfbb7-4faa-43c6-ae7b-4e64301ab629 admin admin] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:28:25.987996 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-58acfbb7-4faa-43c6-ae7b-4e64301ab629 admin admin] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:28:26.013214 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-58acfbb7-4faa-43c6-ae7b-4e64301ab629 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084392 Aug 06 12:28:26.013774 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 37/74] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Aug 6 12:28:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:28:26.842379 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: DEBUG nova.api.openstack.wsgi [None req-8d988aec-5cbe-4919-9812-7e384518e336 admin admin] Calling method '>' {{(pid=103122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:28:26.843379 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: INFO nova.api.openstack.requestlog [None req-8d988aec-5cbe-4919-9812-7e384518e336 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 06 12:28:26.843779 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: [pid: 103122|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Aug 6 12:28:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:28:27.035674 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG nova.api.openstack.wsgi [None req-82d739a2-6de1-4b75-a8e6-264f4c2e97bf admin admin] Calling method '>' {{(pid=103123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:28:27.038104 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 12:28:27.038104 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: warnings.warn(msg) Aug 06 12:28:27.039245 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-82d739a2-6de1-4b75-a8e6-264f4c2e97bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:28:27.039721 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-82d739a2-6de1-4b75-a8e6-264f4c2e97bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:28:27.040158 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-82d739a2-6de1-4b75-a8e6-264f4c2e97bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:28:27.040915 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-82d739a2-6de1-4b75-a8e6-264f4c2e97bf admin admin] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:28:27.041366 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-82d739a2-6de1-4b75-a8e6-264f4c2e97bf admin admin] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:28:27.041792 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: DEBUG oslo_concurrency.lockutils [None req-82d739a2-6de1-4b75-a8e6-264f4c2e97bf admin admin] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:28:27.063519 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: INFO nova.api.openstack.requestlog [None req-82d739a2-6de1-4b75-a8e6-264f4c2e97bf admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079663 Aug 06 12:28:27.064064 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: [pid: 103123|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Aug 6 12:28:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:29:22.757047 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: Sat Aug 6 12:29:22 2022 - graceful shutdown triggered... Aug 06 12:29:22.758025 dv-cinder-851996-3-iscsi devstack@n-api.service[103122]: Gracefully killing worker 1 (pid: 103122)... Aug 06 12:29:22.758376 dv-cinder-851996-3-iscsi devstack@n-api.service[103123]: Gracefully killing worker 2 (pid: 103123)... Aug 06 12:29:22.759951 dv-cinder-851996-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 06 12:29:23.757672 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: worker 1 buried after 1 seconds Aug 06 12:29:23.758205 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: worker 2 buried after 1 seconds Aug 06 12:29:23.758205 dv-cinder-851996-3-iscsi devstack@n-api.service[103121]: goodbye to uWSGI. Aug 06 12:29:23.759241 dv-cinder-851996-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 06 12:29:23.759776 dv-cinder-851996-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 06 12:29:23.762630 dv-cinder-851996-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 12:29:23.773601 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 12:29:23 2022] *** Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: nodename: dv-cinder-851996-3-iscsi Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: machine: x86_64 Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: clock source: unix Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: pcre jit disabled Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: detected number of CPU cores: 4 Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: current working directory: / Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: detected binary path: /usr/bin/uwsgi-core Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: your processes number limit is 47680 Aug 06 12:29:23.775618 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: your memory page size is 4096 bytes Aug 06 12:29:23.776433 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: detected max file descriptor number: 2048 Aug 06 12:29:23.776433 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: lock engine: pthread robust mutexes Aug 06 12:29:23.776433 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: thunder lock: enabled Aug 06 12:29:23.776433 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 12:29:23.776433 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 12:29:23.815571 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: Python main interpreter initialized at 0x561566cb19c0 Aug 06 12:29:23.815571 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: python threads support enabled Aug 06 12:29:23.815571 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: your server socket listen backlog is limited to 100 connections Aug 06 12:29:23.815571 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: your mercy for graceful operations on workers is 90 seconds Aug 06 12:29:23.816017 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 12:29:23.816017 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: *** Operational MODE: preforking *** Aug 06 12:29:23.816296 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: *** uWSGI is running in multiple interpreter mode *** Aug 06 12:29:23.816296 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: spawned uWSGI master process (pid: 117810) Aug 06 12:29:23.816525 dv-cinder-851996-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 06 12:29:23.817095 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: spawned uWSGI worker 1 (pid: 117824, cores: 1) Aug 06 12:29:23.817593 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: spawned uWSGI worker 2 (pid: 117825, cores: 1) Aug 06 12:29:23.817878 dv-cinder-851996-3-iscsi devstack@n-api.service[117810]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 12:29:24.477145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 12:29:24.481780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 12:29:25.628601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 12:29:25.628601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: from cryptography.utils import int_from_bytes Aug 06 12:29:25.629250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 12:29:25.629250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: from cryptography.utils import int_from_bytes Aug 06 12:29:25.636250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 12:29:25.636250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: from cryptography.utils import int_from_bytes Aug 06 12:29:25.636762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 12:29:25.636762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: from cryptography.utils import int_from_bytes Aug 06 12:29:27.952787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 12:29:27.953338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 12:29:27.953642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 12:29:27.953927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 12:29:27.954181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 12:29:27.954565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.954886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.955205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.955518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.955845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.956152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.956512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.956826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.957150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.957407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.957717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.958039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-3-iscsi {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.958357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.958662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.958969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.959283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.959589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.959907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.960237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.960757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.962113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.962113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.962113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.962382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.962700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.963024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.963335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.963671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.963953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.964271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.964686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-3-iscsi {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.965013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.965328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.965632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.966034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.966337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.966643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.966959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.967307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.967602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.967917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.968236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.968575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.968915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.969191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.969503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.969807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.970125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.970427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.970724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.970988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.971277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.971591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.971909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.972228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.972500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.972751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.973110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.973378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.973682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.973986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.974317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.974589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.974893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.975191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.975493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.976375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.976669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.976982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.977301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.977608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.977922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.978325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.978570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.978875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.979211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.979535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.979828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.980162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.980526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.980791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.981096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.981433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.981713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.982048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.982351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.982600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.982899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.983465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.983639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.983845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.984757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.984757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.984757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.985260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.985260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.985570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.985876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.986176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.986475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.986780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.987078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.987378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.987698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.988014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.988333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.988640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.988941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.989242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.989557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.989860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.990163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.990481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.991035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.991388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.992221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.992575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.996568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.996568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.996568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.996568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.996568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.996568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.996568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.996568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.997795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 12:29:27.998276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.998432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 12:29:27.998596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.998763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 12:29:27.998907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.998907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.999212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 12:29:27.999359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.999511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 12:29:27.999665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.999809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:27.999985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.000133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.000276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.000460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.000618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.000771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.000933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.001108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.001263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.001414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.001568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.001726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.001883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.006375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.006555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.006708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.006864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.007025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.007179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.007335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.007499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.007646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-3-iscsi {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.007797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.007958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.010289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.010475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.010645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.010809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.010970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.011136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.011292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.011446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.011603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.011754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.011909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.012054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.012200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.012508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.012730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.012889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.013048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.013194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.013339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.013500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.013653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.013825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.013974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.014118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.014273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.014425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.014568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.014720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.014874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.015024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.016486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.016660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.016828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.016988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.017134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.017134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.017409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-3-iscsi {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.017409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.017689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.017843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.017992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.018136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.018278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.018278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.018580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.018743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.018894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.019045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.021102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.021858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.022016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.022166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.022314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.022469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.022635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.022783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.022933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.023094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.023238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.023389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.023547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.023693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.023838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.023992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.024147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.024343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.024506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.024665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.024813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.024978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.025123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.025294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.025952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.026116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.026269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.026269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.026605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.026775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.026930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.027082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.027227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.027227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.027529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.027690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.027835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.027835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.028126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.028275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.028462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.028609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.028753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.028896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.029042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.029185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.029352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.029504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.029655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.029807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.030702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.030943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.031108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.031261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.031413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.031565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.031708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.031860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.032070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.032220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.032397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.032551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.032722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.032962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.033122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.033275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.033419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.033573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.033723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.033879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.034031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.034031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.034330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.034481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.034636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.034792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.034937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.035085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.035230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.035374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.035548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.036158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.036351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.036504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.036702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.036864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.037029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.037173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.037316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.037469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.037612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.037763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.037919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.038070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.038717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.038869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.039029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.039183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.039333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.039333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.039632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.039777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.039929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.040101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.040859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.041132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.041294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.041294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.041579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.041746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.041905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.042057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.042202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.042344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.042486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.042638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.042791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.042935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.043088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.043240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.043390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.043534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.043701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.043846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.044001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.044152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.044378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.044583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.044747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.044898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.045052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.045203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.045354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.045498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.045655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.046291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.046456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.046611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.046806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.046966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.047120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.047273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.047424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.047577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.047743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.047896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.048049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.048201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.048386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.048545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.048697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.048860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.049017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.049161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.049318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.049463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.049681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.049840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.049986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.050130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.050297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.050450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.050602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.050857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.051013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.051275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.051436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.051582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.051726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.051870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.052014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.052014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.052345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.052520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.052673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.052818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.052961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.053120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.053266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.053415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.053560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.053710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.054003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.054663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.054823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.054823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.055112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.055271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.055415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.055568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.055724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.055875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.055875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.056652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.056860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.057019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.057175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.057322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.057465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.057619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.057780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.057933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 12:29:28.058077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.058077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.058359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.058503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.058702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.058853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.058996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.059147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.059291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.059435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.059602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.059756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.059907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.060058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.060201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.060574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.060736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.060997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.061152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.061400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.061562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.061716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.061874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.062018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.062168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.062321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.062474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.062628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.062773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.062917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.063060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.063203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.063360 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.063513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.063513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.063811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.063956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.064108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.064266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.064436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.064591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.064814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.064981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.065140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.065305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.065464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.065615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.065774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.065942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.066561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.066733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.066933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.067091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.067249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.067407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.067567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.067718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.067879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.068031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.068181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.068386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.069637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.069813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.069977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.070129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.070279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.070439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.070439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.070848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.071010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.071270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.071451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.071699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.071879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.072035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.072193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.072377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.072542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.072702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.072868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.073023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.073180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.073331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.073481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.073640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.073791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.073959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.074113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.074262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.074419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.074579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.074737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.074888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.075037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.075188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.075344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.075508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.075667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.075818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.075985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.076138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.076703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.076877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.077080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.077248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.077401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.077559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.077719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.077871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.078029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.078188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.078340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.078501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.078665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.078824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.078982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.079146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.079300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.079459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.079643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.079979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.080137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.080332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.080505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.080692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.080692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.081075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.081236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.081499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.081656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.081920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.082079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.082079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.082382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.082543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.082701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.082867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.083029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.083181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.083331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.083489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.083639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.083801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.083960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.084111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.084278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.084456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.084608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.084769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.084930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.085118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.085284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.085436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.085593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.085751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.085901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.086059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.086222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.086391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.086936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.087731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.087903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.087903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.088202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.088437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.088646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.088818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.088968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.089127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.089299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.089451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.089615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.089776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.089998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.090159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.090318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.090469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.090640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.090793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.091041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.091200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.091351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.091536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.091797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.092079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.092239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.092440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.092603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.092833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.092997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.093157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.093308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.093459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.093618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.093780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.093932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.094084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.094242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.094393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.094578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.095301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.095466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.095627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.095786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.095944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.096106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.096258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.096475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.097406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.097579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.097787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.097958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.098124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.098276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.098427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.098577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.098749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.098911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.099071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.099232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.099391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.099549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.099939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.100102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.100276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.100454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.100625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.102859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.103069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.103229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.103392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.103547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.103715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.103867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.104036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.104189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.104371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.104555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.104709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.104859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.105036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.105036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.105336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.105489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.105638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.105798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.105949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.106106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.106258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.106409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.106579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.106739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.107377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.107539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.107700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.107851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.108011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.108175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.108358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.108523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.108683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.108845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.109004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.109178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.109338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.109498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.109694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.109854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.110006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.110166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.110324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.110483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.110642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.110802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.110802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.111118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.111118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.111508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.111508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.111812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.111990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.112245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.112506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.112662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.112813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.112964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.113126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.113279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.113430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.113591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.113743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.113895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.114055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.114214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.114373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.114524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.114682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.114848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.115002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.115160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.115319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.115488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.115902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.116070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.116229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.116987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.117566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.117727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.117887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.118050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.118204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.118363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.118515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.118666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.118847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.119010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.119164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.119322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.119473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.119939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.120110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.120272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.120461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.120461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.120758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.120956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.121128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.121293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.121474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.121710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.121874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.122026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.122186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.122443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.122607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.122768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.122928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.123087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.123249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.123410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.123580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.123785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.123953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.124154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.124465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.124630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.124792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.124944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.125105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.125272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.125434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.125594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.125746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.125934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.126088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.126248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.126408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.126569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.126721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.126880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.127032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.127226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.127798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.127960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.128113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.128276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.128452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.128619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.128791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.128951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.129103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.129254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.129414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.129573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.129726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.129877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.130028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.130185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.130356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.130510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.130662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.130821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.130972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.131131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.131304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.131468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.131620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.131912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.132183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.132466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.132719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.132896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.133647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.133821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.133990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.134158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.134320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.134500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.134500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.134799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.134952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.135112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.135266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.135436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.135588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.135739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.135889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.135889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.136192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.136392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.136560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.136713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.136877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.137037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.137188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.137338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.138438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.138572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.138668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.138754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.138828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.138901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.138986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.139956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.140986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.141982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.142935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.143943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.144948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.145976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.146999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.147080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.147154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.147251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.147330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.147428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.147511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.147619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.147766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.147903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.148031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.148174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.148267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.148382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.148478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.148566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.148659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.148753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.148845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.148930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.149926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.150994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.151089 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.151189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.151281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.151375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.151461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.151552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.151638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.151731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.151818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.151910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.152947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.153026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.153106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.153233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.153326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.153412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.153510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.153603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.153694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.153779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.153869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.154971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.155973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.156992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.157957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.158968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.159936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.160949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161309 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.161953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.162961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.163094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.163693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.163780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.163913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.164976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.165119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.165211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.165303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.165397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.165491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.165576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.165667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.165759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.165851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.165942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.166917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.167950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.168992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.169958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.170937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.171917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.172009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.172103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.172189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.172279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.172437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.172533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.172694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.172782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.172873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.172965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.173947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.174914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.175981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.176071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.176156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.176239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.176439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.176541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.176541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.176704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.176796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.176952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.177940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.178086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.178177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.178248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.178326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.178398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.178477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.178557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.178636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.178769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.179442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.179551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.179648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.179735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.179827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.179926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.180950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.181034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.181126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.181224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.181317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.181409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.181501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.181594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.181679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.181776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.181914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.182995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.183080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.183163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.183247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.183385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.183487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.183581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.183674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.183674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.183843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.183945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.184038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.184166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.184258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.184392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.184392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.184613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.184710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.184710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.184865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.184949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.185986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.186966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.187995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.188964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.189036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.189207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.189305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.189515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.189635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.189818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.189925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.190120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.190240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.190419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.190525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.190728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.190839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.191028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.191123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.191327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.191421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.191624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.191732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.191922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.192016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.192219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.192341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.192571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.192767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.192899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.193077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.193209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.193406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.193567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.193730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.193832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.194052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.194146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.194368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.194554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.194729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.194853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.195053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.195148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.195357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.195465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.195658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.195759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.195966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.196067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.196280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.196464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.196601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.196694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.196905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.196997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.197212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.197316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.197510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.197654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.197813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.197908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.198118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.198220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.198441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.198650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.198754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.198994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.199102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.199309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.199402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.199633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.199735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.199940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.200041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.200246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.200360 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.200574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.200682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.200894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.200989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.201195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.201288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.201496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.201596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.201800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.201895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.202102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.202193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.202402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.202510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.202703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.202796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.203005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.203104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.203307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.203412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.203605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.203705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.203910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.204004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.204207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.204328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.204543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.204647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.204862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.204962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.205185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.205288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.205484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.205583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.205792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.205893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.206099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.206194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.206399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.206491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.206698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.206798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.206998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.207091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.207306 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.207401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.207543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 12:29:28.207635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.207897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.208196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.208534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.208837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.209144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.209446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.209767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.211109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.211499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.211829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.212150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.212511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.212832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.213147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.213501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.213820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.214407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.214743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.215064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.215402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.215735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.216042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.216368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.216677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.217003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.217318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.217626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.217936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.218244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.218553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.218862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.219172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.219479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.219786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.220093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.220421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.220732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.221037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.221343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.221657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.222046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.222367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.222683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.222997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.223364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.223620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.223928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.224234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.224567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.224881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.225212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.225522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.226382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.226817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.227129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.227448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.227772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.228078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.228425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.228747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.229058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.229376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.229683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.230011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.230351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.230677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.231000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.231303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.231605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.231907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.232214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.232555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.232861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.233159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.233459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.233765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.234066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.234368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.234668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.234968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.235273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.235573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.235872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.236174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.236582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.236888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.237191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.237498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.237805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.238107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.238407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.238813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.239004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.239459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.239675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.239984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.240969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.240969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.241238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.241487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.241807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.242126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.242444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.242757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.243087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.243395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.243703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.244012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.244362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.245258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.245571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.245907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.246234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.246541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.246915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.247178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.247499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.247819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.248128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.248480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.248792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.249101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.249777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.249777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.250059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.250370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.250608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.250915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.251225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.251586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.251923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.252242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.252627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.252954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.253277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.253627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.253936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.254281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.254605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.254920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.255227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.255527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 12:29:28.255808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 12:29:28.359626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO dbcounter [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Registered counter for database nova_api Aug 06 12:29:28.380153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_db.sqlalchemy.engines [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:29:28.387238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writer thread running {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:29:28.405665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Registered counter for database nova_api Aug 06 12:29:28.425084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:29:28.432050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:29:28.442699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.context [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),061923a9-3e0d-4e1d-84a5-ebe9694ea1ee(cell1) {{(pid=117824) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 12:29:28.447270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:29:28.447740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:29:28.449329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:29:28.450057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:29:28.450499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:29:28.452495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:29:28.454437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO dbcounter [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Registered counter for database nova_cell0 Aug 06 12:29:28.458491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO dbcounter [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Registered counter for database nova_cell1 Aug 06 12:29:28.465913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_db.sqlalchemy.engines [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:29:28.467717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_db.sqlalchemy.engines [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:29:28.473940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writer thread running {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:29:28.475500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writer thread running {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:29:28.487648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.context [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),061923a9-3e0d-4e1d-84a5-ebe9694ea1ee(cell1) {{(pid=117825) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 12:29:28.492503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:29:28.492979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:29:28.494528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:29:28.495258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:29:28.495701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:29:28.497696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:29:28.499654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Registered counter for database nova_cell0 Aug 06 12:29:28.503662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Registered counter for database nova_cell1 Aug 06 12:29:28.512288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:29:28.513388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:29:28.518291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:29:28.520929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:29:28.620769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO dbcounter [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Registered counter for database nova_cell0 Aug 06 12:29:28.630083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_db.sqlalchemy.engines [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:29:28.635399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writer thread running {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:29:28.665023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Registered counter for database nova_cell0 Aug 06 12:29:28.671846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 12:29:28.676475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 12:29:28.962946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: WARNING keystonemiddleware.auth_token [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 12:29:28.970293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: WARNING keystonemiddleware.auth_token [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 12:29:28.991541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 12:29:28.998830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 12:29:29.320394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: WARNING keystonemiddleware.auth_token [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 12:29:29.326381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: WARNING keystonemiddleware.auth_token [None req-88bcaaa4-f5e3-4d78-b432-78757c4ac4b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 12:29:29.332972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561566cb19c0 pid: 117824 (default app) Aug 06 12:29:29.346218 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 12:29:29.352092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-f1e8b3dc-3144-40f8-b784-126b33fb989f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 12:29:29.358584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561566cb19c0 pid: 117825 (default app) Aug 06 12:30:04.474793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:04.478112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:04.479337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:04.482611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:05.055383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:05.057122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:05.058792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:05.066914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:05.888980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5cc112e3-59f0-4bec-9214-1763106d6b31 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Action: 'create', calling method: .version_select at 0x7f541c922dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-102858884"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:06.278211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-600dbf71-0208-4251-a00a-d526a38187a6 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Action: 'create', calling method: .version_select at 0x7f541c920dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-305823397", "metadata": {"Type": "work"}}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:07.582639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-600dbf71-0208-4251-a00a-d526a38187a6 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.532907 Aug 06 12:30:07.583335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Aug 6 12:30:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2535 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 06 12:30:07.597514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5cc112e3-59f0-4bec-9214-1763106d6b31 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.148574 Aug 06 12:30:07.598648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1155 bytes} [Sat Aug 6 12:30:04 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3151 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 06 12:30:07.602545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ec5e33f5-54df-44d6-a008-fa4e996e3fa3 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c80fc10>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:07.617632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b3bca6a6-c084-46c2-a641-f7d285c88339 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c80ec10>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:07.680179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ec5e33f5-54df-44d6-a008-fa4e996e3fa3 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.083818 Aug 06 12:30:07.681611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:07 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:30:07.808223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b3bca6a6-c084-46c2-a641-f7d285c88339 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b" status: 200 len: 344 microversion: 2.1 time: 0.194826 Aug 06 12:30:07.818789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:07 2022] GET /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b => generated 344 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:08.589183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4a375130-0ad4-42fa-be02-bb238db75e0e tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541c7ac310>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:08.656812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4a375130-0ad4-42fa-be02-bb238db75e0e tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/0017307a-7438-4aaa-9767-10d1b95e3e99" status: 200 len: 349 microversion: 2.1 time: 0.072923 Aug 06 12:30:08.657587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:08 2022] GET /compute/v2.1/os-volumes/0017307a-7438-4aaa-9767-10d1b95e3e99 => generated 349 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:08.695109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d23162be-b4b9-4583-b449-ac6cfa909aef tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c7b1310>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:08.810889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d23162be-b4b9-4583-b449-ac6cfa909aef tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.120818 Aug 06 12:30:08.811942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:08 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:08.823765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6f0cd424-b28d-492d-9fe7-585e17786782 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c7aca60>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:08.886080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6f0cd424-b28d-492d-9fe7-585e17786782 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b" status: 200 len: 345 microversion: 2.1 time: 0.065887 Aug 06 12:30:08.895097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:08 2022] GET /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:08.900971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8a596c79-ebe7-4f2a-bc93-8f965b26c319 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Action: 'create', calling method: .version_select at 0x7f541c7b19d0>, body: {"snapshot": {"volume_id": "066a3ba7-ee5e-4333-aa81-76b8a780ed4b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1759231785"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:09.332627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8a596c79-ebe7-4f2a-bc93-8f965b26c319 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.436337 Aug 06 12:30:09.333494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 4/8] 10.222.0.20 () {60 vars in 1162 bytes} [Sat Aug 6 12:30:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:09.344975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d5638e18-b0bf-44eb-9434-791622169df2 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c80fca0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:09.472773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d5638e18-b0bf-44eb-9434-791622169df2 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.132481 Aug 06 12:30:09.473663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:09 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:09.486074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-530ac671-b17c-4476-8a55-0cf6de70f761 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c7b1d30>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:09.589255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-530ac671-b17c-4476-8a55-0cf6de70f761 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.108113 Aug 06 12:30:09.590196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1140 bytes} [Sat Aug 6 12:30:09 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:09.602152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8938c7de-de9c-498d-b05e-523b71ee2a5c tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c7ac9d0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:09.661327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8938c7de-de9c-498d-b05e-523b71ee2a5c tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.063833 Aug 06 12:30:09.666718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:09 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:09.826522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7b7abbab-3244-497c-b1e1-45e1b9eb1a7c tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c80eaf0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:09.941669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7b7abbab-3244-497c-b1e1-45e1b9eb1a7c tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 353 microversion: 2.1 time: 0.118365 Aug 06 12:30:09.945303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:09 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:09.962703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d2169471-8197-4f9b-9f01-a4dce37ab9a0 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c7ac280>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:10.145837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d2169471-8197-4f9b-9f01-a4dce37ab9a0 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 353 microversion: 2.1 time: 0.192297 Aug 06 12:30:10.147245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:09 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:10.166323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8f685a3c-02b6-42e2-bd27-273b71257dd2 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c7b6670>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:10.389923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8f685a3c-02b6-42e2-bd27-273b71257dd2 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 202 len: 0 microversion: 2.1 time: 0.228031 Aug 06 12:30:10.390957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Aug 6 12:30:10 2022] DELETE /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:30:10.400819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b270f44d-b884-49a6-8428-398ac1e68ca3 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c7ac1f0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:10.571303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b270f44d-b884-49a6-8428-398ac1e68ca3 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.175727 Aug 06 12:30:10.574766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:10 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:10.674785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-23e32390-48f2-4988-90ca-2bf17dfd724c tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c80edc0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:10.727697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-23e32390-48f2-4988-90ca-2bf17dfd724c tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.056324 Aug 06 12:30:10.728594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:10 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:11.587220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-34633037-7f17-45c4-867b-8826a0b2d80d tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c7ac9d0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:11.711962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-34633037-7f17-45c4-867b-8826a0b2d80d tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.128730 Aug 06 12:30:11.712798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 9/17] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:11 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:11.745086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-35faf487-9fcd-4659-91f6-ea4b84a15be2 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c7b13a0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:11.886729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-35faf487-9fcd-4659-91f6-ea4b84a15be2 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.149797 Aug 06 12:30:11.887291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 9/18] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:11 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:12.725767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9fcaeb6c-a7cb-4fce-ac12-300d1fc226a9 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c80fca0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:12.907320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6b40466e-c768-4592-b623-6c36dc475e71 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c7b1af0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:12.909722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9fcaeb6c-a7cb-4fce-ac12-300d1fc226a9 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.187630 Aug 06 12:30:12.910589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 10/19] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:12 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:12.979684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6b40466e-c768-4592-b623-6c36dc475e71 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.076885 Aug 06 12:30:12.980372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 10/20] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:12 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:13.923181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3d7a0d0-1a5e-458d-a832-4b5f3df9fea2 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c80fc10>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:13.993972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f25fc070-f730-4278-9674-f8bcdcb366dd tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c7b1d30>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:14.072436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f25fc070-f730-4278-9674-f8bcdcb366dd tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.083899 Aug 06 12:30:14.073305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 11/21] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:13 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:30:14.134745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3d7a0d0-1a5e-458d-a832-4b5f3df9fea2 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.215510 Aug 06 12:30:14.136117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 11/22] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:13 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:15.086804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b0cbb913-7479-4004-91fe-623e50ca80c8 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c7b11f0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:15.142959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b0cbb913-7479-4004-91fe-623e50ca80c8 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.059546 Aug 06 12:30:15.148088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3db592b5-9094-42af-a6c1-c64505959694 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c7ac940>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:15.148617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:15 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:15.219847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3db592b5-9094-42af-a6c1-c64505959694 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.075315 Aug 06 12:30:15.220587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:15 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:30:16.155808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2c6d34d5-2c9b-4d0d-ab0c-d6532840c08a tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c80eee0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:16.215919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2c6d34d5-2c9b-4d0d-ab0c-d6532840c08a tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 288 microversion: 2.1 time: 0.063806 Aug 06 12:30:16.224335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:16 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 288 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:16.229340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8739040d-7649-4dcd-8198-e52570ebf08d tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c7ac040>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:16.236068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6be7c6a2-ba8a-487c-a146-05fc9f003f5d tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c7b68b0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:16.339356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6be7c6a2-ba8a-487c-a146-05fc9f003f5d tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.108509 Aug 06 12:30:16.340190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 14/26] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:16 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:30:16.471864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8739040d-7649-4dcd-8198-e52570ebf08d tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 202 len: 0 microversion: 2.1 time: 0.246076 Aug 06 12:30:16.477613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1254 bytes} [Sat Aug 6 12:30:16 2022] DELETE /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:30:16.482857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a251cbd3-e469-45cd-b634-e2bcf5087341 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c7bf430>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:16.547882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a251cbd3-e469-45cd-b634-e2bcf5087341 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.068975 Aug 06 12:30:16.559292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 14/28] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:16 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:16.562494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-280e7477-cc92-4de7-a049-20cc82cc2ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'create', calling method: .version_select at 0x7f541c80ec10>, body: {"keypair": {"name": "tempest-keypair-205071423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB54/IWA79yX6h4NiRD49fkK1RR+n8b0xboaTgbXFgH02AGPz/lK5xehcI1bbk8G8EH2JRJhw6s4K021bWgwfqZEo6Vongb541R5Qe0YsDk4ZnrqMGhKiEru1XBxDtfTxw=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:16.641695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-280e7477-cc92-4de7-a049-20cc82cc2ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Getting quotas for project 9ce267dd4f15447fae8aef5e99cbb018. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:30:16.652094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-280e7477-cc92-4de7-a049-20cc82cc2ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Getting quotas for user 257ddc018c33406aa47e7e7129943ae3 and project 9ce267dd4f15447fae8aef5e99cbb018. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:30:16.752687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-280e7477-cc92-4de7-a049-20cc82cc2ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.384115 Aug 06 12:30:16.756021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 15/29] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Aug 6 12:30:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 390 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 12:30:17.336731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-41254f07-ac5a-4c13-ba11-68b77a4b81e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: .version_select at 0x7f541c80fdc0>, body: {"keypair": {"name": "tempest-keypair-410279104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXHaW6VM/qu0U2kcQjfJXVLrriGbS8BCQ52Nm3cn6TJ/CabPaktSYId7MJbl1YXhBB9xjSPMDbYMUmq9+6q8FJU0d/4Ajfw64VQq2khP7KB0D5KB8XplUFYh6vhv4xHwA=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:17.355846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8c78b279-a6a5-4bf8-a5d7-ef8db107de47 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c739160>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:17.505575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8c78b279-a6a5-4bf8-a5d7-ef8db107de47 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.155016 Aug 06 12:30:17.506581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 16/30] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:17 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:17.523309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-41254f07-ac5a-4c13-ba11-68b77a4b81e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:30:17.568054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e4ddb669-a7b3-47bf-ac79-6f96143b6eb4 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c739820>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:17.572028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-41254f07-ac5a-4c13-ba11-68b77a4b81e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for user 1125a0b93c9d45ccb2d3f28f188dfd04 and project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:30:17.643683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e4ddb669-a7b3-47bf-ac79-6f96143b6eb4 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.081974 Aug 06 12:30:17.644117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 17/31] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:17 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:17.705873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-41254f07-ac5a-4c13-ba11-68b77a4b81e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.478985 Aug 06 12:30:17.710094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 15/32] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Aug 6 12:30:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:18.314802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-998806810", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "networks": [{"uuid": "d051604f-6a83-4a35-b9a7-241bfaca0340"}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:18.493087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] validate_networks() for [('d051604f-6a83-4a35-b9a7-241bfaca0340', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:30:18.519849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-59e78031-1017-4e00-959e-35464d0190dd tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c73b3a0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:18.653443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-59e78031-1017-4e00-959e-35464d0190dd tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.138099 Aug 06 12:30:18.654236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 16/33] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:18 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:30:18.664406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aab9eb8e-b683-4f42-a237-c510c36964ad tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c788940>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:18.840739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aab9eb8e-b683-4f42-a237-c510c36964ad tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.183918 Aug 06 12:30:18.847554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 17/34] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:18 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:19.675095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b51ae04-bb8f-4d91-a137-01d7f364bfe7 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541c73b8b0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:19.863346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b51ae04-bb8f-4d91-a137-01d7f364bfe7 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.199369 Aug 06 12:30:19.865226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 18/35] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:19 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:30:19.871564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-645e6d1a-e4d1-46bf-a8f7-22bf824d4acc tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541c73bf70>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:19.938445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-645e6d1a-e4d1-46bf-a8f7-22bf824d4acc tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 200 len: 287 microversion: 2.1 time: 0.071625 Aug 06 12:30:19.939019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 19/36] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:19 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:20.218715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-618678552", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:20.424863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] validate_networks() for [('f9772107-4faf-4fb2-a5c9-81f3bb613c65', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:30:20.770166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:30:20.770716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:30:20.771118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:30:20.771530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:30:20.772741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:30:20.785597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:20.786459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:20.787143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:20.788691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:20.789488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:20.789996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:20.863373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Getting quotas for project 6111202e81324d069fae641cc1606e77. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:30:20.869985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Getting quotas for user 79c2d686d2034765ac50f7ad75295197 and project 6111202e81324d069fae641cc1606e77. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:30:20.886504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:30:20.891078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:30:21.045387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ec02618c-3153-4813-ab93-08a48ca64e97 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.845594 Aug 06 12:30:21.046079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:30:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 12:30:21.062450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-114d0e51-562b-4527-8177-4dd849312f42 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541be5adc0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:21.275476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-114d0e51-562b-4527-8177-4dd849312f42 tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 200 len: 352 microversion: 2.1 time: 0.228035 Aug 06 12:30:21.276120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 19/38] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:21 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 352 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:21.282257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1879806442", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6d29da4-1787-4a36-8551-8fbcda8f3c70"}], "security_groups": [{"name": "tempest-securitygroup--1122200498"}], "key_name": "tempest-keypair-205071423", "user_data": "}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:21.546515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] validate_networks() for [('e6d29da4-1787-4a36-8551-8fbcda8f3c70', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:30:22.508513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:30:22.509058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:30:22.509354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:30:22.509797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:30:22.510280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:30:22.531415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:22.532530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:22.534449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:22.537198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:22.542422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:22.543109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:22.595375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Getting quotas for project 9ce267dd4f15447fae8aef5e99cbb018. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:30:22.605063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Getting quotas for user 257ddc018c33406aa47e7e7129943ae3 and project 9ce267dd4f15447fae8aef5e99cbb018. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:30:22.630580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:30:22.636094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:30:22.697289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-523c28c7-9595-4684-8952-011bafc880b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.419617 Aug 06 12:30:22.698173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 20/39] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Aug 6 12:30:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 12:30:22.702996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a1b5cff-8ce4-42e1-9677-ff12156732c4 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541be5ab80>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:22.750234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-0a1b5cff-8ce4-42e1-9677-ff12156732c4 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] HTTP exception thrown: Snapshot a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 could not be found. Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a1b5cff-8ce4-42e1-9677-ff12156732c4 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Request method failure captured: Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 HTTP/1.1 Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7Mjm8tSGQCFBzORIgdfXCuLyx_zdnoqxpS8LSxYoYvM-mI-26dak0fAm-w3JVFVs2uO1YN36-UD1GJs64HVaqFsLOAwAvCfQDZY86v2uiZNu1Z2a7pJlSWgBk6DBQ4ggWVvmaXWYib9WKFXhuVsO-0VHP_1KPGxbh_5w9fkltKmbc Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 923d72d5b3294f65aa6fdb0203731a27 Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:30:22.755781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 923d72d5b3294f65aa6fdb0203731a27 Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesSnapshotsTestJSON-1962238940-project Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: b3c55244b9ed490eb71af80a976cd416 Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1962238940-project Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Snapshot a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 could not be found. Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'a9c9e2a5-00a0-4a5e-9731-6ca1119b1117'} Aug 06 12:30:22.756892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 could not be found. (HTTP 404) (Request-ID: req-0db2b6b9-5ea4-40d1-81d0-f6bf750acd72) Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:22.757520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 12:30:22.758351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 could not be found. Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 06 12:30:22.759200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 could not be found. Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 could not be found. Aug 06 12:30:22.760116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:22.762563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a1b5cff-8ce4-42e1-9677-ff12156732c4 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Returning 404 to user: Snapshot a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:22.763629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0a1b5cff-8ce4-42e1-9677-ff12156732c4 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117" status: 404 len: 111 microversion: 2.1 time: 0.064361 Aug 06 12:30:22.767778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 21/40] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Aug 6 12:30:22 2022] GET /compute/v2.1/os-snapshots/a9c9e2a5-00a0-4a5e-9731-6ca1119b1117 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 12:30:22.773978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3d171656-6a77-48c2-b409-9f18fbd0a503 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:22.775619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3d171656-6a77-48c2-b409-9f18fbd0a503 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:22.933861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3d171656-6a77-48c2-b409-9f18fbd0a503 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:22.980074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3d171656-6a77-48c2-b409-9f18fbd0a503 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1214 microversion: 2.1 time: 0.207074 Aug 06 12:30:22.994740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:22 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:23.000662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:30:23.001774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:30:23.003118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:30:23.003738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:30:23.004507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:30:23.011316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-030558bb-9d19-4fd1-8cb5-9ccfe639db5e tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541ade2040>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:23.024265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:23.025451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:23.026928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:23.042501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:23.043215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:23.043820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:23.130864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Getting quotas for project 6dea90217d154c2ab843c86c2a5ebb49. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:30:23.147071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-030558bb-9d19-4fd1-8cb5-9ccfe639db5e tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6d9bd81f-2888-42c5-8025-9d5c27cc92da" status: 200 len: 351 microversion: 2.1 time: 0.147817 Aug 06 12:30:23.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Getting quotas for user 7c520a94e20245ca9cc898dee3ab89bc and project 6dea90217d154c2ab843c86c2a5ebb49. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:30:23.147945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 23/42] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:22 2022] GET /compute/v2.1/os-volumes/6d9bd81f-2888-42c5-8025-9d5c27cc92da => generated 351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:23.163584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bf23ca60-d169-4c24-9dcc-76d9be69fb8d tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Calling method '.version_select at 0x7f541ade2f70>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:23.211185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:30:23.214359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:30:23.245583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-bf23ca60-d169-4c24-9dcc-76d9be69fb8d tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] HTTP exception thrown: Volume 553f2a1d-338b-45fc-8583-9b999414bf38 could not be found. Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bf23ca60-d169-4c24-9dcc-76d9be69fb8d tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Request method failure captured: Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 HTTP/1.1 Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7M6r5o8PHPCUpbx7SmVKmU6sMeiZX3zVIGLPXclaCjz_WkdoiGiPHvH6VJSYnMFPiwpkpUzkPSZleBVZD-sheo9_PhGUD0HNy31cnT3eD-gnRh1-Zv2ZX_SAkUeZZGPx7lXtm0RBc6cYXqGmsFW2uoIWYeApgFSbNmtYCt3215dlY Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 321f21add6a240a09f41cd78713a15be Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesGetTestJSON-1443701530 Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:30:23.248712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/321f21add6a240a09f41cd78713a15be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_321f21add6a240a09f41cd78713a15be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/321f21add6a240a09f41cd78713a15be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/321f21add6a240a09f41cd78713a15be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesGetTestJSON-1443701530 Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 321f21add6a240a09f41cd78713a15be Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesGetTestJSON-1443701530 Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesGetTestJSON-1443701530-project Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 8cbc932c57cc4dfd8abed78be68ff1c8 Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesGetTestJSON-1443701530-project Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Volume 553f2a1d-338b-45fc-8583-9b999414bf38 could not be found. Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '553f2a1d-338b-45fc-8583-9b999414bf38'} Aug 06 12:30:23.249992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 553f2a1d-338b-45fc-8583-9b999414bf38 could not be found. (HTTP 404) (Request-ID: req-5956fbb4-df0f-413b-91be-d32f7d398778) Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:23.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 12:30:23.251955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 553f2a1d-338b-45fc-8583-9b999414bf38 could not be found. Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 12:30:23.253231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 553f2a1d-338b-45fc-8583-9b999414bf38 could not be found. Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 553f2a1d-338b-45fc-8583-9b999414bf38 could not be found. Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bf23ca60-d169-4c24-9dcc-76d9be69fb8d tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] Returning 404 to user: Volume 553f2a1d-338b-45fc-8583-9b999414bf38 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bf23ca60-d169-4c24-9dcc-76d9be69fb8d tempest-VolumesGetTestJSON-1443701530 tempest-VolumesGetTestJSON-1443701530-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38" status: 404 len: 109 microversion: 2.1 time: 0.095885 Aug 06 12:30:23.254375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 24/43] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:23 2022] GET /compute/v2.1/os-volumes/553f2a1d-338b-45fc-8583-9b999414bf38 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 12:30:23.279387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4aad1bae-f835-4060-a670-9571d7993a2a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:23.280105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4aad1bae-f835-4060-a670-9571d7993a2a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:23.407707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4aad1bae-f835-4060-a670-9571d7993a2a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:23.420725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4aad1bae-f835-4060-a670-9571d7993a2a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:23.427922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4aad1bae-f835-4060-a670-9571d7993a2a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:23.432714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4aad1bae-f835-4060-a670-9571d7993a2a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1281 microversion: 2.20 time: 0.175284 Aug 06 12:30:23.435773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 25/44] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:23.465362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-351f6b8b-4242-414a-8cda-d1d272f1fafc tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541adf6940>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:23.497246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-215742ab-e4e5-415b-927e-6034e1ce0471 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.382341 Aug 06 12:30:23.500440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 20/45] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:30:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 12:30:23.513605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-841832399", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eedc16df-3c43-4b30-b37e-93e76fe94c3d"}], "security_groups": [{"name": "tempest-securitygroup--987363440"}], "key_name": "tempest-keypair-410279104", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:23.679426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-351f6b8b-4242-414a-8cda-d1d272f1fafc tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b" status: 202 len: 0 microversion: 2.1 time: 0.239541 Aug 06 12:30:23.679992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 26/46] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Aug 6 12:30:23 2022] DELETE /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:30:23.689553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3770e1b4-c4b1-4c73-af12-d45d24b580fb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:23.690169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3770e1b4-c4b1-4c73-af12-d45d24b580fb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:23.860662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] validate_networks() for [('eedc16df-3c43-4b30-b37e-93e76fe94c3d', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:30:23.949821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3770e1b4-c4b1-4c73-af12-d45d24b580fb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:23.970670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3770e1b4-c4b1-4c73-af12-d45d24b580fb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1221 microversion: 2.1 time: 0.283706 Aug 06 12:30:23.973180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 27/47] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:23 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1221 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:24.004599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e282a3bd-e82a-4c81-907e-d251cf113c3d tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541ada6ca0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:24.060134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-e282a3bd-e82a-4c81-907e-d251cf113c3d tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] HTTP exception thrown: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e282a3bd-e82a-4c81-907e-d251cf113c3d tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Request method failure captured: Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b HTTP/1.1 Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7Mjm8tSGQCFBzORIgdfXCuLyx_zdnoqxpS8LSxYoYvM-mI-26dak0fAm-w3JVFVs2uO1YN36-UD1GJs64HVaqFsLOAwAvCfQDZY86v2uiZNu1Z2a7pJlSWgBk6DBQ4ggWVvmaXWYib9WKFXhuVsO-0VHP_1KPGxbh_5w9fkltKmbc Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 923d72d5b3294f65aa6fdb0203731a27 Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:30:24.062305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 923d72d5b3294f65aa6fdb0203731a27 Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesSnapshotsTestJSON-1962238940-project Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: b3c55244b9ed490eb71af80a976cd416 Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1962238940-project Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '066a3ba7-ee5e-4333-aa81-76b8a780ed4b'} Aug 06 12:30:24.063380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. (HTTP 404) (Request-ID: req-013fc259-790d-4c84-a4a7-5c77268d13fb) Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:24.063995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 12:30:24.065155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 12:30:24.066148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e282a3bd-e82a-4c81-907e-d251cf113c3d tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Returning 404 to user: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e282a3bd-e82a-4c81-907e-d251cf113c3d tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b" status: 404 len: 109 microversion: 2.1 time: 0.086166 Aug 06 12:30:24.069060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 28/48] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:23 2022] GET /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 12:30:24.074591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5927a35e-f320-4ef4-86f8-9ab5ec35bb08 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:24.082182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5927a35e-f320-4ef4-86f8-9ab5ec35bb08 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:24.112681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5927a35e-f320-4ef4-86f8-9ab5ec35bb08 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:24.113456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5927a35e-f320-4ef4-86f8-9ab5ec35bb08 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:24.116052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5927a35e-f320-4ef4-86f8-9ab5ec35bb08 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:24.118684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5927a35e-f320-4ef4-86f8-9ab5ec35bb08 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:24.121271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5927a35e-f320-4ef4-86f8-9ab5ec35bb08 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:24.121719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5927a35e-f320-4ef4-86f8-9ab5ec35bb08 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:24.464421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5927a35e-f320-4ef4-86f8-9ab5ec35bb08 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:24.484922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5927a35e-f320-4ef4-86f8-9ab5ec35bb08 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1266 microversion: 2.1 time: 0.419565 Aug 06 12:30:24.485564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 29/49] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:24 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1266 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:24.508276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b5f0ffc0-2e3b-472e-9726-b3e23d04b4c9 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541ad32040>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:24.595148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-b5f0ffc0-2e3b-472e-9726-b3e23d04b4c9 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] HTTP exception thrown: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b5f0ffc0-2e3b-472e-9726-b3e23d04b4c9 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Request method failure captured: Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b HTTP/1.1 Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7Mjm8tSGQCFBzORIgdfXCuLyx_zdnoqxpS8LSxYoYvM-mI-26dak0fAm-w3JVFVs2uO1YN36-UD1GJs64HVaqFsLOAwAvCfQDZY86v2uiZNu1Z2a7pJlSWgBk6DBQ4ggWVvmaXWYib9WKFXhuVsO-0VHP_1KPGxbh_5w9fkltKmbc Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 923d72d5b3294f65aa6fdb0203731a27 Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:30:24.597756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 923d72d5b3294f65aa6fdb0203731a27 Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesSnapshotsTestJSON-1962238940-project Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: b3c55244b9ed490eb71af80a976cd416 Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1962238940-project Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '066a3ba7-ee5e-4333-aa81-76b8a780ed4b'} Aug 06 12:30:24.599152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. (HTTP 404) (Request-ID: req-d51274bf-3b36-4d86-9837-c81ffc698680) Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:24.599871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 12:30:24.604320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 12:30:24.605450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b5f0ffc0-2e3b-472e-9726-b3e23d04b4c9 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Returning 404 to user: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b5f0ffc0-2e3b-472e-9726-b3e23d04b4c9 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b" status: 404 len: 109 microversion: 2.1 time: 0.110596 Aug 06 12:30:24.606567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 30/50] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Aug 6 12:30:24 2022] DELETE /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 12:30:24.614039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-274987253", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:24.789425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] validate_networks() for [('f9772107-4faf-4fb2-a5c9-81f3bb613c65', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:30:25.417380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:30:25.418442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:30:25.419165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:30:25.419722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:30:25.420348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:30:25.437443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:25.437944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:25.438421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:25.439128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:25.439607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:25.440025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:25.483630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:30:25.488774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for user 1125a0b93c9d45ccb2d3f28f188dfd04 and project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:30:25.565348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:30:25.570719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:30:25.738528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f3f402e2-7158-4c06-a446-4578f707ecb2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.236607 Aug 06 12:30:25.747992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 21/51] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:30:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 12:30:25.769122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:25.773017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:25.800353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:25.801375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:25.802052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:25.803155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:25.803975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:25.804649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:26.183050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:26.212025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:26.221192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:26.232389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e6d2c383-1019-4495-98bc-79b3ca395a09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1333 microversion: 2.20 time: 0.482941 Aug 06 12:30:26.248197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 22/52] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1333 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:26.258852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-799c950b-e39c-4958-9b40-a08a8738c8d8 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Calling method '.version_select at 0x7f541adc9280>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:26.321859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-799c950b-e39c-4958-9b40-a08a8738c8d8 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] HTTP exception thrown: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-799c950b-e39c-4958-9b40-a08a8738c8d8 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Request method failure captured: Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b HTTP/1.1 Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7Mjm8tSGQCFBzORIgdfXCuLyx_zdnoqxpS8LSxYoYvM-mI-26dak0fAm-w3JVFVs2uO1YN36-UD1GJs64HVaqFsLOAwAvCfQDZY86v2uiZNu1Z2a7pJlSWgBk6DBQ4ggWVvmaXWYib9WKFXhuVsO-0VHP_1KPGxbh_5w9fkltKmbc Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 923d72d5b3294f65aa6fdb0203731a27 Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:30:26.326144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/923d72d5b3294f65aa6fdb0203731a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 923d72d5b3294f65aa6fdb0203731a27 Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1962238940 Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotsTestJSON-1962238940-project Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: b3c55244b9ed490eb71af80a976cd416 Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1962238940-project Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '066a3ba7-ee5e-4333-aa81-76b8a780ed4b'} Aug 06 12:30:26.327223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. (HTTP 404) (Request-ID: req-ed9ce626-ce37-4831-81cf-0e92a017400b) Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:26.327899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 12:30:26.328873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 12:30:26.329754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. Aug 06 12:30:26.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:26.333115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-799c950b-e39c-4958-9b40-a08a8738c8d8 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] Returning 404 to user: Volume 066a3ba7-ee5e-4333-aa81-76b8a780ed4b could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:26.334184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-799c950b-e39c-4958-9b40-a08a8738c8d8 tempest-VolumesSnapshotsTestJSON-1962238940 tempest-VolumesSnapshotsTestJSON-1962238940-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b" status: 404 len: 109 microversion: 2.1 time: 0.084671 Aug 06 12:30:26.334921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 23/53] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:26 2022] GET /compute/v2.1/os-volumes/066a3ba7-ee5e-4333-aa81-76b8a780ed4b => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 12:30:26.361052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0209c3ca-717e-4fbf-86c2-67becb5fb2d5 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541ad31550>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:26.456643 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0209c3ca-717e-4fbf-86c2-67becb5fb2d5 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/46a85fcd-b761-4090-99dc-2155c0d23c63" status: 200 len: 351 microversion: 2.1 time: 0.120373 Aug 06 12:30:26.458242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 24/54] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:26 2022] GET /compute/v2.1/os-volumes/46a85fcd-b761-4090-99dc-2155c0d23c63 => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:26.469264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3198fb9e-8b3c-4c55-944a-2a8d161bea27 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:26.469951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3198fb9e-8b3c-4c55-944a-2a8d161bea27 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:26.488531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3198fb9e-8b3c-4c55-944a-2a8d161bea27 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:26.489196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3198fb9e-8b3c-4c55-944a-2a8d161bea27 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:26.489815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3198fb9e-8b3c-4c55-944a-2a8d161bea27 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:26.491371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3198fb9e-8b3c-4c55-944a-2a8d161bea27 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:26.491522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3198fb9e-8b3c-4c55-944a-2a8d161bea27 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:26.492194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3198fb9e-8b3c-4c55-944a-2a8d161bea27 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:26.744749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3198fb9e-8b3c-4c55-944a-2a8d161bea27 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:26.763019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3198fb9e-8b3c-4c55-944a-2a8d161bea27 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1272 microversion: 2.1 time: 0.301950 Aug 06 12:30:26.765349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 25/55] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:26 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1272 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:26.771144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-afb8d579-73dd-43fe-8780-e219f8effbae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:26.785148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-afb8d579-73dd-43fe-8780-e219f8effbae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:27.086318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-afb8d579-73dd-43fe-8780-e219f8effbae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:27.134593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-afb8d579-73dd-43fe-8780-e219f8effbae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1240 microversion: 2.1 time: 0.367869 Aug 06 12:30:27.140487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 26/56] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1240 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:27.153419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9ea9c42f-b9be-47a7-9e0f-f2ed28c6c81c tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541ae0daf0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:27.512739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9ea9c42f-b9be-47a7-9e0f-f2ed28c6c81c tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.370908 Aug 06 12:30:27.524117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 27/57] 10.222.0.20 () {58 vars in 1134 bytes} [Sat Aug 6 12:30:27 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:27.527247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:27.527951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:27.553573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:27.554079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:27.559132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:27.566197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:27.568490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:27.574868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:27.742898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:30:27.743377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:30:27.744892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:30:27.745539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:30:27.746168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:30:27.770018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:27.779461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:27.781502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:27.782840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:27.785809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:27.787531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:27.878456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Getting quotas for project 6dea90217d154c2ab843c86c2a5ebb49. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:30:27.899873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Getting quotas for user 7c520a94e20245ca9cc898dee3ab89bc and project 6dea90217d154c2ab843c86c2a5ebb49. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:30:27.949671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:30:27.962542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:30:28.105488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:28.114503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f6e0fa93-5d7f-4d2a-a9f8-468569007b33 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.513600 Aug 06 12:30:28.119913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 31/58] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:30:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 3519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 12:30:28.129009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac48789f-cb29-454a-806c-555c72e70743 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541ad32790>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:28.146497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:28.148179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:28.163927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ddac78da-4ca0-48b9-a69d-fbdf324cdf6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1339 microversion: 2.20 time: 0.648957 Aug 06 12:30:28.164551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 28/59] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1339 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:28.200487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-660d157c-3040-438d-99d6-8ab0d2c4b1a7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:28.208504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-660d157c-3040-438d-99d6-8ab0d2c4b1a7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:28.248865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-660d157c-3040-438d-99d6-8ab0d2c4b1a7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:28.249592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-660d157c-3040-438d-99d6-8ab0d2c4b1a7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:28.251146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-660d157c-3040-438d-99d6-8ab0d2c4b1a7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:28.267989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-660d157c-3040-438d-99d6-8ab0d2c4b1a7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:28.269451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-660d157c-3040-438d-99d6-8ab0d2c4b1a7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:28.286875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-660d157c-3040-438d-99d6-8ab0d2c4b1a7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:28.403267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac48789f-cb29-454a-806c-555c72e70743 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.281954 Aug 06 12:30:28.416139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 32/60] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Aug 6 12:30:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:28.434660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a345fdc6-998d-497b-8411-000c459e8874 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:28.435796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a345fdc6-998d-497b-8411-000c459e8874 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:28.708182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-660d157c-3040-438d-99d6-8ab0d2c4b1a7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:28.724563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-660d157c-3040-438d-99d6-8ab0d2c4b1a7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1272 microversion: 2.1 time: 0.535216 Aug 06 12:30:28.726112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 29/61] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:28 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1272 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:28.749574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e6f181e2-e67c-4bf3-a7f6-2d39d504df1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:28.750505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e6f181e2-e67c-4bf3-a7f6-2d39d504df1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:28.808468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6f181e2-e67c-4bf3-a7f6-2d39d504df1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:28.813899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6f181e2-e67c-4bf3-a7f6-2d39d504df1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:28.815597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6f181e2-e67c-4bf3-a7f6-2d39d504df1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:28.823489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6f181e2-e67c-4bf3-a7f6-2d39d504df1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:28.828786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6f181e2-e67c-4bf3-a7f6-2d39d504df1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:28.829621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6f181e2-e67c-4bf3-a7f6-2d39d504df1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:29.118009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a345fdc6-998d-497b-8411-000c459e8874 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:29.142687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a345fdc6-998d-497b-8411-000c459e8874 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1221 microversion: 2.1 time: 0.721106 Aug 06 12:30:29.159928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 33/62] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:28 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1221 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:29.167577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ecfaeeac-f4bb-4dd5-8230-296db912ac05 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541acdd430>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:29.678268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ecfaeeac-f4bb-4dd5-8230-296db912ac05 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.514285 Aug 06 12:30:29.679098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 34/63] 10.222.0.20 () {58 vars in 1134 bytes} [Sat Aug 6 12:30:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:29.685510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:29.686322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:29.699684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:29.713500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:29.716661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:29.721082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:29.721825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:29.722742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:30.142742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6f181e2-e67c-4bf3-a7f6-2d39d504df1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:30.153289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e6f181e2-e67c-4bf3-a7f6-2d39d504df1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1300 microversion: 2.1 time: 1.424744 Aug 06 12:30:30.164272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 30/64] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:28 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1300 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:30.188332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b29ff8d8-0fd7-40e7-84a4-e88c0ed9d598 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541d16cc10>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:30.583279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b29ff8d8-0fd7-40e7-84a4-e88c0ed9d598 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.417122 Aug 06 12:30:30.591763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 31/65] 10.222.0.20 () {58 vars in 1167 bytes} [Sat Aug 6 12:30:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:30.593274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a2b31dfb-3306-4352-b61b-d4ca4be842dc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:30.595939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a2b31dfb-3306-4352-b61b-d4ca4be842dc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:30.616869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2b31dfb-3306-4352-b61b-d4ca4be842dc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:30.622766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2b31dfb-3306-4352-b61b-d4ca4be842dc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:30.623229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2b31dfb-3306-4352-b61b-d4ca4be842dc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:30.624958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2b31dfb-3306-4352-b61b-d4ca4be842dc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:30.627606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2b31dfb-3306-4352-b61b-d4ca4be842dc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:30.628486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2b31dfb-3306-4352-b61b-d4ca4be842dc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:30.820251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a2b31dfb-3306-4352-b61b-d4ca4be842dc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:30.838747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a2b31dfb-3306-4352-b61b-d4ca4be842dc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1272 microversion: 2.1 time: 0.249992 Aug 06 12:30:30.856024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 32/66] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:30 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:30.869549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b6d1b414-7b15-4111-a177-dd7460afc88f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:30.870737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b6d1b414-7b15-4111-a177-dd7460afc88f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:30.885079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6d1b414-7b15-4111-a177-dd7460afc88f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:30.885941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6d1b414-7b15-4111-a177-dd7460afc88f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:30.886592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6d1b414-7b15-4111-a177-dd7460afc88f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:30.887571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6d1b414-7b15-4111-a177-dd7460afc88f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:30.888225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6d1b414-7b15-4111-a177-dd7460afc88f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:30.888905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6d1b414-7b15-4111-a177-dd7460afc88f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:30.957831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:30.974127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:30.984977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:30.994990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-23ceefb7-5f12-4bfa-8b47-0bfc3f62ac43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1339 microversion: 2.20 time: 1.308146 Aug 06 12:30:31.011475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 35/67] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1339 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:31.031421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9c2a517d-a06a-45f8-972b-19b1a7415327 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541acddb80>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:31.113496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b6d1b414-7b15-4111-a177-dd7460afc88f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:31.128278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b6d1b414-7b15-4111-a177-dd7460afc88f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1273 microversion: 2.1 time: 0.269052 Aug 06 12:30:31.145939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 33/68] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:30 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:31.188141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bc19f9be-6211-432e-b308-036520a9037c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:31.189960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bc19f9be-6211-432e-b308-036520a9037c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:31.206391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc19f9be-6211-432e-b308-036520a9037c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:31.208976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc19f9be-6211-432e-b308-036520a9037c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:31.210399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc19f9be-6211-432e-b308-036520a9037c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:31.213289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc19f9be-6211-432e-b308-036520a9037c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:31.215698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc19f9be-6211-432e-b308-036520a9037c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:31.216961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc19f9be-6211-432e-b308-036520a9037c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:31.311350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9c2a517d-a06a-45f8-972b-19b1a7415327 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.298292 Aug 06 12:30:31.312090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 36/69] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Aug 6 12:30:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:31.326231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8b34cb46-d311-49b6-9d0d-87cec35256be tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541ad8daf0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:31.435165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bc19f9be-6211-432e-b308-036520a9037c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:31.472338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bc19f9be-6211-432e-b308-036520a9037c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1298 microversion: 2.1 time: 0.287302 Aug 06 12:30:31.522824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 34/70] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:31 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1298 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:31.622153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8b34cb46-d311-49b6-9d0d-87cec35256be tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.299583 Aug 06 12:30:31.628236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 37/71] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Aug 6 12:30:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:31.643569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27a6a72c-406e-4b80-ba1f-d6de45e01a0a tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541ad41ee0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:31.878732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4e2ddf0e-cb95-4771-9756-5593103508bf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:31.879952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4e2ddf0e-cb95-4771-9756-5593103508bf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:31.904407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e2ddf0e-cb95-4771-9756-5593103508bf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:31.911759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e2ddf0e-cb95-4771-9756-5593103508bf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:31.913783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e2ddf0e-cb95-4771-9756-5593103508bf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:31.915412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e2ddf0e-cb95-4771-9756-5593103508bf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:31.920464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e2ddf0e-cb95-4771-9756-5593103508bf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:31.924078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e2ddf0e-cb95-4771-9756-5593103508bf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:32.136695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27a6a72c-406e-4b80-ba1f-d6de45e01a0a tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.498648 Aug 06 12:30:32.151110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 35/72] 10.222.0.20 () {58 vars in 1188 bytes} [Sat Aug 6 12:30:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:32.161657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:32.164543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:32.190469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:32.191010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:32.191496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:32.192287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:32.194201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:32.194631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:32.824282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:32.849699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:32.855234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:32.861987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-14e3ae99-a7f0-444e-b7f4-6ed27cbef721 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1339 microversion: 2.20 time: 0.708674 Aug 06 12:30:32.864483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 36/73] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1339 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:32.886077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-01ac4b0f-bc06-44cf-b2e1-d6460efa1ac7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:32.886924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-01ac4b0f-bc06-44cf-b2e1-d6460efa1ac7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:32.912580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01ac4b0f-bc06-44cf-b2e1-d6460efa1ac7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:32.913757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01ac4b0f-bc06-44cf-b2e1-d6460efa1ac7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:32.915670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01ac4b0f-bc06-44cf-b2e1-d6460efa1ac7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:32.916690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01ac4b0f-bc06-44cf-b2e1-d6460efa1ac7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:32.919391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01ac4b0f-bc06-44cf-b2e1-d6460efa1ac7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:32.920117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01ac4b0f-bc06-44cf-b2e1-d6460efa1ac7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:33.052696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4e2ddf0e-cb95-4771-9756-5593103508bf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:33.062049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4e2ddf0e-cb95-4771-9756-5593103508bf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 1.198833 Aug 06 12:30:33.066776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 38/74] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:31 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:33.075003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9c0b9d9d-f7ad-46c3-9933-7e33c04ac5a5 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] Calling method '.version_select at 0x7f541ace8790>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:33.394326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9c0b9d9d-f7ad-46c3-9933-7e33c04ac5a5 tempest-VolumesTestJSON-784787686 tempest-VolumesTestJSON-784787686-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.325290 Aug 06 12:30:33.395475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 39/75] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Aug 6 12:30:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:33.401595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dd75f165-2cfd-480e-ada3-8fa31d7ff754 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:33.405298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dd75f165-2cfd-480e-ada3-8fa31d7ff754 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:33.438241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd75f165-2cfd-480e-ada3-8fa31d7ff754 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:33.439828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd75f165-2cfd-480e-ada3-8fa31d7ff754 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:33.440289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd75f165-2cfd-480e-ada3-8fa31d7ff754 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:33.441115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd75f165-2cfd-480e-ada3-8fa31d7ff754 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:33.442009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd75f165-2cfd-480e-ada3-8fa31d7ff754 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:33.442507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd75f165-2cfd-480e-ada3-8fa31d7ff754 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:33.563650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-01ac4b0f-bc06-44cf-b2e1-d6460efa1ac7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:33.604591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-01ac4b0f-bc06-44cf-b2e1-d6460efa1ac7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1279 microversion: 2.1 time: 0.738762 Aug 06 12:30:33.624230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 37/76] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:32 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1279 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:33.889187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:33.889894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:33.903266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:33.905000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:33.907085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:33.909204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:33.914688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:33.915623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:34.198557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:34.220331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:34.226015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:34.239309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-254f9114-07ac-4f78-9328-da2cc1d101df tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1339 microversion: 2.20 time: 0.355123 Aug 06 12:30:34.259491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 38/77] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1339 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:34.264958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-78268d77-b514-4610-80eb-f196abec02e2 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:34.265828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-78268d77-b514-4610-80eb-f196abec02e2 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:34.285897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78268d77-b514-4610-80eb-f196abec02e2 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:34.286829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78268d77-b514-4610-80eb-f196abec02e2 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:34.288177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78268d77-b514-4610-80eb-f196abec02e2 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:34.291464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78268d77-b514-4610-80eb-f196abec02e2 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:34.292379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78268d77-b514-4610-80eb-f196abec02e2 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:34.296529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78268d77-b514-4610-80eb-f196abec02e2 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:35.463424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:35.491144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-78268d77-b514-4610-80eb-f196abec02e2 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:35.506524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-78268d77-b514-4610-80eb-f196abec02e2 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 1.245526 Aug 06 12:30:35.508775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 39/78] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:34 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:35.517265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-384dd20b-528d-4092-9d36-87f8e2550bbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:35.518551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-384dd20b-528d-4092-9d36-87f8e2550bbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:35.545851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-384dd20b-528d-4092-9d36-87f8e2550bbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:35.548049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-384dd20b-528d-4092-9d36-87f8e2550bbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:35.550830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-384dd20b-528d-4092-9d36-87f8e2550bbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:35.554181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-384dd20b-528d-4092-9d36-87f8e2550bbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:35.557005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-384dd20b-528d-4092-9d36-87f8e2550bbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:35.557723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-384dd20b-528d-4092-9d36-87f8e2550bbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:35.800006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-384dd20b-528d-4092-9d36-87f8e2550bbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:35.818697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-384dd20b-528d-4092-9d36-87f8e2550bbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1279 microversion: 2.1 time: 0.305002 Aug 06 12:30:35.821464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 40/79] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:35 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1279 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:36.775678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ebda599b-c4b6-4a5d-b9db-66804328957f tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Action: 'create', calling method: .version_select at 0x7f541ad41040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-298496439", "metadata": {"Type": "work"}}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ebda599b-c4b6-4a5d-b9db-66804328957f tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Request method failure captured: Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 121 Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7q1oqpWUMcgjHvWGNHJVImO_VIVS7JrVi8ahl6R477Sv8hP8lqSomqTJLGYjKcdbNjTlVy0kGIY8a9PjvCPGUzPOqEfB0svF-E_9S-ncC3PvoEEo_1EVWGcRox2iwU85A4qiAd8H_nxjEprEKIYeIEJ2qZLx2cXGOCE8cNDg7NXwY Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:30:36.785564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 1a19e414e5ab48fb8fd2615e694dec41 Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-298496439", "metadata": {"Type": "work"}}} Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: Aug 06 12:30:36.786919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-298496439', 'metadata': {'Type': 'work'}}}} Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise error Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi '#$%' Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:36.787722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 12:30:36.788903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 12:30:36.789916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 12:30:36.789916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:36.793148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ebda599b-c4b6-4a5d-b9db-66804328957f tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:36.795738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ebda599b-c4b6-4a5d-b9db-66804328957f tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.973022 Aug 06 12:30:36.804070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 41/80] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Aug 6 12:30:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 982 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:30:36.816680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:36.838120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:36.856544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dd75f165-2cfd-480e-ada3-8fa31d7ff754 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:36.863357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:36.866556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dd75f165-2cfd-480e-ada3-8fa31d7ff754 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 3.469500 Aug 06 12:30:36.869617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:36.870594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:36.871822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:36.873187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:36.876476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:36.882037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 40/81] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 3486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:36.893613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb4c7ddc-6989-4c0f-878d-e79509c2f397 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:36.894482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb4c7ddc-6989-4c0f-878d-e79509c2f397 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:36.906558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb4c7ddc-6989-4c0f-878d-e79509c2f397 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:36.907418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb4c7ddc-6989-4c0f-878d-e79509c2f397 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:36.908040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb4c7ddc-6989-4c0f-878d-e79509c2f397 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:36.912725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb4c7ddc-6989-4c0f-878d-e79509c2f397 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:36.913495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb4c7ddc-6989-4c0f-878d-e79509c2f397 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:36.914223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb4c7ddc-6989-4c0f-878d-e79509c2f397 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:37.101181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=18 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:37.812271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:38.095292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bb4c7ddc-6989-4c0f-878d-e79509c2f397 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:38.116131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb4c7ddc-6989-4c0f-878d-e79509c2f397 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 1.230409 Aug 06 12:30:38.118949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 41/82] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:36 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:38.142310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27c8316a-01cf-49a1-8282-52e8b78ea737 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Action: 'create', calling method: .version_select at 0x7f541ace8790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1720443926", "metadata": {"Type": "work"}}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27c8316a-01cf-49a1-8282-52e8b78ea737 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Request method failure captured: Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 120 Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7q1oqpWUMcgjHvWGNHJVImO_VIVS7JrVi8ahl6R477Sv8hP8lqSomqTJLGYjKcdbNjTlVy0kGIY8a9PjvCPGUzPOqEfB0svF-E_9S-ncC3PvoEEo_1EVWGcRox2iwU85A4qiAd8H_nxjEprEKIYeIEJ2qZLx2cXGOCE8cNDg7NXwY Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:30:38.159204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1a19e414e5ab48fb8fd2615e694dec41 Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1720443926", "metadata": {"Type": "work"}}} Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: Aug 06 12:30:38.160651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1720443926', 'metadata': {'Type': 'work'}}}} Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise error Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi '0' Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:38.161389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 12:30:38.162630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 12:30:38.164112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 12:30:38.164112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:38.168158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27c8316a-01cf-49a1-8282-52e8b78ea737 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:38.171074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-27c8316a-01cf-49a1-8282-52e8b78ea737 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.038887 Aug 06 12:30:38.174326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 42/83] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Aug 6 12:30:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:30:38.186672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6c844da-9d3d-4826-aa7d-082ff01174bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:38.187820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c6c844da-9d3d-4826-aa7d-082ff01174bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:38.208266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c844da-9d3d-4826-aa7d-082ff01174bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:38.209186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c844da-9d3d-4826-aa7d-082ff01174bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:38.214374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c844da-9d3d-4826-aa7d-082ff01174bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:38.217475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c844da-9d3d-4826-aa7d-082ff01174bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:38.218216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c844da-9d3d-4826-aa7d-082ff01174bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:38.218938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c844da-9d3d-4826-aa7d-082ff01174bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:38.857571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:38.885341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:38.889959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:38.909361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8bf1f2d0-92d5-4086-a814-0ae5f6ee91b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 2.086177 Aug 06 12:30:38.912034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 42/84] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:38.920076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d93b39a-0487-4428-b381-63b261c43f46 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:38.921934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1d93b39a-0487-4428-b381-63b261c43f46 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:38.933088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d93b39a-0487-4428-b381-63b261c43f46 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:38.934421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d93b39a-0487-4428-b381-63b261c43f46 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:38.935667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d93b39a-0487-4428-b381-63b261c43f46 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:38.939385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d93b39a-0487-4428-b381-63b261c43f46 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:38.942930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d93b39a-0487-4428-b381-63b261c43f46 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:38.945149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d93b39a-0487-4428-b381-63b261c43f46 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:39.124413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=30 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:40.661314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c6c844da-9d3d-4826-aa7d-082ff01174bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:40.706512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c6c844da-9d3d-4826-aa7d-082ff01174bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 2.525331 Aug 06 12:30:40.710758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 43/85] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:38 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 2535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:40.730727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-94254743-8f24-4fd6-a889-9ae0a4b5bc2e tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Action: 'create', calling method: .version_select at 0x7f541acddd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-291652708", "metadata": {"Type": "work"}}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-94254743-8f24-4fd6-a889-9ae0a4b5bc2e tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Request method failure captured: Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 118 Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7q1oqpWUMcgjHvWGNHJVImO_VIVS7JrVi8ahl6R477Sv8hP8lqSomqTJLGYjKcdbNjTlVy0kGIY8a9PjvCPGUzPOqEfB0svF-E_9S-ncC3PvoEEo_1EVWGcRox2iwU85A4qiAd8H_nxjEprEKIYeIEJ2qZLx2cXGOCE8cNDg7NXwY Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:30:40.830403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1a19e414e5ab48fb8fd2615e694dec41 Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-291652708", "metadata": {"Type": "work"}}} Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: Aug 06 12:30:40.831621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-291652708', 'metadata': {'Type': 'work'}}}} Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise error Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi '' Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:40.832390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 12:30:40.833427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 12:30:40.834310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 12:30:40.834310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:40.854636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1d93b39a-0487-4428-b381-63b261c43f46 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:40.855076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-94254743-8f24-4fd6-a889-9ae0a4b5bc2e tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:40.867610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1d93b39a-0487-4428-b381-63b261c43f46 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 1.953338 Aug 06 12:30:40.872239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 43/86] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:40.877098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7a7d5c13-f5eb-4c45-a4a4-73267d32c44c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:40.879229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-94254743-8f24-4fd6-a889-9ae0a4b5bc2e tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.162648 Aug 06 12:30:40.886608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7a7d5c13-f5eb-4c45-a4a4-73267d32c44c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:40.898696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 44/87] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Aug 6 12:30:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:30:40.904831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a7d5c13-f5eb-4c45-a4a4-73267d32c44c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:40.909024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a7d5c13-f5eb-4c45-a4a4-73267d32c44c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:40.914889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a7d5c13-f5eb-4c45-a4a4-73267d32c44c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:40.918163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a7d5c13-f5eb-4c45-a4a4-73267d32c44c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:40.918880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a7d5c13-f5eb-4c45-a4a4-73267d32c44c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:40.919458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a7d5c13-f5eb-4c45-a4a4-73267d32c44c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:41.010535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:41.011260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:41.041945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:41.052356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:41.055507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:41.057152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:41.059306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:41.061196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:41.673719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a7d5c13-f5eb-4c45-a4a4-73267d32c44c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:41.677454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:41.686513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7a7d5c13-f5eb-4c45-a4a4-73267d32c44c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.812945 Aug 06 12:30:41.687335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 44/88] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:40 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:41.697115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0f12a60f-7281-4c75-ba5e-d745513c2451 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Calling method '.version_select at 0x7f541acfa8b0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:41.783935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-0f12a60f-7281-4c75-ba5e-d745513c2451 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] HTTP exception thrown: Volume tempest-invalid-652360456 could not be found. Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0f12a60f-7281-4c75-ba5e-d745513c2451 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Request method failure captured: Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-652360456 HTTP/1.1 Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7q1oqpWUMcgjHvWGNHJVImO_VIVS7JrVi8ahl6R477Sv8hP8lqSomqTJLGYjKcdbNjTlVy0kGIY8a9PjvCPGUzPOqEfB0svF-E_9S-ncC3PvoEEo_1EVWGcRox2iwU85A4qiAd8H_nxjEprEKIYeIEJ2qZLx2cXGOCE8cNDg7NXwY Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:30:41.786489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 1a19e414e5ab48fb8fd2615e694dec41 Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Volume tempest-invalid-652360456 could not be found. Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'tempest-invalid-652360456'} Aug 06 12:30:41.787596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-652360456 could not be found. (HTTP 404) (Request-ID: req-286f7d48-a271-4923-9139-4a8b6b339d8f) Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:41.788242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 12:30:41.789211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-652360456 could not be found. Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:30:41.790257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-652360456 could not be found. Aug 06 12:30:41.791337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:41.791337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:41.791337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:41.791337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:41.791337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:41.791337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:41.791337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:30:41.791337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:30:41.791337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-652360456 could not be found. Aug 06 12:30:41.791337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:30:41.793794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0f12a60f-7281-4c75-ba5e-d745513c2451 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Returning 404 to user: Volume tempest-invalid-652360456 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:41.794894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0f12a60f-7281-4c75-ba5e-d745513c2451 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-652360456" status: 404 len: 98 microversion: 2.1 time: 0.103661 Aug 06 12:30:41.800792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 45/89] 10.222.0.20 () {58 vars in 1215 bytes} [Sat Aug 6 12:30:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-652360456 => generated 98 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 12:30:42.116723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-ea14b34c-c9fc-4899-9a71-90b452b11ef3 req-90ed001d-0b99-4daa-82a6-807c9cb734cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88", "tag": "6661d37d-f9d6-463e-aeaa-3bb99adff19b"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:42.153080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ea14b34c-c9fc-4899-9a71-90b452b11ef3 req-90ed001d-0b99-4daa-82a6-807c9cb734cc service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:42.156226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ea14b34c-c9fc-4899-9a71-90b452b11ef3 req-90ed001d-0b99-4daa-82a6-807c9cb734cc service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:42.157542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ea14b34c-c9fc-4899-9a71-90b452b11ef3 req-90ed001d-0b99-4daa-82a6-807c9cb734cc service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:42.212207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:42.216343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-ea14b34c-c9fc-4899-9a71-90b452b11ef3 req-90ed001d-0b99-4daa-82a6-807c9cb734cc service nova] Creating event network-changed:6661d37d-f9d6-463e-aeaa-3bb99adff19b for instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 on hv-cinder-85199 Aug 06 12:30:42.217092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ea14b34c-c9fc-4899-9a71-90b452b11ef3 req-90ed001d-0b99-4daa-82a6-807c9cb734cc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117825) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 12:30:42.218242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ea14b34c-c9fc-4899-9a71-90b452b11ef3 req-90ed001d-0b99-4daa-82a6-807c9cb734cc service nova] Acquired lock "compute-rpcapi-router" {{(pid=117825) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 12:30:42.219524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bf51cc9-d25a-468a-ba3a-626103eafd20 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:42.220857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bf51cc9-d25a-468a-ba3a-626103eafd20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:42.221515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bf51cc9-d25a-468a-ba3a-626103eafd20 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:42.222448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bf51cc9-d25a-468a-ba3a-626103eafd20 None None] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:42.223881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bf51cc9-d25a-468a-ba3a-626103eafd20 None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:42.224629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bf51cc9-d25a-468a-ba3a-626103eafd20 None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:42.240267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.compute.rpcapi [None req-9bf51cc9-d25a-468a-ba3a-626103eafd20 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 12:30:42.241791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bf51cc9-d25a-468a-ba3a-626103eafd20 None None] Releasing lock "compute-rpcapi-router" {{(pid=117825) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 12:30:42.247007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:42.256064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:42.261101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98b47083-604c-41a9-8e64-10e03baeeb31 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 1.351423 Aug 06 12:30:42.301825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 45/90] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:42.315404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9bf51cc9-d25a-468a-ba3a-626103eafd20 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.512349 Aug 06 12:30:42.321030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 46/91] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:42.359886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f725b15e-2720-435f-9335-3b6b3576cdc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:42.360670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f725b15e-2720-435f-9335-3b6b3576cdc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:42.414351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f725b15e-2720-435f-9335-3b6b3576cdc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:42.414870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f725b15e-2720-435f-9335-3b6b3576cdc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:42.416285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f725b15e-2720-435f-9335-3b6b3576cdc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:42.420115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f725b15e-2720-435f-9335-3b6b3576cdc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:42.420912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f725b15e-2720-435f-9335-3b6b3576cdc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:42.422560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f725b15e-2720-435f-9335-3b6b3576cdc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:42.542989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-ba1aefb3-f4e7-4cc5-b328-19784e626468 req-54002736-ec7a-4b91-9986-dd90f36a6cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f231479c-af6e-4233-8b90-27574ed9335f", "tag": "172336ef-ed14-4657-93d7-72c15445dce5"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:42.574625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ba1aefb3-f4e7-4cc5-b328-19784e626468 req-54002736-ec7a-4b91-9986-dd90f36a6cc8 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:42.585530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ba1aefb3-f4e7-4cc5-b328-19784e626468 req-54002736-ec7a-4b91-9986-dd90f36a6cc8 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:42.595234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ba1aefb3-f4e7-4cc5-b328-19784e626468 req-54002736-ec7a-4b91-9986-dd90f36a6cc8 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:42.714401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-ba1aefb3-f4e7-4cc5-b328-19784e626468 req-54002736-ec7a-4b91-9986-dd90f36a6cc8 service nova] Creating event network-changed:172336ef-ed14-4657-93d7-72c15445dce5 for instance f231479c-af6e-4233-8b90-27574ed9335f on hv-cinder-85199 Aug 06 12:30:42.715391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ba1aefb3-f4e7-4cc5-b328-19784e626468 req-54002736-ec7a-4b91-9986-dd90f36a6cc8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117824) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 12:30:42.715986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ba1aefb3-f4e7-4cc5-b328-19784e626468 req-54002736-ec7a-4b91-9986-dd90f36a6cc8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117824) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 12:30:42.718254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7973bd4d-818d-4e2c-89a2-4699a9e8458e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:42.719324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7973bd4d-818d-4e2c-89a2-4699a9e8458e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:42.719969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7973bd4d-818d-4e2c-89a2-4699a9e8458e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:42.722012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7973bd4d-818d-4e2c-89a2-4699a9e8458e None None] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:42.722683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7973bd4d-818d-4e2c-89a2-4699a9e8458e None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:42.723336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7973bd4d-818d-4e2c-89a2-4699a9e8458e None None] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:42.754048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.compute.rpcapi [None req-7973bd4d-818d-4e2c-89a2-4699a9e8458e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 12:30:42.754048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7973bd4d-818d-4e2c-89a2-4699a9e8458e None None] Releasing lock "compute-rpcapi-router" {{(pid=117824) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 12:30:42.772702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7973bd4d-818d-4e2c-89a2-4699a9e8458e None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.467461 Aug 06 12:30:42.776145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 46/92] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:42.782265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-002f74b0-80de-4b43-b294-ef1cecf67119 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004543 Aug 06 12:30:42.783289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 47/93] 10.222.0.20 () {58 vars in 1140 bytes} [Sat Aug 6 12:30:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 12:30:42.797546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cc753288-2c45-448c-8386-ec7796a1afd6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:42.798068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cc753288-2c45-448c-8386-ec7796a1afd6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:42.804937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc753288-2c45-448c-8386-ec7796a1afd6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:42.805427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc753288-2c45-448c-8386-ec7796a1afd6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:42.805866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc753288-2c45-448c-8386-ec7796a1afd6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:42.806722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc753288-2c45-448c-8386-ec7796a1afd6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:42.807197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc753288-2c45-448c-8386-ec7796a1afd6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:42.807630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc753288-2c45-448c-8386-ec7796a1afd6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:42.976062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f725b15e-2720-435f-9335-3b6b3576cdc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:42.987786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f725b15e-2720-435f-9335-3b6b3576cdc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.653443 Aug 06 12:30:42.990904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 47/94] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:42 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:43.018798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3feafff8-2c9d-43c7-9134-a175f5d66439 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:43.021411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3feafff8-2c9d-43c7-9134-a175f5d66439 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:43.038456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3feafff8-2c9d-43c7-9134-a175f5d66439 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:43.040533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3feafff8-2c9d-43c7-9134-a175f5d66439 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:43.041879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3feafff8-2c9d-43c7-9134-a175f5d66439 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:43.044362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3feafff8-2c9d-43c7-9134-a175f5d66439 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:43.044875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3feafff8-2c9d-43c7-9134-a175f5d66439 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:43.046998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3feafff8-2c9d-43c7-9134-a175f5d66439 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:43.056264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cc753288-2c45-448c-8386-ec7796a1afd6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:43.076468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cc753288-2c45-448c-8386-ec7796a1afd6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.291216 Aug 06 12:30:43.077058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 48/95] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:42 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:43.086028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-336fc530-006f-458e-8365-2cf15d9141a7 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006442 Aug 06 12:30:43.092249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 49/96] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Aug 6 12:30:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 12:30:43.098263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-300f7681-2c70-4021-a810-42c0d2776441 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Calling method '.version_select at 0x7f541ad32790>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:43.133545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-300f7681-2c70-4021-a810-42c0d2776441 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] HTTP exception thrown: Volume 0dc045c9-6156-4f0e-94d3-f17b232883fd could not be found. Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-300f7681-2c70-4021-a810-42c0d2776441 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Request method failure captured: Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/os-volumes/0dc045c9-6156-4f0e-94d3-f17b232883fd HTTP/1.1 Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7q1oqpWUMcgjHvWGNHJVImO_VIVS7JrVi8ahl6R477Sv8hP8lqSomqTJLGYjKcdbNjTlVy0kGIY8a9PjvCPGUzPOqEfB0svF-E_9S-ncC3PvoEEo_1EVWGcRox2iwU85A4qiAd8H_nxjEprEKIYeIEJ2qZLx2cXGOCE8cNDg7NXwY Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:30:43.135583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1a19e414e5ab48fb8fd2615e694dec41 Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Volume 0dc045c9-6156-4f0e-94d3-f17b232883fd could not be found. Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '0dc045c9-6156-4f0e-94d3-f17b232883fd'} Aug 06 12:30:43.136970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0dc045c9-6156-4f0e-94d3-f17b232883fd could not be found. (HTTP 404) (Request-ID: req-d5e07c8a-d82d-4833-b5c4-13a62e1591c6) Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:43.137826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 12:30:43.139069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0dc045c9-6156-4f0e-94d3-f17b232883fd could not be found. Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 12:30:43.140232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0dc045c9-6156-4f0e-94d3-f17b232883fd could not be found. Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0dc045c9-6156-4f0e-94d3-f17b232883fd could not be found. Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-300f7681-2c70-4021-a810-42c0d2776441 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Returning 404 to user: Volume 0dc045c9-6156-4f0e-94d3-f17b232883fd could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:43.141464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-300f7681-2c70-4021-a810-42c0d2776441 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/0dc045c9-6156-4f0e-94d3-f17b232883fd" status: 404 len: 109 microversion: 2.1 time: 0.043229 Aug 06 12:30:43.144023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 50/97] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Aug 6 12:30:43 2022] DELETE /compute/v2.1/os-volumes/0dc045c9-6156-4f0e-94d3-f17b232883fd => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 12:30:43.150958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-15cd312e-cf05-4ba7-a019-0c2bdb17c762 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Calling method '.version_select at 0x7f541ace8af0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:43.183054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-15cd312e-cf05-4ba7-a019-0c2bdb17c762 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] HTTP exception thrown: Volume 4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e could not be found. Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-15cd312e-cf05-4ba7-a019-0c2bdb17c762 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Request method failure captured: Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/os-volumes/4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e HTTP/1.1 Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7q1oqpWUMcgjHvWGNHJVImO_VIVS7JrVi8ahl6R477Sv8hP8lqSomqTJLGYjKcdbNjTlVy0kGIY8a9PjvCPGUzPOqEfB0svF-E_9S-ncC3PvoEEo_1EVWGcRox2iwU85A4qiAd8H_nxjEprEKIYeIEJ2qZLx2cXGOCE8cNDg7NXwY Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:30:43.185180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/386778dcad4d45c7bc5c343b735983b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 386778dcad4d45c7bc5c343b735983b2 Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesNegativeTest-588000863 Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1a19e414e5ab48fb8fd2615e694dec41 Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesNegativeTest-588000863-project Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Volume 4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e could not be found. Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e'} Aug 06 12:30:43.186474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e could not be found. (HTTP 404) (Request-ID: req-255fa189-02cc-4be0-839c-15293d4dfc94) Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:43.187142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 12:30:43.188060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e could not be found. Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 12:30:43.189569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e could not be found. Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e could not be found. Aug 06 12:30:43.192760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:30:43.194777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-15cd312e-cf05-4ba7-a019-0c2bdb17c762 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] Returning 404 to user: Volume 4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:30:43.201154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-15cd312e-cf05-4ba7-a019-0c2bdb17c762 tempest-VolumesNegativeTest-588000863 tempest-VolumesNegativeTest-588000863-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e" status: 404 len: 109 microversion: 2.1 time: 0.055867 Aug 06 12:30:43.201954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 51/98] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Aug 6 12:30:43 2022] GET /compute/v2.1/os-volumes/4e1a0bb4-4992-4ca5-ab51-4571f7e4b83e => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 12:30:43.218158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3feafff8-2c9d-43c7-9134-a175f5d66439 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:43.226373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3feafff8-2c9d-43c7-9134-a175f5d66439 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.234296 Aug 06 12:30:43.226955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 48/99] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:42 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:43.284616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:43.285243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:43.298400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:43.298969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:43.299248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:43.299953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:43.300430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:43.301530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:43.452111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:43.460614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:43.462339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:43.463754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-50f3ddca-0a13-4f3d-85c6-98344929f93f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.183710 Aug 06 12:30:43.464633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 52/100] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:44.009215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-708633e4-8dea-4cc3-97f0-7be2e385f3ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:44.010183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-708633e4-8dea-4cc3-97f0-7be2e385f3ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:44.016896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-708633e4-8dea-4cc3-97f0-7be2e385f3ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:44.017751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-708633e4-8dea-4cc3-97f0-7be2e385f3ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:44.018249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-708633e4-8dea-4cc3-97f0-7be2e385f3ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:44.019123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-708633e4-8dea-4cc3-97f0-7be2e385f3ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:44.020379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-708633e4-8dea-4cc3-97f0-7be2e385f3ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:44.020988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-708633e4-8dea-4cc3-97f0-7be2e385f3ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:44.102724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7f45fcc6-a6f3-420b-8d85-64d4a8d933f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:44.103756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7f45fcc6-a6f3-420b-8d85-64d4a8d933f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:44.109557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:44.116478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f45fcc6-a6f3-420b-8d85-64d4a8d933f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:44.117933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f45fcc6-a6f3-420b-8d85-64d4a8d933f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:44.119570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f45fcc6-a6f3-420b-8d85-64d4a8d933f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:44.120331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f45fcc6-a6f3-420b-8d85-64d4a8d933f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:44.120796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f45fcc6-a6f3-420b-8d85-64d4a8d933f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:44.121231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f45fcc6-a6f3-420b-8d85-64d4a8d933f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:44.348344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-708633e4-8dea-4cc3-97f0-7be2e385f3ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:44.356747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-708633e4-8dea-4cc3-97f0-7be2e385f3ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.351488 Aug 06 12:30:44.357338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 49/101] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:44 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:44.382922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5b09155c-ed12-4abe-bec8-31d45e93d2be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:44.383530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5b09155c-ed12-4abe-bec8-31d45e93d2be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:44.397846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b09155c-ed12-4abe-bec8-31d45e93d2be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:44.399307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b09155c-ed12-4abe-bec8-31d45e93d2be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:44.399756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b09155c-ed12-4abe-bec8-31d45e93d2be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:44.400510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b09155c-ed12-4abe-bec8-31d45e93d2be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:44.400963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b09155c-ed12-4abe-bec8-31d45e93d2be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:44.401384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b09155c-ed12-4abe-bec8-31d45e93d2be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:44.625355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b09155c-ed12-4abe-bec8-31d45e93d2be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:44.649818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5b09155c-ed12-4abe-bec8-31d45e93d2be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.266695 Aug 06 12:30:44.649988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7f45fcc6-a6f3-420b-8d85-64d4a8d933f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:44.657577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7f45fcc6-a6f3-420b-8d85-64d4a8d933f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.559648 Aug 06 12:30:44.668348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 53/102] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:30:44.669266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 50/103] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:44 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:44.676674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-67e2fbb0-45c7-49c2-b675-315bc72debb5 req-82d221e8-8d4d-486e-a23a-e7d2c7d50928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27", "tag": "3caedfaf-acd7-443b-a2c4-40f8c5e04f52"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:44.678868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:44.679537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:44.694677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:44.695129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:44.695606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:44.696669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:44.697365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:44.698148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:44.712092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-67e2fbb0-45c7-49c2-b675-315bc72debb5 req-82d221e8-8d4d-486e-a23a-e7d2c7d50928 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:44.714769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-67e2fbb0-45c7-49c2-b675-315bc72debb5 req-82d221e8-8d4d-486e-a23a-e7d2c7d50928 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:44.716005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-67e2fbb0-45c7-49c2-b675-315bc72debb5 req-82d221e8-8d4d-486e-a23a-e7d2c7d50928 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:44.748031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-67e2fbb0-45c7-49c2-b675-315bc72debb5 req-82d221e8-8d4d-486e-a23a-e7d2c7d50928 service nova] Creating event network-changed:3caedfaf-acd7-443b-a2c4-40f8c5e04f52 for instance b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 on hv-cinder-85199 Aug 06 12:30:44.766982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-67e2fbb0-45c7-49c2-b675-315bc72debb5 req-82d221e8-8d4d-486e-a23a-e7d2c7d50928 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105239 Aug 06 12:30:44.770089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 54/104] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:44.819922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-931dbca2-99f9-441c-8677-91e28fd9048e req-f2e4d1a5-ec2c-4660-8dd7-d45e7b665a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc407ff3-fc1e-44bf-9c20-73203361a20f", "tag": "38e012d9-8547-43fd-8f63-fc6e18d35361"}, {"name": "network-changed", "server_uuid": "acfe37e0-b98f-49eb-aef9-6e6279dae867", "tag": "d5229f58-fe7a-4bcb-b624-651ae519779d"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:44.835090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-931dbca2-99f9-441c-8677-91e28fd9048e req-f2e4d1a5-ec2c-4660-8dd7-d45e7b665a18 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:44.835664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-931dbca2-99f9-441c-8677-91e28fd9048e req-f2e4d1a5-ec2c-4660-8dd7-d45e7b665a18 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:44.835979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-931dbca2-99f9-441c-8677-91e28fd9048e req-f2e4d1a5-ec2c-4660-8dd7-d45e7b665a18 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:44.874132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-931dbca2-99f9-441c-8677-91e28fd9048e req-f2e4d1a5-ec2c-4660-8dd7-d45e7b665a18 service nova] Creating event network-changed:38e012d9-8547-43fd-8f63-fc6e18d35361 for instance dc407ff3-fc1e-44bf-9c20-73203361a20f on hv-cinder-85199 Aug 06 12:30:44.874818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-931dbca2-99f9-441c-8677-91e28fd9048e req-f2e4d1a5-ec2c-4660-8dd7-d45e7b665a18 service nova] Creating event network-changed:d5229f58-fe7a-4bcb-b624-651ae519779d for instance acfe37e0-b98f-49eb-aef9-6e6279dae867 on hv-cinder-85199 Aug 06 12:30:44.885794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-931dbca2-99f9-441c-8677-91e28fd9048e req-f2e4d1a5-ec2c-4660-8dd7-d45e7b665a18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.069755 Aug 06 12:30:44.886412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 55/105] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:45.259168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:45.267826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:45.271409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:45.272786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-271f8adb-144c-47a7-abee-b75ee07c330a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.605103 Aug 06 12:30:45.288101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 51/106] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:45.381366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-50c4d4f9-4a87-482e-83ea-73195ab68b78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:45.381830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-50c4d4f9-4a87-482e-83ea-73195ab68b78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:45.388793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50c4d4f9-4a87-482e-83ea-73195ab68b78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:45.389555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50c4d4f9-4a87-482e-83ea-73195ab68b78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:45.390219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50c4d4f9-4a87-482e-83ea-73195ab68b78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:45.391355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50c4d4f9-4a87-482e-83ea-73195ab68b78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:45.391931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50c4d4f9-4a87-482e-83ea-73195ab68b78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:45.392950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50c4d4f9-4a87-482e-83ea-73195ab68b78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:45.396397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=75 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:45.561103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-50c4d4f9-4a87-482e-83ea-73195ab68b78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:45.569279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-50c4d4f9-4a87-482e-83ea-73195ab68b78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.193846 Aug 06 12:30:45.583827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 56/107] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:45 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:45.674674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d1ef85a3-ae0e-422a-adb7-d9f3b437c380 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:45.676857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d1ef85a3-ae0e-422a-adb7-d9f3b437c380 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:45.685250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f2a4b986-2b1a-4f01-b2b9-a85b1ea13f21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:45.686349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f2a4b986-2b1a-4f01-b2b9-a85b1ea13f21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:45.699753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:45.702568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2a4b986-2b1a-4f01-b2b9-a85b1ea13f21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:45.704732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1ef85a3-ae0e-422a-adb7-d9f3b437c380 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:45.705226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2a4b986-2b1a-4f01-b2b9-a85b1ea13f21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:45.707374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1ef85a3-ae0e-422a-adb7-d9f3b437c380 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:45.708739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2a4b986-2b1a-4f01-b2b9-a85b1ea13f21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:45.709549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1ef85a3-ae0e-422a-adb7-d9f3b437c380 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:45.711841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2a4b986-2b1a-4f01-b2b9-a85b1ea13f21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:45.713180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1ef85a3-ae0e-422a-adb7-d9f3b437c380 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:45.713469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2a4b986-2b1a-4f01-b2b9-a85b1ea13f21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:45.714241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1ef85a3-ae0e-422a-adb7-d9f3b437c380 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:45.715155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2a4b986-2b1a-4f01-b2b9-a85b1ea13f21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:45.716911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1ef85a3-ae0e-422a-adb7-d9f3b437c380 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:45.949147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f2a4b986-2b1a-4f01-b2b9-a85b1ea13f21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:45.957863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f2a4b986-2b1a-4f01-b2b9-a85b1ea13f21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.278460 Aug 06 12:30:45.959316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 57/108] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:30:45.975856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d1ef85a3-ae0e-422a-adb7-d9f3b437c380 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:45.986964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d1ef85a3-ae0e-422a-adb7-d9f3b437c380 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.316091 Aug 06 12:30:46.006136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 52/109] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:45 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:46.295319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:46.296154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:46.302943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:46.303429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:46.303862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:46.304589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:46.305031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:46.305605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:46.454951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:46.467385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:46.468934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:46.470451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5fc49c72-2378-4549-b442-067f3469d312 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.179009 Aug 06 12:30:46.471651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 58/110] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:46.590258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1785a51b-8e71-4b20-94da-077aec6dc5d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:46.590860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1785a51b-8e71-4b20-94da-077aec6dc5d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:46.596868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1785a51b-8e71-4b20-94da-077aec6dc5d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:46.597500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1785a51b-8e71-4b20-94da-077aec6dc5d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:46.598270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1785a51b-8e71-4b20-94da-077aec6dc5d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:46.599139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1785a51b-8e71-4b20-94da-077aec6dc5d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:46.599758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1785a51b-8e71-4b20-94da-077aec6dc5d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:46.600448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1785a51b-8e71-4b20-94da-077aec6dc5d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:46.753234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1785a51b-8e71-4b20-94da-077aec6dc5d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:46.761326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1785a51b-8e71-4b20-94da-077aec6dc5d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.175008 Aug 06 12:30:46.761894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 53/111] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:46 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:46.979954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c9ffec82-4fd9-4ada-950d-521046abbc5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:46.980655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c9ffec82-4fd9-4ada-950d-521046abbc5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:46.987738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9ffec82-4fd9-4ada-950d-521046abbc5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:46.989813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9ffec82-4fd9-4ada-950d-521046abbc5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:46.992050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9ffec82-4fd9-4ada-950d-521046abbc5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:46.994676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9ffec82-4fd9-4ada-950d-521046abbc5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:46.995421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9ffec82-4fd9-4ada-950d-521046abbc5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:46.996822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9ffec82-4fd9-4ada-950d-521046abbc5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:47.008497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-18ed32c5-a537-44a2-9b9e-8fbf69773195 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:47.009109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-18ed32c5-a537-44a2-9b9e-8fbf69773195 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:47.020067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18ed32c5-a537-44a2-9b9e-8fbf69773195 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:47.023355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18ed32c5-a537-44a2-9b9e-8fbf69773195 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:47.023869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18ed32c5-a537-44a2-9b9e-8fbf69773195 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:47.024623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18ed32c5-a537-44a2-9b9e-8fbf69773195 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:47.025085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18ed32c5-a537-44a2-9b9e-8fbf69773195 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:47.025521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18ed32c5-a537-44a2-9b9e-8fbf69773195 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:47.274049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-18ed32c5-a537-44a2-9b9e-8fbf69773195 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:47.284942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-18ed32c5-a537-44a2-9b9e-8fbf69773195 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.278807 Aug 06 12:30:47.284942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 54/112] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:47 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:47.439520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c9ffec82-4fd9-4ada-950d-521046abbc5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:47.450035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c9ffec82-4fd9-4ada-950d-521046abbc5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.474056 Aug 06 12:30:47.450613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 59/113] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:47.498371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:47.499382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:47.510695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:47.512884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:47.514335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:47.518741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:47.521051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:47.521505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:47.785992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e84b5d8d-2116-4c84-8864-fab91fcba1fc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:47.787342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e84b5d8d-2116-4c84-8864-fab91fcba1fc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:47.795042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e84b5d8d-2116-4c84-8864-fab91fcba1fc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:47.795723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e84b5d8d-2116-4c84-8864-fab91fcba1fc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:47.796164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e84b5d8d-2116-4c84-8864-fab91fcba1fc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:47.797063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e84b5d8d-2116-4c84-8864-fab91fcba1fc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:47.797606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e84b5d8d-2116-4c84-8864-fab91fcba1fc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:47.798034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e84b5d8d-2116-4c84-8864-fab91fcba1fc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:47.847016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:47.859955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:47.862385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:47.864423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-132986a4-0fe6-43f7-9f22-98ec6222124c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.374891 Aug 06 12:30:47.865171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 55/114] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:48.073522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e84b5d8d-2116-4c84-8864-fab91fcba1fc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:48.081767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e84b5d8d-2116-4c84-8864-fab91fcba1fc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.302069 Aug 06 12:30:48.082415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 60/115] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:47 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:48.307036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ab43ff6d-7fe4-46db-81bb-fdf33b728b93 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:48.307659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ab43ff6d-7fe4-46db-81bb-fdf33b728b93 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:48.320158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab43ff6d-7fe4-46db-81bb-fdf33b728b93 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:48.320685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab43ff6d-7fe4-46db-81bb-fdf33b728b93 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:48.321282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab43ff6d-7fe4-46db-81bb-fdf33b728b93 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:48.321991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab43ff6d-7fe4-46db-81bb-fdf33b728b93 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:48.324480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab43ff6d-7fe4-46db-81bb-fdf33b728b93 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:48.325208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab43ff6d-7fe4-46db-81bb-fdf33b728b93 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:48.471644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f34d7c61-b972-4664-88be-a109e963f0fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:48.472331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f34d7c61-b972-4664-88be-a109e963f0fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:48.484565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34d7c61-b972-4664-88be-a109e963f0fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:48.485065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34d7c61-b972-4664-88be-a109e963f0fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:48.485498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34d7c61-b972-4664-88be-a109e963f0fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:48.486193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34d7c61-b972-4664-88be-a109e963f0fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:48.497800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34d7c61-b972-4664-88be-a109e963f0fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:48.505191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34d7c61-b972-4664-88be-a109e963f0fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:48.610336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ab43ff6d-7fe4-46db-81bb-fdf33b728b93 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:48.618605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ab43ff6d-7fe4-46db-81bb-fdf33b728b93 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.315316 Aug 06 12:30:48.619187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 56/116] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:48 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:48.806424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f34d7c61-b972-4664-88be-a109e963f0fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:48.821619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f34d7c61-b972-4664-88be-a109e963f0fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.353729 Aug 06 12:30:48.822880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 61/117] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:30:48.909453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:48.911197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:48.918264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:48.918681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:48.919131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:48.920048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:48.920551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:48.921564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:49.082692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:49.093188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:49.095677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:49.097093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4892989c-f7d6-4830-81b3-39cba1abecf8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.191721 Aug 06 12:30:49.100720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 57/118] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:30:49.102211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-003e8fdf-d43c-4676-ac01-c274c4c0b496 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:49.103002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-003e8fdf-d43c-4676-ac01-c274c4c0b496 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:49.117430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-003e8fdf-d43c-4676-ac01-c274c4c0b496 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:49.118228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-003e8fdf-d43c-4676-ac01-c274c4c0b496 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:49.118821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-003e8fdf-d43c-4676-ac01-c274c4c0b496 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:49.119679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-003e8fdf-d43c-4676-ac01-c274c4c0b496 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:49.120141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-003e8fdf-d43c-4676-ac01-c274c4c0b496 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:49.120633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-003e8fdf-d43c-4676-ac01-c274c4c0b496 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:49.265410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-003e8fdf-d43c-4676-ac01-c274c4c0b496 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:49.274082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-003e8fdf-d43c-4676-ac01-c274c4c0b496 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.175722 Aug 06 12:30:49.274720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 62/119] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:49 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:49.640546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4b66acb4-c8c0-435a-961f-753e1b69a891 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:49.641523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4b66acb4-c8c0-435a-961f-753e1b69a891 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:49.655272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b66acb4-c8c0-435a-961f-753e1b69a891 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:49.656936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b66acb4-c8c0-435a-961f-753e1b69a891 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:49.658358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b66acb4-c8c0-435a-961f-753e1b69a891 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:49.661688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b66acb4-c8c0-435a-961f-753e1b69a891 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:49.662473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b66acb4-c8c0-435a-961f-753e1b69a891 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:49.664672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b66acb4-c8c0-435a-961f-753e1b69a891 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:49.846870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-711fef62-cd46-4e72-a052-068752c760b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:49.848014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-711fef62-cd46-4e72-a052-068752c760b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:49.865132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-711fef62-cd46-4e72-a052-068752c760b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:49.865132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-711fef62-cd46-4e72-a052-068752c760b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:49.865132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-711fef62-cd46-4e72-a052-068752c760b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:49.865132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-711fef62-cd46-4e72-a052-068752c760b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:49.865690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-711fef62-cd46-4e72-a052-068752c760b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:49.865762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-711fef62-cd46-4e72-a052-068752c760b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:49.911002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4b66acb4-c8c0-435a-961f-753e1b69a891 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:49.920681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4b66acb4-c8c0-435a-961f-753e1b69a891 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.284878 Aug 06 12:30:49.921764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 58/120] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:49 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:50.121894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:50.123434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:50.126982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-711fef62-cd46-4e72-a052-068752c760b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:50.135049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:50.137115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-711fef62-cd46-4e72-a052-068752c760b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.294412 Aug 06 12:30:50.140408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:50.140948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:50.142274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:50.144868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:50.146276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:50.150010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 63/121] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:50.295103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-545a97f4-1689-434f-ad76-7a29972097e7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:50.296949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-545a97f4-1689-434f-ad76-7a29972097e7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:50.307133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-545a97f4-1689-434f-ad76-7a29972097e7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:50.307689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-545a97f4-1689-434f-ad76-7a29972097e7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:50.308134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-545a97f4-1689-434f-ad76-7a29972097e7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:50.308892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-545a97f4-1689-434f-ad76-7a29972097e7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:50.309346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-545a97f4-1689-434f-ad76-7a29972097e7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:50.309768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-545a97f4-1689-434f-ad76-7a29972097e7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:50.444980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:50.453885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:50.455354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:50.460575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ee6f6927-4b43-441f-b0f0-f785e7bcacba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.339031 Aug 06 12:30:50.465718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 59/122] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:30:50.672911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-545a97f4-1689-434f-ad76-7a29972097e7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:50.682908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-545a97f4-1689-434f-ad76-7a29972097e7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.391734 Aug 06 12:30:50.684848 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 64/123] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:50 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:30:50.944860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-116cd1eb-5c33-4619-91af-bf0b45a04e23 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:50.946132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-116cd1eb-5c33-4619-91af-bf0b45a04e23 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:50.954671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-116cd1eb-5c33-4619-91af-bf0b45a04e23 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:50.955397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-116cd1eb-5c33-4619-91af-bf0b45a04e23 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:50.969120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-116cd1eb-5c33-4619-91af-bf0b45a04e23 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:50.969900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-116cd1eb-5c33-4619-91af-bf0b45a04e23 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:50.970542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-116cd1eb-5c33-4619-91af-bf0b45a04e23 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:50.971128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-116cd1eb-5c33-4619-91af-bf0b45a04e23 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:51.165223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-624fdffa-a279-49f0-b194-2b807693436b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:51.166120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-624fdffa-a279-49f0-b194-2b807693436b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:51.190714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-624fdffa-a279-49f0-b194-2b807693436b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:51.191771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-624fdffa-a279-49f0-b194-2b807693436b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:51.192261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-624fdffa-a279-49f0-b194-2b807693436b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:51.193158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-624fdffa-a279-49f0-b194-2b807693436b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:51.194201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-624fdffa-a279-49f0-b194-2b807693436b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:51.196723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-624fdffa-a279-49f0-b194-2b807693436b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:51.236588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-116cd1eb-5c33-4619-91af-bf0b45a04e23 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:51.248086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-116cd1eb-5c33-4619-91af-bf0b45a04e23 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.309316 Aug 06 12:30:51.248875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 60/124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:50 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:51.397500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-624fdffa-a279-49f0-b194-2b807693436b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:51.406311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-624fdffa-a279-49f0-b194-2b807693436b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.246723 Aug 06 12:30:51.406881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 65/125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:51.493159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:51.493769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:51.499787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:51.500275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:51.500734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:51.501598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:51.502056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:51.502479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:51.656691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:51.665050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:51.670798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:51.671954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa3511b0-edd8-4666-b1df-b871744e1255 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.183758 Aug 06 12:30:51.678132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 61/126] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:51.712123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a36320a2-65b4-43d6-99ce-b577783252a9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:51.712123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a36320a2-65b4-43d6-99ce-b577783252a9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:51.717015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a36320a2-65b4-43d6-99ce-b577783252a9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:51.717519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a36320a2-65b4-43d6-99ce-b577783252a9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:51.718055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a36320a2-65b4-43d6-99ce-b577783252a9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:51.718658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a36320a2-65b4-43d6-99ce-b577783252a9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:51.719165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a36320a2-65b4-43d6-99ce-b577783252a9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:51.719784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a36320a2-65b4-43d6-99ce-b577783252a9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:52.271754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3a5a88f4-1044-4f16-965f-2d5f85e3d07c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:52.272344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3a5a88f4-1044-4f16-965f-2d5f85e3d07c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:52.275890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:52.287268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a5a88f4-1044-4f16-965f-2d5f85e3d07c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:52.287783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a5a88f4-1044-4f16-965f-2d5f85e3d07c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:52.288229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a5a88f4-1044-4f16-965f-2d5f85e3d07c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:52.290834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a5a88f4-1044-4f16-965f-2d5f85e3d07c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:52.292437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a5a88f4-1044-4f16-965f-2d5f85e3d07c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:52.292882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a5a88f4-1044-4f16-965f-2d5f85e3d07c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:52.438227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a36320a2-65b4-43d6-99ce-b577783252a9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:52.452569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a36320a2-65b4-43d6-99ce-b577783252a9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.751197 Aug 06 12:30:52.453333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 66/127] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:51 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:52.465833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-463c7076-38e2-4367-ade4-03bb509b9fea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:52.465833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-463c7076-38e2-4367-ade4-03bb509b9fea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:52.467362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-463c7076-38e2-4367-ade4-03bb509b9fea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:52.468113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-463c7076-38e2-4367-ade4-03bb509b9fea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:52.468777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-463c7076-38e2-4367-ade4-03bb509b9fea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:52.469915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-463c7076-38e2-4367-ade4-03bb509b9fea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:52.470625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-463c7076-38e2-4367-ade4-03bb509b9fea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:52.471349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-463c7076-38e2-4367-ade4-03bb509b9fea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:52.514189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3a5a88f4-1044-4f16-965f-2d5f85e3d07c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:52.518357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:52.526909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3a5a88f4-1044-4f16-965f-2d5f85e3d07c tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.261236 Aug 06 12:30:52.532508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 62/128] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:52 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:52.698250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-463c7076-38e2-4367-ade4-03bb509b9fea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:52.705485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:52.706212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:52.718593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-463c7076-38e2-4367-ade4-03bb509b9fea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.264092 Aug 06 12:30:52.721036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 67/129] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:52 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:52.722113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:52.722813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:52.723385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:52.725294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:52.725786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:52.726212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:53.056460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:53.070019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:53.073525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:53.076364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-30847b31-4e07-42ef-932f-b3bce551f9af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.385857 Aug 06 12:30:53.085542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 63/130] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:30:53.481929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e400fc9c-3811-476b-9d34-1d4ac325e4f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:53.482621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e400fc9c-3811-476b-9d34-1d4ac325e4f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:53.484679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:53.499758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e400fc9c-3811-476b-9d34-1d4ac325e4f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:53.500771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e400fc9c-3811-476b-9d34-1d4ac325e4f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:53.501586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e400fc9c-3811-476b-9d34-1d4ac325e4f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:53.502535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e400fc9c-3811-476b-9d34-1d4ac325e4f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:53.503308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e400fc9c-3811-476b-9d34-1d4ac325e4f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:53.504575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e400fc9c-3811-476b-9d34-1d4ac325e4f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:53.546897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-df1abdef-a587-4102-837e-e9b687fef82a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:53.547506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df1abdef-a587-4102-837e-e9b687fef82a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:53.554891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df1abdef-a587-4102-837e-e9b687fef82a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:53.556679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df1abdef-a587-4102-837e-e9b687fef82a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:53.557267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df1abdef-a587-4102-837e-e9b687fef82a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:53.557967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df1abdef-a587-4102-837e-e9b687fef82a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:53.558411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df1abdef-a587-4102-837e-e9b687fef82a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:53.558828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df1abdef-a587-4102-837e-e9b687fef82a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:53.694462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e400fc9c-3811-476b-9d34-1d4ac325e4f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:53.704490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e400fc9c-3811-476b-9d34-1d4ac325e4f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.227059 Aug 06 12:30:53.706350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 68/131] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:53 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:53.742050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6299d6d6-fda7-4552-bd9b-46ef021020d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:53.743075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6299d6d6-fda7-4552-bd9b-46ef021020d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:53.754226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6299d6d6-fda7-4552-bd9b-46ef021020d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:53.754726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6299d6d6-fda7-4552-bd9b-46ef021020d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:53.755157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6299d6d6-fda7-4552-bd9b-46ef021020d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:53.756945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6299d6d6-fda7-4552-bd9b-46ef021020d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:53.758766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6299d6d6-fda7-4552-bd9b-46ef021020d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:53.761043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6299d6d6-fda7-4552-bd9b-46ef021020d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:53.768221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df1abdef-a587-4102-837e-e9b687fef82a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:53.778298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-df1abdef-a587-4102-837e-e9b687fef82a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.234969 Aug 06 12:30:53.780571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 64/132] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:53 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:53.976616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6299d6d6-fda7-4552-bd9b-46ef021020d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:53.986115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6299d6d6-fda7-4552-bd9b-46ef021020d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.248803 Aug 06 12:30:53.988473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 69/133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:53 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:54.101203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:54.101805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:54.108650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:54.109369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:54.110029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:54.111191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:54.112391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:54.113554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:54.388237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:54.399896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:54.401822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:54.403161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-086e7571-bd20-46dd-8551-44274e21c840 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.305800 Aug 06 12:30:54.403729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 65/134] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:54.726937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4608d3bb-7219-49d2-b1b8-a50950132e6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:54.728334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4608d3bb-7219-49d2-b1b8-a50950132e6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:54.736446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4608d3bb-7219-49d2-b1b8-a50950132e6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:54.737436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4608d3bb-7219-49d2-b1b8-a50950132e6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:54.738852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4608d3bb-7219-49d2-b1b8-a50950132e6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:54.739857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4608d3bb-7219-49d2-b1b8-a50950132e6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:54.744676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4608d3bb-7219-49d2-b1b8-a50950132e6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:54.745181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4608d3bb-7219-49d2-b1b8-a50950132e6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:54.790766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-cfed4fa0-2d5b-4d74-8657-e7bef00d3bec req-28dc76c9-7646-4c69-b1d3-f2b41c831ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f231479c-af6e-4233-8b90-27574ed9335f", "name": "network-vif-plugged", "status": "completed", "tag": "172336ef-ed14-4657-93d7-72c15445dce5"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:54.801550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-cfed4fa0-2d5b-4d74-8657-e7bef00d3bec req-28dc76c9-7646-4c69-b1d3-f2b41c831ab5 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:54.802353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-cfed4fa0-2d5b-4d74-8657-e7bef00d3bec req-28dc76c9-7646-4c69-b1d3-f2b41c831ab5 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:54.803010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-cfed4fa0-2d5b-4d74-8657-e7bef00d3bec req-28dc76c9-7646-4c69-b1d3-f2b41c831ab5 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:54.836604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-cfed4fa0-2d5b-4d74-8657-e7bef00d3bec req-28dc76c9-7646-4c69-b1d3-f2b41c831ab5 service nova] Creating event network-vif-plugged:172336ef-ed14-4657-93d7-72c15445dce5 for instance f231479c-af6e-4233-8b90-27574ed9335f on hv-cinder-85199 Aug 06 12:30:54.846735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-cfed4fa0-2d5b-4d74-8657-e7bef00d3bec req-28dc76c9-7646-4c69-b1d3-f2b41c831ab5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210869 Aug 06 12:30:54.849414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 70/135] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:54.856706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a2e54286-4ab1-428e-9cfc-6c15f98509a5 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:54.861739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a2e54286-4ab1-428e-9cfc-6c15f98509a5 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:54.869316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e54286-4ab1-428e-9cfc-6c15f98509a5 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:54.869966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e54286-4ab1-428e-9cfc-6c15f98509a5 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:54.870462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e54286-4ab1-428e-9cfc-6c15f98509a5 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:54.871224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e54286-4ab1-428e-9cfc-6c15f98509a5 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:54.871850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e54286-4ab1-428e-9cfc-6c15f98509a5 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:54.872467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e54286-4ab1-428e-9cfc-6c15f98509a5 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:54.918634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4608d3bb-7219-49d2-b1b8-a50950132e6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:54.930117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4608d3bb-7219-49d2-b1b8-a50950132e6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.205460 Aug 06 12:30:54.932718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 66/136] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:54 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:55.010318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c3281585-5f53-4dcc-84ac-2ed298a20db7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:55.011193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c3281585-5f53-4dcc-84ac-2ed298a20db7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:55.020165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3281585-5f53-4dcc-84ac-2ed298a20db7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:55.020950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3281585-5f53-4dcc-84ac-2ed298a20db7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:55.021750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3281585-5f53-4dcc-84ac-2ed298a20db7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:55.023239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3281585-5f53-4dcc-84ac-2ed298a20db7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:55.023918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3281585-5f53-4dcc-84ac-2ed298a20db7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:55.024757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3281585-5f53-4dcc-84ac-2ed298a20db7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:55.161537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2e54286-4ab1-428e-9cfc-6c15f98509a5 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:55.178337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a2e54286-4ab1-428e-9cfc-6c15f98509a5 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.327378 Aug 06 12:30:55.189557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 71/137] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:54 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:55.255232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c3281585-5f53-4dcc-84ac-2ed298a20db7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:55.270681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c3281585-5f53-4dcc-84ac-2ed298a20db7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.265654 Aug 06 12:30:55.271325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 67/138] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:55 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:55.430579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:55.431291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:55.441758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:55.443652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:55.444053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:55.446933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:55.447392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:55.454228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:55.665411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:55.674923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:55.676579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:55.677733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-af5579bc-0ed1-4f35-a4c1-fca79aae0971 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.254260 Aug 06 12:30:55.678874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 72/139] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:55.951450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e87c4356-4b03-4138-8632-a598e6cd5e1d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:55.952400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e87c4356-4b03-4138-8632-a598e6cd5e1d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:55.959794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e87c4356-4b03-4138-8632-a598e6cd5e1d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:55.960153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e87c4356-4b03-4138-8632-a598e6cd5e1d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:55.960615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e87c4356-4b03-4138-8632-a598e6cd5e1d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:55.961300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e87c4356-4b03-4138-8632-a598e6cd5e1d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:55.961963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e87c4356-4b03-4138-8632-a598e6cd5e1d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:55.962588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e87c4356-4b03-4138-8632-a598e6cd5e1d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:56.102810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e87c4356-4b03-4138-8632-a598e6cd5e1d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:56.110236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e87c4356-4b03-4138-8632-a598e6cd5e1d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.163851 Aug 06 12:30:56.111024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 68/140] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:55 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:56.200794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9ad143e8-d3d9-4a80-b9a1-fa2a645795c4 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:56.201515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9ad143e8-d3d9-4a80-b9a1-fa2a645795c4 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:56.208155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad143e8-d3d9-4a80-b9a1-fa2a645795c4 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:56.209272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad143e8-d3d9-4a80-b9a1-fa2a645795c4 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:56.209766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad143e8-d3d9-4a80-b9a1-fa2a645795c4 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:56.210460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad143e8-d3d9-4a80-b9a1-fa2a645795c4 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:56.210945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad143e8-d3d9-4a80-b9a1-fa2a645795c4 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:56.211399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad143e8-d3d9-4a80-b9a1-fa2a645795c4 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:56.226918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:30:56.298960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bedbfb13-15b2-449b-9990-4092168634b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:56.300910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bedbfb13-15b2-449b-9990-4092168634b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:56.320718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bedbfb13-15b2-449b-9990-4092168634b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:56.321638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bedbfb13-15b2-449b-9990-4092168634b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:56.323797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bedbfb13-15b2-449b-9990-4092168634b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:56.328573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bedbfb13-15b2-449b-9990-4092168634b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:56.332723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bedbfb13-15b2-449b-9990-4092168634b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:56.333429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bedbfb13-15b2-449b-9990-4092168634b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:56.826680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9ad143e8-d3d9-4a80-b9a1-fa2a645795c4 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:56.838067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9ad143e8-d3d9-4a80-b9a1-fa2a645795c4 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.640905 Aug 06 12:30:56.838647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 73/141] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:56 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:56.843478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:56.848862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:56.859121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:56.872969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:56.874006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:56.874929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:56.875795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:56.876554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:57.240930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bedbfb13-15b2-449b-9990-4092168634b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:57.241602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bedbfb13-15b2-449b-9990-4092168634b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.952835 Aug 06 12:30:57.242257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 69/142] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:30:57.254410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-77209fa7-d08a-4a5e-8be7-3b674aa57609 req-cdb9316d-0ab1-4e32-982b-3f6873f12fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88", "name": "network-vif-plugged", "status": "completed", "tag": "6661d37d-f9d6-463e-aeaa-3bb99adff19b"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:57.270571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-77209fa7-d08a-4a5e-8be7-3b674aa57609 req-cdb9316d-0ab1-4e32-982b-3f6873f12fa0 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:57.270983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-77209fa7-d08a-4a5e-8be7-3b674aa57609 req-cdb9316d-0ab1-4e32-982b-3f6873f12fa0 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:57.271388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-77209fa7-d08a-4a5e-8be7-3b674aa57609 req-cdb9316d-0ab1-4e32-982b-3f6873f12fa0 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:57.287754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-77209fa7-d08a-4a5e-8be7-3b674aa57609 req-cdb9316d-0ab1-4e32-982b-3f6873f12fa0 service nova] Creating event network-vif-plugged:6661d37d-f9d6-463e-aeaa-3bb99adff19b for instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 on hv-cinder-85199 Aug 06 12:30:57.302721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-77209fa7-d08a-4a5e-8be7-3b674aa57609 req-cdb9316d-0ab1-4e32-982b-3f6873f12fa0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059354 Aug 06 12:30:57.305387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 70/143] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:30:57.320367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3e50a0b5-ea59-4d29-9039-f0bb01d55308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:57.322167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3e50a0b5-ea59-4d29-9039-f0bb01d55308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:57.334447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e50a0b5-ea59-4d29-9039-f0bb01d55308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:57.337160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e50a0b5-ea59-4d29-9039-f0bb01d55308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:57.337669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e50a0b5-ea59-4d29-9039-f0bb01d55308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:57.338460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e50a0b5-ea59-4d29-9039-f0bb01d55308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:57.339941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e50a0b5-ea59-4d29-9039-f0bb01d55308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:57.340517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e50a0b5-ea59-4d29-9039-f0bb01d55308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:57.382872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:57.393020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:57.401400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:57.405972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb814de5-246c-400d-aaac-fc2bf2342bad tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.563478 Aug 06 12:30:57.406911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 74/144] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:56 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:30:57.723896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3e50a0b5-ea59-4d29-9039-f0bb01d55308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:57.731602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3e50a0b5-ea59-4d29-9039-f0bb01d55308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.421715 Aug 06 12:30:57.732241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 71/145] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:57 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:57.857994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c1177b30-07ed-4359-a6b6-20b395ae1579 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:57.858599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c1177b30-07ed-4359-a6b6-20b395ae1579 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:57.868725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1177b30-07ed-4359-a6b6-20b395ae1579 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:57.872182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1177b30-07ed-4359-a6b6-20b395ae1579 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:57.875839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1177b30-07ed-4359-a6b6-20b395ae1579 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:57.876645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1177b30-07ed-4359-a6b6-20b395ae1579 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:57.877256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1177b30-07ed-4359-a6b6-20b395ae1579 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:57.877690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1177b30-07ed-4359-a6b6-20b395ae1579 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:58.161223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c1177b30-07ed-4359-a6b6-20b395ae1579 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:58.169999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c1177b30-07ed-4359-a6b6-20b395ae1579 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.315819 Aug 06 12:30:58.173764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 75/146] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:57 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:58.268611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-613172a7-6a42-4e38-bd29-e5f280fedbe0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:58.269298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-613172a7-6a42-4e38-bd29-e5f280fedbe0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:58.276655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-613172a7-6a42-4e38-bd29-e5f280fedbe0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:58.277141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-613172a7-6a42-4e38-bd29-e5f280fedbe0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:58.279154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-613172a7-6a42-4e38-bd29-e5f280fedbe0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:58.280024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-613172a7-6a42-4e38-bd29-e5f280fedbe0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:58.280656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-613172a7-6a42-4e38-bd29-e5f280fedbe0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:58.281213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-613172a7-6a42-4e38-bd29-e5f280fedbe0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:58.423656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-613172a7-6a42-4e38-bd29-e5f280fedbe0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:58.432130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-613172a7-6a42-4e38-bd29-e5f280fedbe0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.167214 Aug 06 12:30:58.432461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:58.432897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:58.436652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 72/147] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:58.442642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:58.443391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:58.444295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:58.445247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:58.445983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:58.446719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:58.617510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:58.626049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:58.629337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:58.630592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-514af270-ead9-4b97-9fe5-2c059d30fa99 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.202997 Aug 06 12:30:58.644646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 76/148] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:30:58.754232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b240adbe-6ce6-4762-8e7d-2d669199a305 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:58.754827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b240adbe-6ce6-4762-8e7d-2d669199a305 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:58.761933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b240adbe-6ce6-4762-8e7d-2d669199a305 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:58.762409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b240adbe-6ce6-4762-8e7d-2d669199a305 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:58.762833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b240adbe-6ce6-4762-8e7d-2d669199a305 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:58.765361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b240adbe-6ce6-4762-8e7d-2d669199a305 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:58.766511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b240adbe-6ce6-4762-8e7d-2d669199a305 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:58.767099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b240adbe-6ce6-4762-8e7d-2d669199a305 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:58.970295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b240adbe-6ce6-4762-8e7d-2d669199a305 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:58.978804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b240adbe-6ce6-4762-8e7d-2d669199a305 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.228421 Aug 06 12:30:58.979627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 73/149] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:58 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:59.198288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9046c2b0-6981-4c10-967f-83be3a55f046 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:59.199428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9046c2b0-6981-4c10-967f-83be3a55f046 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:59.218097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9046c2b0-6981-4c10-967f-83be3a55f046 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:59.220291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9046c2b0-6981-4c10-967f-83be3a55f046 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:59.224759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9046c2b0-6981-4c10-967f-83be3a55f046 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:59.226648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9046c2b0-6981-4c10-967f-83be3a55f046 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:59.228985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9046c2b0-6981-4c10-967f-83be3a55f046 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:59.229661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9046c2b0-6981-4c10-967f-83be3a55f046 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:59.328542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-8dd7da17-7eb4-4dbf-9399-a22f2ace27c0 req-d7d36868-d0e1-46ea-8ee4-85596f7294b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe37e0-b98f-49eb-aef9-6e6279dae867", "name": "network-vif-plugged", "status": "completed", "tag": "d5229f58-fe7a-4bcb-b624-651ae519779d"}, {"server_uuid": "dc407ff3-fc1e-44bf-9c20-73203361a20f", "name": "network-vif-plugged", "status": "completed", "tag": "38e012d9-8547-43fd-8f63-fc6e18d35361"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:30:59.354475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8dd7da17-7eb4-4dbf-9399-a22f2ace27c0 req-d7d36868-d0e1-46ea-8ee4-85596f7294b5 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:59.355327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8dd7da17-7eb4-4dbf-9399-a22f2ace27c0 req-d7d36868-d0e1-46ea-8ee4-85596f7294b5 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:59.355951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8dd7da17-7eb4-4dbf-9399-a22f2ace27c0 req-d7d36868-d0e1-46ea-8ee4-85596f7294b5 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:59.379401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-8dd7da17-7eb4-4dbf-9399-a22f2ace27c0 req-d7d36868-d0e1-46ea-8ee4-85596f7294b5 service nova] Creating event network-vif-plugged:d5229f58-fe7a-4bcb-b624-651ae519779d for instance acfe37e0-b98f-49eb-aef9-6e6279dae867 on hv-cinder-85199 Aug 06 12:30:59.381196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-8dd7da17-7eb4-4dbf-9399-a22f2ace27c0 req-d7d36868-d0e1-46ea-8ee4-85596f7294b5 service nova] Creating event network-vif-plugged:38e012d9-8547-43fd-8f63-fc6e18d35361 for instance dc407ff3-fc1e-44bf-9c20-73203361a20f on hv-cinder-85199 Aug 06 12:30:59.397853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-8dd7da17-7eb4-4dbf-9399-a22f2ace27c0 req-d7d36868-d0e1-46ea-8ee4-85596f7294b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073424 Aug 06 12:30:59.400640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 74/150] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:30:59.452750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-12b17a1f-a3f0-4c89-9af4-ad6ad3b408bb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:59.453516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-12b17a1f-a3f0-4c89-9af4-ad6ad3b408bb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:59.460275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12b17a1f-a3f0-4c89-9af4-ad6ad3b408bb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:59.463238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12b17a1f-a3f0-4c89-9af4-ad6ad3b408bb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:59.463916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12b17a1f-a3f0-4c89-9af4-ad6ad3b408bb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:59.465059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12b17a1f-a3f0-4c89-9af4-ad6ad3b408bb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:59.465773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12b17a1f-a3f0-4c89-9af4-ad6ad3b408bb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:59.466474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12b17a1f-a3f0-4c89-9af4-ad6ad3b408bb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:59.483485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9046c2b0-6981-4c10-967f-83be3a55f046 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:59.504533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9046c2b0-6981-4c10-967f-83be3a55f046 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1314 microversion: 2.1 time: 0.312167 Aug 06 12:30:59.506552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 77/151] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:59 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:59.665850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:30:59.666399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:30:59.673832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:59.677587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-12b17a1f-a3f0-4c89-9af4-ad6ad3b408bb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:59.681847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:59.685449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:59.686187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:30:59.687757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-12b17a1f-a3f0-4c89-9af4-ad6ad3b408bb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.239056 Aug 06 12:30:59.688774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:30:59.690028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:30:59.690479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 75/152] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:30:59.889935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:59.914228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:59.917268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:30:59.919572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4657ffeb-0107-4e10-95fd-0ee4ca46179d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.264604 Aug 06 12:30:59.923096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 78/153] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:30:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:31:00.001854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-08aef208-ebd9-42f0-888d-d97948c75fc4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:00.003252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-08aef208-ebd9-42f0-888d-d97948c75fc4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:00.020510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08aef208-ebd9-42f0-888d-d97948c75fc4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:00.021342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08aef208-ebd9-42f0-888d-d97948c75fc4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:00.023842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08aef208-ebd9-42f0-888d-d97948c75fc4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:00.025557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08aef208-ebd9-42f0-888d-d97948c75fc4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:00.027741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08aef208-ebd9-42f0-888d-d97948c75fc4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:00.028589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08aef208-ebd9-42f0-888d-d97948c75fc4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:00.318039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-08aef208-ebd9-42f0-888d-d97948c75fc4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:00.328696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-08aef208-ebd9-42f0-888d-d97948c75fc4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.330891 Aug 06 12:31:00.330371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 76/154] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:30:59 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:00.533618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1842c9f4-462c-4eb5-95dd-c2b98ddbc404 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:00.535660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1842c9f4-462c-4eb5-95dd-c2b98ddbc404 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:00.547084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1842c9f4-462c-4eb5-95dd-c2b98ddbc404 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:00.547567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1842c9f4-462c-4eb5-95dd-c2b98ddbc404 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:00.547990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1842c9f4-462c-4eb5-95dd-c2b98ddbc404 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:00.554066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1842c9f4-462c-4eb5-95dd-c2b98ddbc404 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:00.554680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1842c9f4-462c-4eb5-95dd-c2b98ddbc404 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:00.555940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1842c9f4-462c-4eb5-95dd-c2b98ddbc404 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:00.716295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bac0304c-3809-45c9-a772-b6e6d3b664dd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:00.717262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bac0304c-3809-45c9-a772-b6e6d3b664dd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:00.730557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bac0304c-3809-45c9-a772-b6e6d3b664dd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:00.732752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bac0304c-3809-45c9-a772-b6e6d3b664dd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:00.732930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bac0304c-3809-45c9-a772-b6e6d3b664dd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:00.733672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bac0304c-3809-45c9-a772-b6e6d3b664dd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:00.736308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bac0304c-3809-45c9-a772-b6e6d3b664dd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:00.736866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bac0304c-3809-45c9-a772-b6e6d3b664dd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:00.961052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bac0304c-3809-45c9-a772-b6e6d3b664dd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:00.971014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bac0304c-3809-45c9-a772-b6e6d3b664dd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.265578 Aug 06 12:31:00.974008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 77/155] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:00 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:00.985496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:00.986377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:01.000277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:01.000899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:01.002044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:01.002913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:01.004842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:01.005356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:01.033451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1842c9f4-462c-4eb5-95dd-c2b98ddbc404 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:01.042208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1842c9f4-462c-4eb5-95dd-c2b98ddbc404 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1500 microversion: 2.1 time: 0.517458 Aug 06 12:31:01.042930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 79/156] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:00 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1500 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:01.293409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:01.313729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:01.320057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:01.323596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0da14b9c-095b-4bb3-b14c-f537f852a145 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.342309 Aug 06 12:31:01.325891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 78/157] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:31:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:31:01.354642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8140564a-bddb-4fbc-9e90-08b09c05413d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:01.357310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8140564a-bddb-4fbc-9e90-08b09c05413d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:01.383808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8140564a-bddb-4fbc-9e90-08b09c05413d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:01.387100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8140564a-bddb-4fbc-9e90-08b09c05413d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:01.387704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8140564a-bddb-4fbc-9e90-08b09c05413d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:01.390020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8140564a-bddb-4fbc-9e90-08b09c05413d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:01.393698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8140564a-bddb-4fbc-9e90-08b09c05413d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:01.394986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8140564a-bddb-4fbc-9e90-08b09c05413d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:01.430692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-061ed402-9c08-4e6d-88e3-37856d22faac req-bf2ed558-17fa-4fbf-bcf1-eee893348600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27", "name": "network-vif-plugged", "status": "completed", "tag": "3caedfaf-acd7-443b-a2c4-40f8c5e04f52"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:31:01.463604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-061ed402-9c08-4e6d-88e3-37856d22faac req-bf2ed558-17fa-4fbf-bcf1-eee893348600 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:01.465363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-061ed402-9c08-4e6d-88e3-37856d22faac req-bf2ed558-17fa-4fbf-bcf1-eee893348600 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:01.468511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-061ed402-9c08-4e6d-88e3-37856d22faac req-bf2ed558-17fa-4fbf-bcf1-eee893348600 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:01.525472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-061ed402-9c08-4e6d-88e3-37856d22faac req-bf2ed558-17fa-4fbf-bcf1-eee893348600 service nova] Creating event network-vif-plugged:3caedfaf-acd7-443b-a2c4-40f8c5e04f52 for instance b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 on hv-cinder-85199 Aug 06 12:31:01.531091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-061ed402-9c08-4e6d-88e3-37856d22faac req-bf2ed558-17fa-4fbf-bcf1-eee893348600 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104450 Aug 06 12:31:01.539366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 79/158] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:31:01.759585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8140564a-bddb-4fbc-9e90-08b09c05413d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:01.768735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8140564a-bddb-4fbc-9e90-08b09c05413d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.422329 Aug 06 12:31:01.782064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 80/159] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:01 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:01.994538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b406368b-f537-48b9-939c-22749a58ef19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:01.995218 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b406368b-f537-48b9-939c-22749a58ef19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:02.001855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b406368b-f537-48b9-939c-22749a58ef19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:02.006121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b406368b-f537-48b9-939c-22749a58ef19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:02.007725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b406368b-f537-48b9-939c-22749a58ef19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:02.008471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b406368b-f537-48b9-939c-22749a58ef19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:02.008924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b406368b-f537-48b9-939c-22749a58ef19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:02.009341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b406368b-f537-48b9-939c-22749a58ef19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:02.209670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b406368b-f537-48b9-939c-22749a58ef19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:02.217606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b406368b-f537-48b9-939c-22749a58ef19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.227832 Aug 06 12:31:02.218236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 80/160] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:01 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:02.351817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:02.352766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:02.361679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:02.362608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:02.363368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:02.364256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:02.365087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:02.365941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:02.572061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:02.581320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:02.586661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:02.589661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-21b6a812-dd0a-4612-b609-09c590fe5cf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.242444 Aug 06 12:31:02.591510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 81/161] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:31:02 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:31:02.640488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-09e24df0-01fe-43cd-be48-291cf0a201fc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e8cfc60-e8e3-495a-872e-11e95a55d9bb"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:31:02.644485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-09e24df0-01fe-43cd-be48-291cf0a201fc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:02.652619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09e24df0-01fe-43cd-be48-291cf0a201fc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:02.653312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09e24df0-01fe-43cd-be48-291cf0a201fc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:02.653951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09e24df0-01fe-43cd-be48-291cf0a201fc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:02.655221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09e24df0-01fe-43cd-be48-291cf0a201fc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:02.656807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09e24df0-01fe-43cd-be48-291cf0a201fc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:02.657447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09e24df0-01fe-43cd-be48-291cf0a201fc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:02.735414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:02.789708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8e77a739-0190-421e-a0bf-cd30da923e13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:02.790318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8e77a739-0190-421e-a0bf-cd30da923e13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:02.797501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e77a739-0190-421e-a0bf-cd30da923e13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:02.797983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e77a739-0190-421e-a0bf-cd30da923e13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:02.801669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e77a739-0190-421e-a0bf-cd30da923e13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:02.803426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e77a739-0190-421e-a0bf-cd30da923e13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:02.804173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e77a739-0190-421e-a0bf-cd30da923e13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:02.804885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e77a739-0190-421e-a0bf-cd30da923e13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:03.061154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8e77a739-0190-421e-a0bf-cd30da923e13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:03.071437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8e77a739-0190-421e-a0bf-cd30da923e13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.285732 Aug 06 12:31:03.072340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 82/162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:02 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:03.239963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-22361edb-073d-4d63-ae1e-b30f2422e044 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:03.240933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-22361edb-073d-4d63-ae1e-b30f2422e044 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:03.250605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22361edb-073d-4d63-ae1e-b30f2422e044 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:03.255674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22361edb-073d-4d63-ae1e-b30f2422e044 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:03.256423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22361edb-073d-4d63-ae1e-b30f2422e044 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:03.257234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22361edb-073d-4d63-ae1e-b30f2422e044 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:03.257797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22361edb-073d-4d63-ae1e-b30f2422e044 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:03.259122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22361edb-073d-4d63-ae1e-b30f2422e044 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:03.431052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-22361edb-073d-4d63-ae1e-b30f2422e044 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:03.447365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-22361edb-073d-4d63-ae1e-b30f2422e044 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1365 microversion: 2.1 time: 0.211768 Aug 06 12:31:03.448621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 83/163] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:03 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:03.619167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:03.619949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:03.626954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:03.627647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:03.628218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:03.629414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:03.630216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:03.630767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:03.791061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:03.799584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:03.802163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:03.803656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7a5c6348-5750-4410-821f-fb8e1d40e785 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1407 microversion: 2.20 time: 0.190419 Aug 06 12:31:03.804831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 84/164] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:31:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:31:04.092442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a30296e1-9df2-4469-90e2-453a3ead3361 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:04.093383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a30296e1-9df2-4469-90e2-453a3ead3361 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:04.104732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30296e1-9df2-4469-90e2-453a3ead3361 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:04.105592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30296e1-9df2-4469-90e2-453a3ead3361 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:04.106401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30296e1-9df2-4469-90e2-453a3ead3361 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:04.107422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30296e1-9df2-4469-90e2-453a3ead3361 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:04.108019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30296e1-9df2-4469-90e2-453a3ead3361 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:04.108624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30296e1-9df2-4469-90e2-453a3ead3361 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:04.311070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a30296e1-9df2-4469-90e2-453a3ead3361 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:04.320645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a30296e1-9df2-4469-90e2-453a3ead3361 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.231895 Aug 06 12:31:04.322153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 85/165] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:04 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:04.468331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9a8f45b8-f191-45a9-b753-6d7aa8d93d28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:04.468934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9a8f45b8-f191-45a9-b753-6d7aa8d93d28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:04.475257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f45b8-f191-45a9-b753-6d7aa8d93d28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:04.475742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f45b8-f191-45a9-b753-6d7aa8d93d28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:04.476169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f45b8-f191-45a9-b753-6d7aa8d93d28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:04.477047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f45b8-f191-45a9-b753-6d7aa8d93d28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:04.477494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f45b8-f191-45a9-b753-6d7aa8d93d28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:04.478107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f45b8-f191-45a9-b753-6d7aa8d93d28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:04.640492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9a8f45b8-f191-45a9-b753-6d7aa8d93d28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:04.649070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9a8f45b8-f191-45a9-b753-6d7aa8d93d28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1554 microversion: 2.1 time: 0.184306 Aug 06 12:31:04.649635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 86/166] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:04.669822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8594c00a-6cd2-4d95-ab66-f6dd851ac7da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:04.670332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8594c00a-6cd2-4d95-ab66-f6dd851ac7da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:04.676111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8594c00a-6cd2-4d95-ab66-f6dd851ac7da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:04.676618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8594c00a-6cd2-4d95-ab66-f6dd851ac7da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:04.677045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8594c00a-6cd2-4d95-ab66-f6dd851ac7da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:04.677733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8594c00a-6cd2-4d95-ab66-f6dd851ac7da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:04.678187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8594c00a-6cd2-4d95-ab66-f6dd851ac7da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:04.678589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8594c00a-6cd2-4d95-ab66-f6dd851ac7da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:04.811006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8594c00a-6cd2-4d95-ab66-f6dd851ac7da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144858 Aug 06 12:31:04.812183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 87/167] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Aug 6 12:31:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:31:04.826909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:04.827522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:04.839905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:04.840423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:04.840867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:04.841568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:04.842021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:04.842443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:05.313187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:05.340241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:05.341773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:05.342891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-61d19ead-b3d4-41d5-9aa1-1cf12fe4218c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1599 microversion: 2.20 time: 0.519937 Aug 06 12:31:05.366499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 88/168] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:31:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1599 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:31:05.371418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a3abb42c-c0a8-4348-8425-7c212ff75b40 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:05.372036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a3abb42c-c0a8-4348-8425-7c212ff75b40 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:05.383036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3abb42c-c0a8-4348-8425-7c212ff75b40 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:05.390730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3abb42c-c0a8-4348-8425-7c212ff75b40 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:05.395985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3abb42c-c0a8-4348-8425-7c212ff75b40 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:05.398286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3abb42c-c0a8-4348-8425-7c212ff75b40 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:05.399211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3abb42c-c0a8-4348-8425-7c212ff75b40 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:05.400456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3abb42c-c0a8-4348-8425-7c212ff75b40 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:05.858289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a3abb42c-c0a8-4348-8425-7c212ff75b40 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:05.870505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a3abb42c-c0a8-4348-8425-7c212ff75b40 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1321 microversion: 2.1 time: 0.502836 Aug 06 12:31:05.871543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 89/169] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:05 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:05.886330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5189163e-2880-4b61-aec0-bd48e9b50cab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:05.887062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5189163e-2880-4b61-aec0-bd48e9b50cab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:05.898982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5189163e-2880-4b61-aec0-bd48e9b50cab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:05.900391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5189163e-2880-4b61-aec0-bd48e9b50cab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:05.901067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5189163e-2880-4b61-aec0-bd48e9b50cab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:05.902386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5189163e-2880-4b61-aec0-bd48e9b50cab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:05.903063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5189163e-2880-4b61-aec0-bd48e9b50cab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:05.903727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5189163e-2880-4b61-aec0-bd48e9b50cab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:05.922274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:06.169770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5189163e-2880-4b61-aec0-bd48e9b50cab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.296869 Aug 06 12:31:06.170362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 90/170] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Aug 6 12:31:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-interface => generated 284 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:31:06.424788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-09e24df0-01fe-43cd-be48-291cf0a201fc tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "POST /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.788830 Aug 06 12:31:06.430760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 81/171] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 12:31:02 2022] POST /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f/os-volume_attachments => generated 194 bytes in 3795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:31:06.895601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b6adba5e-0848-46c6-8c8a-282ea8d9df3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:06.896224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b6adba5e-0848-46c6-8c8a-282ea8d9df3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:06.906958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6adba5e-0848-46c6-8c8a-282ea8d9df3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:06.907455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6adba5e-0848-46c6-8c8a-282ea8d9df3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:06.907892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6adba5e-0848-46c6-8c8a-282ea8d9df3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:06.908682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6adba5e-0848-46c6-8c8a-282ea8d9df3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:06.909256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6adba5e-0848-46c6-8c8a-282ea8d9df3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:06.909867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6adba5e-0848-46c6-8c8a-282ea8d9df3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:07.373101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b6adba5e-0848-46c6-8c8a-282ea8d9df3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:07.381898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b6adba5e-0848-46c6-8c8a-282ea8d9df3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1516 microversion: 2.1 time: 0.492697 Aug 06 12:31:07.384874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 91/172] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:06 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1516 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:07.409312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f8e08f34-1210-48ad-bd6a-cc94fd69ff3f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:31:07.412169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f8e08f34-1210-48ad-bd6a-cc94fd69ff3f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:07.428273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e08f34-1210-48ad-bd6a-cc94fd69ff3f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:07.428952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e08f34-1210-48ad-bd6a-cc94fd69ff3f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:07.429213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e08f34-1210-48ad-bd6a-cc94fd69ff3f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:07.437727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e08f34-1210-48ad-bd6a-cc94fd69ff3f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:07.438613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e08f34-1210-48ad-bd6a-cc94fd69ff3f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:07.439203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e08f34-1210-48ad-bd6a-cc94fd69ff3f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:07.477628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-f8e08f34-1210-48ad-bd6a-cc94fd69ff3f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'flavor' on Instance uuid b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:31:07.645494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f8e08f34-1210-48ad-bd6a-cc94fd69ff3f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27/action" status: 200 len: 32 microversion: 2.1 time: 0.241725 Aug 06 12:31:07.646637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 82/173] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 12:31:07 2022] POST /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27/action => generated 32 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 12:31:07.676316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8c2ff046-8b0f-48b7-89f9-bb5ece2d356e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:07.677796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8c2ff046-8b0f-48b7-89f9-bb5ece2d356e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:07.685122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c2ff046-8b0f-48b7-89f9-bb5ece2d356e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:07.686006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c2ff046-8b0f-48b7-89f9-bb5ece2d356e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:07.686845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c2ff046-8b0f-48b7-89f9-bb5ece2d356e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:07.687936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c2ff046-8b0f-48b7-89f9-bb5ece2d356e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:07.688710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c2ff046-8b0f-48b7-89f9-bb5ece2d356e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:07.689350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c2ff046-8b0f-48b7-89f9-bb5ece2d356e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:07.802197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-addd9401-17ab-42c6-9733-3c8239744085 req-f07496df-e5f1-4e3c-8118-93da770ad429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfe37e0-b98f-49eb-aef9-6e6279dae867", "tag": "d5229f58-fe7a-4bcb-b624-651ae519779d"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:31:07.832791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-addd9401-17ab-42c6-9733-3c8239744085 req-f07496df-e5f1-4e3c-8118-93da770ad429 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:07.833275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-addd9401-17ab-42c6-9733-3c8239744085 req-f07496df-e5f1-4e3c-8118-93da770ad429 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:07.833697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-addd9401-17ab-42c6-9733-3c8239744085 req-f07496df-e5f1-4e3c-8118-93da770ad429 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:07.884622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-addd9401-17ab-42c6-9733-3c8239744085 req-f07496df-e5f1-4e3c-8118-93da770ad429 service nova] Creating event network-changed:d5229f58-fe7a-4bcb-b624-651ae519779d for instance acfe37e0-b98f-49eb-aef9-6e6279dae867 on hv-cinder-85199 Aug 06 12:31:07.895126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-addd9401-17ab-42c6-9733-3c8239744085 req-f07496df-e5f1-4e3c-8118-93da770ad429 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094508 Aug 06 12:31:07.898152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 83/174] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:31:07.981512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8c2ff046-8b0f-48b7-89f9-bb5ece2d356e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:08.005698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8c2ff046-8b0f-48b7-89f9-bb5ece2d356e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.345683 Aug 06 12:31:08.006713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 92/175] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:07 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:09.029135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-55c7ac6b-1f60-4e91-9dbe-cd00aa0b601f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:09.032455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-55c7ac6b-1f60-4e91-9dbe-cd00aa0b601f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:09.043769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55c7ac6b-1f60-4e91-9dbe-cd00aa0b601f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:09.045030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55c7ac6b-1f60-4e91-9dbe-cd00aa0b601f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:09.045644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55c7ac6b-1f60-4e91-9dbe-cd00aa0b601f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:09.046506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55c7ac6b-1f60-4e91-9dbe-cd00aa0b601f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:09.047158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55c7ac6b-1f60-4e91-9dbe-cd00aa0b601f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:09.047744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55c7ac6b-1f60-4e91-9dbe-cd00aa0b601f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:09.281458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-55c7ac6b-1f60-4e91-9dbe-cd00aa0b601f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:09.293107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-55c7ac6b-1f60-4e91-9dbe-cd00aa0b601f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.269951 Aug 06 12:31:09.294415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 84/176] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:09 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:09.999291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-2ccf1147-7a99-48ae-bf47-09ba47028980 req-8e91171e-3123-4087-bc4f-157278a9e9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc407ff3-fc1e-44bf-9c20-73203361a20f", "tag": "38e012d9-8547-43fd-8f63-fc6e18d35361"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:31:10.019360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-2ccf1147-7a99-48ae-bf47-09ba47028980 req-8e91171e-3123-4087-bc4f-157278a9e9ca service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:10.022053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-2ccf1147-7a99-48ae-bf47-09ba47028980 req-8e91171e-3123-4087-bc4f-157278a9e9ca service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:10.023309 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-2ccf1147-7a99-48ae-bf47-09ba47028980 req-8e91171e-3123-4087-bc4f-157278a9e9ca service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:10.048830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-2ccf1147-7a99-48ae-bf47-09ba47028980 req-8e91171e-3123-4087-bc4f-157278a9e9ca service nova] Creating event network-changed:38e012d9-8547-43fd-8f63-fc6e18d35361 for instance dc407ff3-fc1e-44bf-9c20-73203361a20f on hv-cinder-85199 Aug 06 12:31:10.058177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-2ccf1147-7a99-48ae-bf47-09ba47028980 req-8e91171e-3123-4087-bc4f-157278a9e9ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062862 Aug 06 12:31:10.059011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 93/177] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:31:10.317034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-833915d6-6720-44d8-bb3b-8a8e81e4d6b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:10.317724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-833915d6-6720-44d8-bb3b-8a8e81e4d6b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:10.326588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-833915d6-6720-44d8-bb3b-8a8e81e4d6b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:10.327071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-833915d6-6720-44d8-bb3b-8a8e81e4d6b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:10.327506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-833915d6-6720-44d8-bb3b-8a8e81e4d6b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:10.328213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-833915d6-6720-44d8-bb3b-8a8e81e4d6b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:10.332679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-833915d6-6720-44d8-bb3b-8a8e81e4d6b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:10.333513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-833915d6-6720-44d8-bb3b-8a8e81e4d6b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:10.494008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-833915d6-6720-44d8-bb3b-8a8e81e4d6b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:10.501985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-833915d6-6720-44d8-bb3b-8a8e81e4d6b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.189620 Aug 06 12:31:10.506039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 85/178] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:10 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:11.531924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b49de74e-2838-4fbf-abd4-4968cde6e5b2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:11.534107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b49de74e-2838-4fbf-abd4-4968cde6e5b2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:11.544804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49de74e-2838-4fbf-abd4-4968cde6e5b2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:11.545396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49de74e-2838-4fbf-abd4-4968cde6e5b2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:11.545905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49de74e-2838-4fbf-abd4-4968cde6e5b2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:11.547146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49de74e-2838-4fbf-abd4-4968cde6e5b2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:11.547698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49de74e-2838-4fbf-abd4-4968cde6e5b2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:11.548344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49de74e-2838-4fbf-abd4-4968cde6e5b2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:11.757430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b49de74e-2838-4fbf-abd4-4968cde6e5b2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:11.765371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b49de74e-2838-4fbf-abd4-4968cde6e5b2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.242888 Aug 06 12:31:11.765949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 94/179] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:11 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:12.788122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fdebc571-0418-41ea-aec4-6ea75efcc322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:12.789128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fdebc571-0418-41ea-aec4-6ea75efcc322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:12.807792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fdebc571-0418-41ea-aec4-6ea75efcc322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:12.808507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fdebc571-0418-41ea-aec4-6ea75efcc322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:12.808951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fdebc571-0418-41ea-aec4-6ea75efcc322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:12.809879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fdebc571-0418-41ea-aec4-6ea75efcc322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:12.814854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fdebc571-0418-41ea-aec4-6ea75efcc322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:12.815579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fdebc571-0418-41ea-aec4-6ea75efcc322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:13.291304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fdebc571-0418-41ea-aec4-6ea75efcc322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:13.305175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fdebc571-0418-41ea-aec4-6ea75efcc322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.522377 Aug 06 12:31:13.305763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 86/180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:12 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:14.329926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ba92b831-cf83-43bd-bf50-2395f526d1be tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:14.329926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ba92b831-cf83-43bd-bf50-2395f526d1be tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:14.332397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=83 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:14.336497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba92b831-cf83-43bd-bf50-2395f526d1be tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:14.337055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba92b831-cf83-43bd-bf50-2395f526d1be tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:14.337554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba92b831-cf83-43bd-bf50-2395f526d1be tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:14.338402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba92b831-cf83-43bd-bf50-2395f526d1be tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:14.338893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba92b831-cf83-43bd-bf50-2395f526d1be tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:14.339381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba92b831-cf83-43bd-bf50-2395f526d1be tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:14.492058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ba92b831-cf83-43bd-bf50-2395f526d1be tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:14.503207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ba92b831-cf83-43bd-bf50-2395f526d1be tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.178527 Aug 06 12:31:14.503971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 95/181] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:14 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:15.525483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5395cf4e-c5b7-4010-8223-fc912f207fb7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:15.526462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5395cf4e-c5b7-4010-8223-fc912f207fb7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:15.534047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5395cf4e-c5b7-4010-8223-fc912f207fb7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:15.534047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5395cf4e-c5b7-4010-8223-fc912f207fb7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:15.534047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5395cf4e-c5b7-4010-8223-fc912f207fb7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:15.535388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5395cf4e-c5b7-4010-8223-fc912f207fb7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:15.536407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5395cf4e-c5b7-4010-8223-fc912f207fb7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:15.536915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5395cf4e-c5b7-4010-8223-fc912f207fb7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:15.683658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5395cf4e-c5b7-4010-8223-fc912f207fb7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:15.691834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5395cf4e-c5b7-4010-8223-fc912f207fb7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.170804 Aug 06 12:31:15.692499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 87/182] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:15 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:16.713196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-84e19f7a-1edf-446c-9e48-5bfc30dae42a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:16.713828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-84e19f7a-1edf-446c-9e48-5bfc30dae42a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:16.719650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84e19f7a-1edf-446c-9e48-5bfc30dae42a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:16.720126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84e19f7a-1edf-446c-9e48-5bfc30dae42a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:16.720585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84e19f7a-1edf-446c-9e48-5bfc30dae42a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:16.721268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84e19f7a-1edf-446c-9e48-5bfc30dae42a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:16.721718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84e19f7a-1edf-446c-9e48-5bfc30dae42a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:16.722134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84e19f7a-1edf-446c-9e48-5bfc30dae42a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:16.849831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-84e19f7a-1edf-446c-9e48-5bfc30dae42a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:16.857419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-84e19f7a-1edf-446c-9e48-5bfc30dae42a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.148374 Aug 06 12:31:16.857978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 96/183] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:16 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:17.878331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-872940e7-380e-4c91-af58-89e730274d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:17.878934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-872940e7-380e-4c91-af58-89e730274d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:17.881452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=72 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:17.886751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-872940e7-380e-4c91-af58-89e730274d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:17.887235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-872940e7-380e-4c91-af58-89e730274d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:17.887664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-872940e7-380e-4c91-af58-89e730274d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:17.888379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-872940e7-380e-4c91-af58-89e730274d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:17.888833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-872940e7-380e-4c91-af58-89e730274d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:17.889262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-872940e7-380e-4c91-af58-89e730274d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:18.015948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-872940e7-380e-4c91-af58-89e730274d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:18.023811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-872940e7-380e-4c91-af58-89e730274d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.149307 Aug 06 12:31:18.024461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 88/184] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:17 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:19.050267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6fcf0660-d12b-43b8-a10c-131e054dc1b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:19.050267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6fcf0660-d12b-43b8-a10c-131e054dc1b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:19.052063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6fcf0660-d12b-43b8-a10c-131e054dc1b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:19.052704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6fcf0660-d12b-43b8-a10c-131e054dc1b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:19.053119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6fcf0660-d12b-43b8-a10c-131e054dc1b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:19.053790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6fcf0660-d12b-43b8-a10c-131e054dc1b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:19.054229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6fcf0660-d12b-43b8-a10c-131e054dc1b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:19.054639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6fcf0660-d12b-43b8-a10c-131e054dc1b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:19.186119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6fcf0660-d12b-43b8-a10c-131e054dc1b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:19.193645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6fcf0660-d12b-43b8-a10c-131e054dc1b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.152481 Aug 06 12:31:19.194214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 97/185] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:19 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:20.214124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6b9941ef-6e18-43a5-b2e4-a12d4edc69de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:20.214653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6b9941ef-6e18-43a5-b2e4-a12d4edc69de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:20.220929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b9941ef-6e18-43a5-b2e4-a12d4edc69de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:20.221995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b9941ef-6e18-43a5-b2e4-a12d4edc69de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:20.222420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b9941ef-6e18-43a5-b2e4-a12d4edc69de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:20.223092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b9941ef-6e18-43a5-b2e4-a12d4edc69de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:20.223541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b9941ef-6e18-43a5-b2e4-a12d4edc69de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:20.223955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b9941ef-6e18-43a5-b2e4-a12d4edc69de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:20.356488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6b9941ef-6e18-43a5-b2e4-a12d4edc69de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:20.364488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6b9941ef-6e18-43a5-b2e4-a12d4edc69de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.154138 Aug 06 12:31:20.365059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 89/186] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:20 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:21.385661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6ddb922e-b012-4852-8590-75a1a7e94d77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:21.386253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6ddb922e-b012-4852-8590-75a1a7e94d77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:21.392103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ddb922e-b012-4852-8590-75a1a7e94d77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:21.392605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ddb922e-b012-4852-8590-75a1a7e94d77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:21.393671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ddb922e-b012-4852-8590-75a1a7e94d77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:21.394343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ddb922e-b012-4852-8590-75a1a7e94d77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:21.394786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ddb922e-b012-4852-8590-75a1a7e94d77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:21.395197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ddb922e-b012-4852-8590-75a1a7e94d77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:21.517141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6ddb922e-b012-4852-8590-75a1a7e94d77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:21.525055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6ddb922e-b012-4852-8590-75a1a7e94d77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.143207 Aug 06 12:31:21.525615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 98/187] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:21 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:22.545214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8d6c55b1-4dc6-4da1-bb13-597a45d4952c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:22.545848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8d6c55b1-4dc6-4da1-bb13-597a45d4952c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:22.552281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d6c55b1-4dc6-4da1-bb13-597a45d4952c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:22.552783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d6c55b1-4dc6-4da1-bb13-597a45d4952c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:22.553216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d6c55b1-4dc6-4da1-bb13-597a45d4952c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:22.553897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d6c55b1-4dc6-4da1-bb13-597a45d4952c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:22.554350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d6c55b1-4dc6-4da1-bb13-597a45d4952c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:22.554767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d6c55b1-4dc6-4da1-bb13-597a45d4952c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:22.679032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8d6c55b1-4dc6-4da1-bb13-597a45d4952c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:22.686370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8d6c55b1-4dc6-4da1-bb13-597a45d4952c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.144979 Aug 06 12:31:22.686944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 90/188] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:22 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:23.707436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-894c06bb-e4f4-4ee7-a8b3-2f5866de5789 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:23.708148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-894c06bb-e4f4-4ee7-a8b3-2f5866de5789 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:23.714392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-894c06bb-e4f4-4ee7-a8b3-2f5866de5789 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:23.714871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-894c06bb-e4f4-4ee7-a8b3-2f5866de5789 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:23.715300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-894c06bb-e4f4-4ee7-a8b3-2f5866de5789 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:23.715977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-894c06bb-e4f4-4ee7-a8b3-2f5866de5789 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:23.716463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-894c06bb-e4f4-4ee7-a8b3-2f5866de5789 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:23.716883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-894c06bb-e4f4-4ee7-a8b3-2f5866de5789 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:23.848466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-894c06bb-e4f4-4ee7-a8b3-2f5866de5789 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:23.855772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-894c06bb-e4f4-4ee7-a8b3-2f5866de5789 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.152692 Aug 06 12:31:23.856345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 99/189] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:23 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:24.876882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bbe39052-359f-406b-a8a1-759465faccfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:24.877483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bbe39052-359f-406b-a8a1-759465faccfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:24.883855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbe39052-359f-406b-a8a1-759465faccfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:24.884354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbe39052-359f-406b-a8a1-759465faccfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:24.884785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbe39052-359f-406b-a8a1-759465faccfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:24.885463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbe39052-359f-406b-a8a1-759465faccfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:24.885906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbe39052-359f-406b-a8a1-759465faccfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:24.886321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbe39052-359f-406b-a8a1-759465faccfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:25.029824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bbe39052-359f-406b-a8a1-759465faccfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:25.037284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bbe39052-359f-406b-a8a1-759465faccfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.164204 Aug 06 12:31:25.037839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 91/190] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:24 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:26.059086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ec221a20-1bcb-4f98-af3c-535e72ea8495 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:26.060143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ec221a20-1bcb-4f98-af3c-535e72ea8495 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:26.066169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec221a20-1bcb-4f98-af3c-535e72ea8495 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:26.066837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec221a20-1bcb-4f98-af3c-535e72ea8495 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:26.067271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec221a20-1bcb-4f98-af3c-535e72ea8495 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:26.067953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec221a20-1bcb-4f98-af3c-535e72ea8495 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:26.068425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec221a20-1bcb-4f98-af3c-535e72ea8495 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:26.068845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec221a20-1bcb-4f98-af3c-535e72ea8495 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:26.208519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ec221a20-1bcb-4f98-af3c-535e72ea8495 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:26.216273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ec221a20-1bcb-4f98-af3c-535e72ea8495 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.162099 Aug 06 12:31:26.216877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 100/191] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:26 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:27.203129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50f88390-81a5-4b2e-b2d4-465348bf81be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:27.203622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50f88390-81a5-4b2e-b2d4-465348bf81be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:27.211743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f88390-81a5-4b2e-b2d4-465348bf81be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:27.212274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f88390-81a5-4b2e-b2d4-465348bf81be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:27.213192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f88390-81a5-4b2e-b2d4-465348bf81be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:27.214099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f88390-81a5-4b2e-b2d4-465348bf81be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:27.214742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f88390-81a5-4b2e-b2d4-465348bf81be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:27.215234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f88390-81a5-4b2e-b2d4-465348bf81be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:27.239846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3db557a9-0106-4531-bff4-44484c24e001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:27.241845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3db557a9-0106-4531-bff4-44484c24e001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:27.243551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50f88390-81a5-4b2e-b2d4-465348bf81be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 12:31:27.249040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3db557a9-0106-4531-bff4-44484c24e001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:27.249656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3db557a9-0106-4531-bff4-44484c24e001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:27.250091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3db557a9-0106-4531-bff4-44484c24e001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:27.250855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3db557a9-0106-4531-bff4-44484c24e001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:27.251374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3db557a9-0106-4531-bff4-44484c24e001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:27.251893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3db557a9-0106-4531-bff4-44484c24e001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:27.337971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-50f88390-81a5-4b2e-b2d4-465348bf81be tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 204 len: 0 microversion: 2.1 time: 0.138264 Aug 06 12:31:27.342093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 92/192] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:31:27 2022] DELETE /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 12:31:27.348160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ac1bad33-2b5f-4574-b2e8-5e0cdb3570d7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:27.349139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ac1bad33-2b5f-4574-b2e8-5e0cdb3570d7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:27.355551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac1bad33-2b5f-4574-b2e8-5e0cdb3570d7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:27.356031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac1bad33-2b5f-4574-b2e8-5e0cdb3570d7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:27.356767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac1bad33-2b5f-4574-b2e8-5e0cdb3570d7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:27.357162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac1bad33-2b5f-4574-b2e8-5e0cdb3570d7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:27.357659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac1bad33-2b5f-4574-b2e8-5e0cdb3570d7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:27.358096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac1bad33-2b5f-4574-b2e8-5e0cdb3570d7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:27.394388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3db557a9-0106-4531-bff4-44484c24e001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:27.402096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3db557a9-0106-4531-bff4-44484c24e001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.167968 Aug 06 12:31:27.414898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 101/193] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:27 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:27.519328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ac1bad33-2b5f-4574-b2e8-5e0cdb3570d7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:27.523075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:27.528859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ac1bad33-2b5f-4574-b2e8-5e0cdb3570d7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.185386 Aug 06 12:31:27.529433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 93/194] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:27 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:28.422621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-78011b37-e2d6-4404-a9b8-13fc769791c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:28.423258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-78011b37-e2d6-4404-a9b8-13fc769791c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:28.429603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78011b37-e2d6-4404-a9b8-13fc769791c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:28.430088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78011b37-e2d6-4404-a9b8-13fc769791c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:28.430520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78011b37-e2d6-4404-a9b8-13fc769791c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:28.431210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78011b37-e2d6-4404-a9b8-13fc769791c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:28.431658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78011b37-e2d6-4404-a9b8-13fc769791c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:28.432075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78011b37-e2d6-4404-a9b8-13fc769791c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:28.551148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-638e6f3b-14bc-4817-8287-bdb9cf59b905 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:28.551838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-638e6f3b-14bc-4817-8287-bdb9cf59b905 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:28.559973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-638e6f3b-14bc-4817-8287-bdb9cf59b905 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:28.560574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-638e6f3b-14bc-4817-8287-bdb9cf59b905 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:28.561181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-638e6f3b-14bc-4817-8287-bdb9cf59b905 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:28.564252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-78011b37-e2d6-4404-a9b8-13fc769791c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:28.568906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-638e6f3b-14bc-4817-8287-bdb9cf59b905 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:28.569377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-638e6f3b-14bc-4817-8287-bdb9cf59b905 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:28.569805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-638e6f3b-14bc-4817-8287-bdb9cf59b905 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:28.579143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-78011b37-e2d6-4404-a9b8-13fc769791c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.160678 Aug 06 12:31:28.592882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 102/195] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:28 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:28.720008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-638e6f3b-14bc-4817-8287-bdb9cf59b905 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:28.728101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-638e6f3b-14bc-4817-8287-bdb9cf59b905 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.181722 Aug 06 12:31:28.728697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 94/196] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:28 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:29.599489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b9182574-a2d3-4ee1-b015-ab45b7a8edf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:29.600061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b9182574-a2d3-4ee1-b015-ab45b7a8edf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:29.605892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9182574-a2d3-4ee1-b015-ab45b7a8edf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:29.606359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9182574-a2d3-4ee1-b015-ab45b7a8edf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:29.606781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9182574-a2d3-4ee1-b015-ab45b7a8edf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:29.607477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9182574-a2d3-4ee1-b015-ab45b7a8edf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:29.607914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9182574-a2d3-4ee1-b015-ab45b7a8edf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:29.608349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9182574-a2d3-4ee1-b015-ab45b7a8edf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:29.740758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b9182574-a2d3-4ee1-b015-ab45b7a8edf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:29.748434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b9182574-a2d3-4ee1-b015-ab45b7a8edf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.153265 Aug 06 12:31:29.749154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 103/197] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:29 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:29.749264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e0468135-4165-45ec-8604-11d3549d8979 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:29.749846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e0468135-4165-45ec-8604-11d3549d8979 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:29.756188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0468135-4165-45ec-8604-11d3549d8979 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:29.756703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0468135-4165-45ec-8604-11d3549d8979 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:29.757137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0468135-4165-45ec-8604-11d3549d8979 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:29.757823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0468135-4165-45ec-8604-11d3549d8979 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:29.758274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0468135-4165-45ec-8604-11d3549d8979 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:29.758693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0468135-4165-45ec-8604-11d3549d8979 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:29.893963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e0468135-4165-45ec-8604-11d3549d8979 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:29.901844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e0468135-4165-45ec-8604-11d3549d8979 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.156505 Aug 06 12:31:29.902401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 95/198] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:29 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:30.769130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4eefd047-da8f-4858-80bc-7cff87caa3ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:30.769729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4eefd047-da8f-4858-80bc-7cff87caa3ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:30.775509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4eefd047-da8f-4858-80bc-7cff87caa3ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:30.775973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4eefd047-da8f-4858-80bc-7cff87caa3ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:30.776423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4eefd047-da8f-4858-80bc-7cff87caa3ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:30.777090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4eefd047-da8f-4858-80bc-7cff87caa3ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:30.777529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4eefd047-da8f-4858-80bc-7cff87caa3ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:30.777939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4eefd047-da8f-4858-80bc-7cff87caa3ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:30.911612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4eefd047-da8f-4858-80bc-7cff87caa3ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:30.919003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4eefd047-da8f-4858-80bc-7cff87caa3ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.154160 Aug 06 12:31:30.919805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 104/199] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:30 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:30.924615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-da062015-a0c0-4254-8add-b890eb96a563 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:30.925260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-da062015-a0c0-4254-8add-b890eb96a563 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:30.931883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da062015-a0c0-4254-8add-b890eb96a563 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:30.932435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da062015-a0c0-4254-8add-b890eb96a563 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:30.932874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da062015-a0c0-4254-8add-b890eb96a563 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:30.933607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da062015-a0c0-4254-8add-b890eb96a563 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:30.934102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da062015-a0c0-4254-8add-b890eb96a563 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:30.934554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da062015-a0c0-4254-8add-b890eb96a563 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:31.066997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-da062015-a0c0-4254-8add-b890eb96a563 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:31.075096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-da062015-a0c0-4254-8add-b890eb96a563 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.154512 Aug 06 12:31:31.075657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 96/200] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:30 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:31.938885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-80472eca-85f9-439d-84e7-cfdc73fd7047 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:31.940013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-80472eca-85f9-439d-84e7-cfdc73fd7047 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:31.946038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80472eca-85f9-439d-84e7-cfdc73fd7047 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:31.946525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80472eca-85f9-439d-84e7-cfdc73fd7047 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:31.946954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80472eca-85f9-439d-84e7-cfdc73fd7047 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:31.947638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80472eca-85f9-439d-84e7-cfdc73fd7047 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:31.948080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80472eca-85f9-439d-84e7-cfdc73fd7047 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:31.948522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80472eca-85f9-439d-84e7-cfdc73fd7047 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:32.073185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-80472eca-85f9-439d-84e7-cfdc73fd7047 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:32.080573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-80472eca-85f9-439d-84e7-cfdc73fd7047 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.145473 Aug 06 12:31:32.081136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 105/201] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:31 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:32.094896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6985450d-e2f8-4050-8002-2447386613ec tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:32.095504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6985450d-e2f8-4050-8002-2447386613ec tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:32.101823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6985450d-e2f8-4050-8002-2447386613ec tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:32.102302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6985450d-e2f8-4050-8002-2447386613ec tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:32.102737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6985450d-e2f8-4050-8002-2447386613ec tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:32.103419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6985450d-e2f8-4050-8002-2447386613ec tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:32.103871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6985450d-e2f8-4050-8002-2447386613ec tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:32.104289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6985450d-e2f8-4050-8002-2447386613ec tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:32.229147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6985450d-e2f8-4050-8002-2447386613ec tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:32.237756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6985450d-e2f8-4050-8002-2447386613ec tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.146573 Aug 06 12:31:32.238331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 97/202] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:32 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:33.100878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9603da20-5117-431d-afdc-cf93ff3881cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:33.101429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9603da20-5117-431d-afdc-cf93ff3881cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:33.107237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9603da20-5117-431d-afdc-cf93ff3881cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:33.107714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9603da20-5117-431d-afdc-cf93ff3881cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:33.108142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9603da20-5117-431d-afdc-cf93ff3881cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:33.108855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9603da20-5117-431d-afdc-cf93ff3881cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:33.109305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9603da20-5117-431d-afdc-cf93ff3881cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:33.109720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9603da20-5117-431d-afdc-cf93ff3881cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:33.243366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9603da20-5117-431d-afdc-cf93ff3881cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:33.250945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9603da20-5117-431d-afdc-cf93ff3881cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.153903 Aug 06 12:31:33.251534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 106/203] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:33 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:33.259031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5ce53ff-f797-464f-b1d4-a602bc8a5bd1 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:33.260388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5ce53ff-f797-464f-b1d4-a602bc8a5bd1 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:33.267075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ce53ff-f797-464f-b1d4-a602bc8a5bd1 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:33.267576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ce53ff-f797-464f-b1d4-a602bc8a5bd1 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:33.268007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ce53ff-f797-464f-b1d4-a602bc8a5bd1 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:33.268939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ce53ff-f797-464f-b1d4-a602bc8a5bd1 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:33.269394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ce53ff-f797-464f-b1d4-a602bc8a5bd1 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:33.269904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ce53ff-f797-464f-b1d4-a602bc8a5bd1 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:33.416822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5ce53ff-f797-464f-b1d4-a602bc8a5bd1 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:33.425108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5ce53ff-f797-464f-b1d4-a602bc8a5bd1 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.170102 Aug 06 12:31:33.425666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 98/204] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:33 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:34.272654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a091e614-7b8f-4509-94c5-d94632fdf051 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:34.273207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a091e614-7b8f-4509-94c5-d94632fdf051 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:34.279034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a091e614-7b8f-4509-94c5-d94632fdf051 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:34.279508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a091e614-7b8f-4509-94c5-d94632fdf051 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:34.279935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a091e614-7b8f-4509-94c5-d94632fdf051 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:34.280639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a091e614-7b8f-4509-94c5-d94632fdf051 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:34.281087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a091e614-7b8f-4509-94c5-d94632fdf051 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:34.281504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a091e614-7b8f-4509-94c5-d94632fdf051 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:34.422101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a091e614-7b8f-4509-94c5-d94632fdf051 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:34.429664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a091e614-7b8f-4509-94c5-d94632fdf051 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.160978 Aug 06 12:31:34.430220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 107/205] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:34 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:34.445084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c7b99486-2b54-42f7-87d2-3fd12d0ac57a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:34.445690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c7b99486-2b54-42f7-87d2-3fd12d0ac57a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:34.452539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7b99486-2b54-42f7-87d2-3fd12d0ac57a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:34.453061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7b99486-2b54-42f7-87d2-3fd12d0ac57a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:34.453520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7b99486-2b54-42f7-87d2-3fd12d0ac57a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:34.454258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7b99486-2b54-42f7-87d2-3fd12d0ac57a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:34.454715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7b99486-2b54-42f7-87d2-3fd12d0ac57a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:34.455711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7b99486-2b54-42f7-87d2-3fd12d0ac57a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:34.581761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7b99486-2b54-42f7-87d2-3fd12d0ac57a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:34.589684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c7b99486-2b54-42f7-87d2-3fd12d0ac57a tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.148424 Aug 06 12:31:34.590255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 99/206] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:34 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:35.450813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-965e2be3-675a-43ed-aa33-0cac22e88eb1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:35.451421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-965e2be3-675a-43ed-aa33-0cac22e88eb1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:35.458471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-965e2be3-675a-43ed-aa33-0cac22e88eb1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:35.460480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-965e2be3-675a-43ed-aa33-0cac22e88eb1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:35.460915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-965e2be3-675a-43ed-aa33-0cac22e88eb1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:35.461677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-965e2be3-675a-43ed-aa33-0cac22e88eb1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:35.462217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-965e2be3-675a-43ed-aa33-0cac22e88eb1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:35.462688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-965e2be3-675a-43ed-aa33-0cac22e88eb1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:35.466655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:35.609845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-965e2be3-675a-43ed-aa33-0cac22e88eb1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:35.610759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-516369b7-2361-4d68-8f47-050bcd0c6ea3 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:35.611900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-516369b7-2361-4d68-8f47-050bcd0c6ea3 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:35.617978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-965e2be3-675a-43ed-aa33-0cac22e88eb1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.171624 Aug 06 12:31:35.618714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 108/207] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:35 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:35.619026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516369b7-2361-4d68-8f47-050bcd0c6ea3 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:35.619581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516369b7-2361-4d68-8f47-050bcd0c6ea3 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:35.620018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516369b7-2361-4d68-8f47-050bcd0c6ea3 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:35.620759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516369b7-2361-4d68-8f47-050bcd0c6ea3 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:35.621207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516369b7-2361-4d68-8f47-050bcd0c6ea3 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:35.621631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516369b7-2361-4d68-8f47-050bcd0c6ea3 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:35.754646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-516369b7-2361-4d68-8f47-050bcd0c6ea3 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:35.762421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-516369b7-2361-4d68-8f47-050bcd0c6ea3 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.155967 Aug 06 12:31:35.762992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 100/208] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:35 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:36.638731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-97bbd45d-0563-469a-b0c8-72af4aa78f68 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:36.639331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-97bbd45d-0563-469a-b0c8-72af4aa78f68 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:36.645720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-97bbd45d-0563-469a-b0c8-72af4aa78f68 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:36.646179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-97bbd45d-0563-469a-b0c8-72af4aa78f68 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:36.646603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-97bbd45d-0563-469a-b0c8-72af4aa78f68 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:36.647277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-97bbd45d-0563-469a-b0c8-72af4aa78f68 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:36.647722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-97bbd45d-0563-469a-b0c8-72af4aa78f68 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:36.648142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-97bbd45d-0563-469a-b0c8-72af4aa78f68 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:36.783795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50fd0d3d-6fd7-40a0-9707-9afb9fc4f416 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:36.784259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-97bbd45d-0563-469a-b0c8-72af4aa78f68 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:36.784508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50fd0d3d-6fd7-40a0-9707-9afb9fc4f416 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:36.791800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50fd0d3d-6fd7-40a0-9707-9afb9fc4f416 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:36.792280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50fd0d3d-6fd7-40a0-9707-9afb9fc4f416 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:36.792728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50fd0d3d-6fd7-40a0-9707-9afb9fc4f416 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:36.792862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-97bbd45d-0563-469a-b0c8-72af4aa78f68 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.157937 Aug 06 12:31:36.793409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50fd0d3d-6fd7-40a0-9707-9afb9fc4f416 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:36.793542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 109/209] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:36 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:36.794146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50fd0d3d-6fd7-40a0-9707-9afb9fc4f416 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:36.794562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50fd0d3d-6fd7-40a0-9707-9afb9fc4f416 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:36.925115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-50fd0d3d-6fd7-40a0-9707-9afb9fc4f416 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:36.932933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-50fd0d3d-6fd7-40a0-9707-9afb9fc4f416 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.153905 Aug 06 12:31:36.933496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 101/210] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:36 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:37.813585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c133b3fb-484d-4d79-a9bb-e355829b18b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:37.814271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c133b3fb-484d-4d79-a9bb-e355829b18b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:37.820208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c133b3fb-484d-4d79-a9bb-e355829b18b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:37.820748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c133b3fb-484d-4d79-a9bb-e355829b18b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:37.821175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c133b3fb-484d-4d79-a9bb-e355829b18b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:37.821851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c133b3fb-484d-4d79-a9bb-e355829b18b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:37.822295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c133b3fb-484d-4d79-a9bb-e355829b18b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:37.822726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c133b3fb-484d-4d79-a9bb-e355829b18b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:37.947113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c133b3fb-484d-4d79-a9bb-e355829b18b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:37.953823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8bfcad78-3b5e-4b38-ad67-4feb975c6061 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:37.954423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8bfcad78-3b5e-4b38-ad67-4feb975c6061 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:37.954617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c133b3fb-484d-4d79-a9bb-e355829b18b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.144779 Aug 06 12:31:37.955183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 110/211] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:37 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:37.960781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfcad78-3b5e-4b38-ad67-4feb975c6061 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:37.961249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfcad78-3b5e-4b38-ad67-4feb975c6061 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:37.961675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfcad78-3b5e-4b38-ad67-4feb975c6061 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:37.962351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfcad78-3b5e-4b38-ad67-4feb975c6061 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:37.962792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfcad78-3b5e-4b38-ad67-4feb975c6061 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:37.963208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfcad78-3b5e-4b38-ad67-4feb975c6061 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:38.092860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8bfcad78-3b5e-4b38-ad67-4feb975c6061 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:38.101356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8bfcad78-3b5e-4b38-ad67-4feb975c6061 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.151267 Aug 06 12:31:38.101923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 102/212] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:37 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:38.975861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-61dd81b9-58d5-40bb-9cec-f5a9f85df7b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:38.976440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-61dd81b9-58d5-40bb-9cec-f5a9f85df7b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:38.982206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61dd81b9-58d5-40bb-9cec-f5a9f85df7b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:38.982684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61dd81b9-58d5-40bb-9cec-f5a9f85df7b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:38.983109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61dd81b9-58d5-40bb-9cec-f5a9f85df7b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:38.983780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61dd81b9-58d5-40bb-9cec-f5a9f85df7b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:38.984227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61dd81b9-58d5-40bb-9cec-f5a9f85df7b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:38.984675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61dd81b9-58d5-40bb-9cec-f5a9f85df7b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:39.113326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-61dd81b9-58d5-40bb-9cec-f5a9f85df7b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:39.121365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-61dd81b9-58d5-40bb-9cec-f5a9f85df7b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.149364 Aug 06 12:31:39.121727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a6e8ec2b-2008-4999-ae8f-e0cd5af6d5cf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:39.122176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 111/213] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:38 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:39.122333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a6e8ec2b-2008-4999-ae8f-e0cd5af6d5cf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:39.128726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e8ec2b-2008-4999-ae8f-e0cd5af6d5cf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:39.129197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e8ec2b-2008-4999-ae8f-e0cd5af6d5cf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:39.129620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e8ec2b-2008-4999-ae8f-e0cd5af6d5cf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:39.130300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e8ec2b-2008-4999-ae8f-e0cd5af6d5cf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:39.130752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e8ec2b-2008-4999-ae8f-e0cd5af6d5cf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:39.131168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e8ec2b-2008-4999-ae8f-e0cd5af6d5cf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:39.258519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a6e8ec2b-2008-4999-ae8f-e0cd5af6d5cf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:39.266282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a6e8ec2b-2008-4999-ae8f-e0cd5af6d5cf tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.148398 Aug 06 12:31:39.266842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 103/214] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:39 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:40.142302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-78cfe490-ce29-4430-af44-e775aa898a5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:40.142905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-78cfe490-ce29-4430-af44-e775aa898a5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:40.148853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78cfe490-ce29-4430-af44-e775aa898a5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:40.149325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78cfe490-ce29-4430-af44-e775aa898a5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:40.149777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78cfe490-ce29-4430-af44-e775aa898a5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:40.150453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78cfe490-ce29-4430-af44-e775aa898a5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:40.150896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78cfe490-ce29-4430-af44-e775aa898a5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:40.151309 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78cfe490-ce29-4430-af44-e775aa898a5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:40.289799 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-78cfe490-ce29-4430-af44-e775aa898a5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:40.294815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-deec48db-860e-47ca-9a6a-21637a2b54da tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:40.295532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-deec48db-860e-47ca-9a6a-21637a2b54da tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:40.297355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-78cfe490-ce29-4430-af44-e775aa898a5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.158890 Aug 06 12:31:40.297915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 112/215] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:40 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:40.302150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-deec48db-860e-47ca-9a6a-21637a2b54da tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:40.302633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-deec48db-860e-47ca-9a6a-21637a2b54da tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:40.303066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-deec48db-860e-47ca-9a6a-21637a2b54da tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:40.303751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-deec48db-860e-47ca-9a6a-21637a2b54da tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:40.304202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-deec48db-860e-47ca-9a6a-21637a2b54da tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:40.304657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-deec48db-860e-47ca-9a6a-21637a2b54da tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:40.434319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-deec48db-860e-47ca-9a6a-21637a2b54da tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:40.442858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-deec48db-860e-47ca-9a6a-21637a2b54da tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1552 microversion: 2.1 time: 0.151930 Aug 06 12:31:40.443422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 104/216] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:40 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:41.318464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a9e016e3-8f87-4644-ab25-122aa0d657b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:41.319074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a9e016e3-8f87-4644-ab25-122aa0d657b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:41.319931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-93927a4f-49ce-4b0a-83ff-6c25d85043d3 req-4ae95f08-f276-4751-b0e3-175ae8633748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f231479c-af6e-4233-8b90-27574ed9335f", "name": "network-vif-deleted", "tag": "172336ef-ed14-4657-93d7-72c15445dce5"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:31:41.338060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9e016e3-8f87-4644-ab25-122aa0d657b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:41.338562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9e016e3-8f87-4644-ab25-122aa0d657b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:41.339066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9e016e3-8f87-4644-ab25-122aa0d657b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:41.339770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9e016e3-8f87-4644-ab25-122aa0d657b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:41.340277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9e016e3-8f87-4644-ab25-122aa0d657b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:41.340728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9e016e3-8f87-4644-ab25-122aa0d657b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:41.348474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-93927a4f-49ce-4b0a-83ff-6c25d85043d3 req-4ae95f08-f276-4751-b0e3-175ae8633748 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:41.348940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-93927a4f-49ce-4b0a-83ff-6c25d85043d3 req-4ae95f08-f276-4751-b0e3-175ae8633748 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:41.350395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-93927a4f-49ce-4b0a-83ff-6c25d85043d3 req-4ae95f08-f276-4751-b0e3-175ae8633748 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:41.372327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-93927a4f-49ce-4b0a-83ff-6c25d85043d3 req-4ae95f08-f276-4751-b0e3-175ae8633748 service nova] Creating event network-vif-deleted:172336ef-ed14-4657-93d7-72c15445dce5 for instance f231479c-af6e-4233-8b90-27574ed9335f on hv-cinder-85199 Aug 06 12:31:41.379171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-93927a4f-49ce-4b0a-83ff-6c25d85043d3 req-4ae95f08-f276-4751-b0e3-175ae8633748 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071050 Aug 06 12:31:41.380128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 113/217] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:31:41.473102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-43a5b792-3ee5-4a05-9ce3-08c424d0a0ad tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:41.476343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-43a5b792-3ee5-4a05-9ce3-08c424d0a0ad tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:41.491974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a5b792-3ee5-4a05-9ce3-08c424d0a0ad tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:41.492709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a5b792-3ee5-4a05-9ce3-08c424d0a0ad tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:41.494639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a5b792-3ee5-4a05-9ce3-08c424d0a0ad tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:41.495558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a5b792-3ee5-4a05-9ce3-08c424d0a0ad tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:41.496018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a5b792-3ee5-4a05-9ce3-08c424d0a0ad tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:41.496481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a5b792-3ee5-4a05-9ce3-08c424d0a0ad tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:41.578000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-43a5b792-3ee5-4a05-9ce3-08c424d0a0ad tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:41.578623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a9e016e3-8f87-4644-ab25-122aa0d657b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:41.587701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-43a5b792-3ee5-4a05-9ce3-08c424d0a0ad tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1345 microversion: 2.1 time: 0.125694 Aug 06 12:31:41.588282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 114/218] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:41 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:41.589060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a9e016e3-8f87-4644-ab25-122aa0d657b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.275085 Aug 06 12:31:41.595907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 105/219] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:41 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:42.612197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db50ab2d-2c82-439c-ad3e-7093be983cbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:42.613203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:42.613717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db50ab2d-2c82-439c-ad3e-7093be983cbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:42.614612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:42.621996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:42.622581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:42.623064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db50ab2d-2c82-439c-ad3e-7093be983cbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:42.623436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:42.623778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db50ab2d-2c82-439c-ad3e-7093be983cbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:42.624498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db50ab2d-2c82-439c-ad3e-7093be983cbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:42.624629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:42.625150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:42.625693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:42.629900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db50ab2d-2c82-439c-ad3e-7093be983cbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:42.630643 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db50ab2d-2c82-439c-ad3e-7093be983cbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:42.631271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db50ab2d-2c82-439c-ad3e-7093be983cbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:42.661969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:42.663023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:42.663959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:42.664905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lazy-loading 'fault' on Instance uuid f231479c-af6e-4233-8b90-27574ed9335f {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:31:42.731472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c2d686d2034765ac50f7ad75295197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6111202e81324d069fae641cc1606e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:42.743710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c23532e1-a8a8-4631-b774-5a780826fea7 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 200 len: 1350 microversion: 2.1 time: 0.136032 Aug 06 12:31:42.744812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 115/220] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:42 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:42.802125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db50ab2d-2c82-439c-ad3e-7093be983cbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:42.809587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db50ab2d-2c82-439c-ad3e-7093be983cbc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.202853 Aug 06 12:31:42.810160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 106/221] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:42 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:43.765450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:43.766058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:43.772068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:43.772575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:43.773008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:43.773820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:43.774235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:43.774660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:43.788550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] HTTP exception thrown: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Request method failure captured: Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f HTTP/1.1 Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7ZwCqcSbAulV3YiKSnc7LUrWVpWnVFUjRZtb6eR--Aj5V1QusnkB4rEghyIiV6C_L5Z7LW3r-H1O637QaxC4r6k8t6oZnO3YXqIjzlvVhB4sBYvQN9he-FG9aBYLmjJAKjOVAFuPWadJZ5KqsVCdFjkMHIhvbJmeZMYpCCOB6ME6A Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 6111202e81324d069fae641cc1606e77 Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:31:43.793302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6111202e81324d069fae641cc1606e77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6111202e81324d069fae641cc1606e77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6111202e81324d069fae641cc1606e77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6111202e81324d069fae641cc1606e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 6111202e81324d069fae641cc1606e77 Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-DeleteServersTestJSON-1632427155-project Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 79c2d686d2034765ac50f7ad75295197 Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-DeleteServersTestJSON-1632427155-project Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:43.794826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'f231479c-af6e-4233-8b90-27574ed9335f'} Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:31:43.795613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:43.797139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:43.798666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Returning 404 to user: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:31:43.798666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-64e21d84-62b9-4273-8ca0-39202491631b tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 404 len: 111 microversion: 2.1 time: 0.033172 Aug 06 12:31:43.798666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 116/222] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:43 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 12:31:43.830514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a9c15ef0-1289-44c2-b9b9-4fe425e1704e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:43.831204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a9c15ef0-1289-44c2-b9b9-4fe425e1704e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:43.837697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c15ef0-1289-44c2-b9b9-4fe425e1704e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:43.838208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c15ef0-1289-44c2-b9b9-4fe425e1704e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:43.838638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c15ef0-1289-44c2-b9b9-4fe425e1704e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:43.839329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c15ef0-1289-44c2-b9b9-4fe425e1704e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:43.839782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c15ef0-1289-44c2-b9b9-4fe425e1704e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:43.840203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c15ef0-1289-44c2-b9b9-4fe425e1704e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:43.916067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:43.918827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:43.925052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:43.925534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:43.925974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:43.926700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:43.927152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:43.927978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:43.942101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] HTTP exception thrown: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Request method failure captured: Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f/os-volume_attachments HTTP/1.1 Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7ZwCqcSbAulV3YiKSnc7LUrWVpWnVFUjRZtb6eR--Aj5V1QusnkB4rEghyIiV6C_L5Z7LW3r-H1O637QaxC4r6k8t6oZnO3YXqIjzlvVhB4sBYvQN9he-FG9aBYLmjJAKjOVAFuPWadJZ5KqsVCdFjkMHIhvbJmeZMYpCCOB6ME6A Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 6111202e81324d069fae641cc1606e77 Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:31:43.943635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6111202e81324d069fae641cc1606e77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6111202e81324d069fae641cc1606e77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6111202e81324d069fae641cc1606e77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6111202e81324d069fae641cc1606e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 6111202e81324d069fae641cc1606e77 Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-DeleteServersTestJSON-1632427155-project Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 79c2d686d2034765ac50f7ad75295197 Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-DeleteServersTestJSON-1632427155-project Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:43.945118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': 'f231479c-af6e-4233-8b90-27574ed9335f'} Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:31:43.946106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:43.947151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:43.948245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Returning 404 to user: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:31:43.948245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2ccc7888-6288-47a6-9729-e040e504310d tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033415 Aug 06 12:31:43.948245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 117/223] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:31:43 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 12:31:43.992946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a9c15ef0-1289-44c2-b9b9-4fe425e1704e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:44.004772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a9c15ef0-1289-44c2-b9b9-4fe425e1704e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.177464 Aug 06 12:31:44.005327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 107/224] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:43 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:45.026357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-92a1533f-2924-4bf7-a21f-cdbd18152714 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:45.027162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-92a1533f-2924-4bf7-a21f-cdbd18152714 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:45.029313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=48 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:45.035479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a1533f-2924-4bf7-a21f-cdbd18152714 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:45.035955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a1533f-2924-4bf7-a21f-cdbd18152714 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:45.036459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a1533f-2924-4bf7-a21f-cdbd18152714 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:45.037161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a1533f-2924-4bf7-a21f-cdbd18152714 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:45.037613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a1533f-2924-4bf7-a21f-cdbd18152714 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:45.038036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a1533f-2924-4bf7-a21f-cdbd18152714 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:45.168911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-92a1533f-2924-4bf7-a21f-cdbd18152714 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:45.172624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-92a1533f-2924-4bf7-a21f-cdbd18152714 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.150256 Aug 06 12:31:45.173187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 118/225] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:45 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:45.398405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-210875396", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:31:45.450201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] validate_networks() for None {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:31:45.718376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:31:45.718798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:31:45.719268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:31:45.719673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:31:45.720697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:31:45.729567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:45.730066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:45.730489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:45.731223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:45.731666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:45.732138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:45.748723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Getting quotas for project c1cbbde8a7a342d6a74e14d9010e91e0. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:31:45.752606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Getting quotas for user d36ce80ae6a942f1866cd2b0a5fe4c01 and project c1cbbde8a7a342d6a74e14d9010e91e0. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:31:45.763188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:31:45.765405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:31:45.810301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8282093f-2f7b-4536-893f-9f26e1262796 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.415567 Aug 06 12:31:45.811038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 108/226] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:31:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 12:31:45.821516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4565a6a9-e110-40bb-9451-80d5faa0aea7 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:45.822117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4565a6a9-e110-40bb-9451-80d5faa0aea7 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:45.891580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4565a6a9-e110-40bb-9451-80d5faa0aea7 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:45.900097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4565a6a9-e110-40bb-9451-80d5faa0aea7 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1214 microversion: 2.1 time: 0.082268 Aug 06 12:31:45.900706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 119/227] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:45 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:46.194185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c7560a6b-3569-47de-9118-84427e878c1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:46.194882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c7560a6b-3569-47de-9118-84427e878c1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:46.201560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7560a6b-3569-47de-9118-84427e878c1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:46.202050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7560a6b-3569-47de-9118-84427e878c1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:46.202490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7560a6b-3569-47de-9118-84427e878c1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:46.203187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7560a6b-3569-47de-9118-84427e878c1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:46.203882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7560a6b-3569-47de-9118-84427e878c1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:46.205552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7560a6b-3569-47de-9118-84427e878c1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:46.336048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7560a6b-3569-47de-9118-84427e878c1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:46.343676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c7560a6b-3569-47de-9118-84427e878c1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.153658 Aug 06 12:31:46.344243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 109/228] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:46 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:46.920007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-43a21dc9-dedf-4ce5-a6ad-327c8324dfe1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:46.920634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-43a21dc9-dedf-4ce5-a6ad-327c8324dfe1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:46.926692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a21dc9-dedf-4ce5-a6ad-327c8324dfe1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:46.927163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a21dc9-dedf-4ce5-a6ad-327c8324dfe1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:46.927590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a21dc9-dedf-4ce5-a6ad-327c8324dfe1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:46.928259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a21dc9-dedf-4ce5-a6ad-327c8324dfe1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:46.928730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a21dc9-dedf-4ce5-a6ad-327c8324dfe1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:46.929149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43a21dc9-dedf-4ce5-a6ad-327c8324dfe1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:46.987933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-43a21dc9-dedf-4ce5-a6ad-327c8324dfe1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:46.995504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-43a21dc9-dedf-4ce5-a6ad-327c8324dfe1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1218 microversion: 2.1 time: 0.079204 Aug 06 12:31:46.996247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 120/229] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:46 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:47.364735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6e4c3785-b9c1-4ed5-a53b-2a60bee7e5d3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:47.365601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6e4c3785-b9c1-4ed5-a53b-2a60bee7e5d3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:47.371998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e4c3785-b9c1-4ed5-a53b-2a60bee7e5d3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:47.372511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e4c3785-b9c1-4ed5-a53b-2a60bee7e5d3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:47.372945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e4c3785-b9c1-4ed5-a53b-2a60bee7e5d3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:47.373626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e4c3785-b9c1-4ed5-a53b-2a60bee7e5d3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:47.374079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e4c3785-b9c1-4ed5-a53b-2a60bee7e5d3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:47.374498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e4c3785-b9c1-4ed5-a53b-2a60bee7e5d3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:47.502026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6e4c3785-b9c1-4ed5-a53b-2a60bee7e5d3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:47.509370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6e4c3785-b9c1-4ed5-a53b-2a60bee7e5d3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.148961 Aug 06 12:31:47.509939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 110/230] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:47 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:48.015595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ca29cb19-e543-4c18-a5e5-7372081d3e82 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:48.016338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ca29cb19-e543-4c18-a5e5-7372081d3e82 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:48.023065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca29cb19-e543-4c18-a5e5-7372081d3e82 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:48.023566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca29cb19-e543-4c18-a5e5-7372081d3e82 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:48.024021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca29cb19-e543-4c18-a5e5-7372081d3e82 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:48.024775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca29cb19-e543-4c18-a5e5-7372081d3e82 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:48.025265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca29cb19-e543-4c18-a5e5-7372081d3e82 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:48.025730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca29cb19-e543-4c18-a5e5-7372081d3e82 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:48.086011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ca29cb19-e543-4c18-a5e5-7372081d3e82 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:48.093317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ca29cb19-e543-4c18-a5e5-7372081d3e82 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1218 microversion: 2.1 time: 0.081864 Aug 06 12:31:48.093886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 121/231] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:48 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:48.530766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6ceb6e77-3c4a-442a-959e-32a8f1270081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:48.531507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6ceb6e77-3c4a-442a-959e-32a8f1270081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:48.534500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:48.541619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ceb6e77-3c4a-442a-959e-32a8f1270081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:48.542246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ceb6e77-3c4a-442a-959e-32a8f1270081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:48.542733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ceb6e77-3c4a-442a-959e-32a8f1270081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:48.543562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ceb6e77-3c4a-442a-959e-32a8f1270081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:48.544026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ceb6e77-3c4a-442a-959e-32a8f1270081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:48.544508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ceb6e77-3c4a-442a-959e-32a8f1270081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:48.550250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:48.671831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6ceb6e77-3c4a-442a-959e-32a8f1270081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:48.679233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6ceb6e77-3c4a-442a-959e-32a8f1270081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.152625 Aug 06 12:31:48.679804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 111/232] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:48 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:49.112675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-93be33a5-9a95-4406-9c13-87b3495dec92 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:49.113276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-93be33a5-9a95-4406-9c13-87b3495dec92 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:49.119318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93be33a5-9a95-4406-9c13-87b3495dec92 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:49.119792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93be33a5-9a95-4406-9c13-87b3495dec92 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:49.120219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93be33a5-9a95-4406-9c13-87b3495dec92 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:49.120924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93be33a5-9a95-4406-9c13-87b3495dec92 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:49.121372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93be33a5-9a95-4406-9c13-87b3495dec92 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:49.121805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93be33a5-9a95-4406-9c13-87b3495dec92 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:49.182355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-93be33a5-9a95-4406-9c13-87b3495dec92 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:49.190173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-93be33a5-9a95-4406-9c13-87b3495dec92 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1266 microversion: 2.1 time: 0.081469 Aug 06 12:31:49.190729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 122/233] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:49 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:49.700660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d6302ba-09ec-41ff-9b79-b004d72541ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:49.701171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3d6302ba-09ec-41ff-9b79-b004d72541ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:49.707974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d6302ba-09ec-41ff-9b79-b004d72541ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:49.708551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d6302ba-09ec-41ff-9b79-b004d72541ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:49.708979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d6302ba-09ec-41ff-9b79-b004d72541ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:49.709650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d6302ba-09ec-41ff-9b79-b004d72541ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:49.710094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d6302ba-09ec-41ff-9b79-b004d72541ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:49.710510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d6302ba-09ec-41ff-9b79-b004d72541ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:49.842279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3d6302ba-09ec-41ff-9b79-b004d72541ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:49.853164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3d6302ba-09ec-41ff-9b79-b004d72541ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.156410 Aug 06 12:31:49.853851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 112/234] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:49 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:50.218490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e19aa2b0-d304-4b94-a89b-6285da078276 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:50.219165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e19aa2b0-d304-4b94-a89b-6285da078276 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:50.225773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e19aa2b0-d304-4b94-a89b-6285da078276 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:50.226282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e19aa2b0-d304-4b94-a89b-6285da078276 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:50.232785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e19aa2b0-d304-4b94-a89b-6285da078276 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:50.233631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e19aa2b0-d304-4b94-a89b-6285da078276 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:50.234108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e19aa2b0-d304-4b94-a89b-6285da078276 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:50.234652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e19aa2b0-d304-4b94-a89b-6285da078276 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:50.330743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e19aa2b0-d304-4b94-a89b-6285da078276 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:50.338435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e19aa2b0-d304-4b94-a89b-6285da078276 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1284 microversion: 2.1 time: 0.124102 Aug 06 12:31:50.339011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 123/235] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:50 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:50.424524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:50.425056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:50.431213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:50.431696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:50.432135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:50.432902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:50.433498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:50.433968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:50.447367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] HTTP exception thrown: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Request method failure captured: Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f HTTP/1.1 Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7ZwCqcSbAulV3YiKSnc7LUrWVpWnVFUjRZtb6eR--Aj5V1QusnkB4rEghyIiV6C_L5Z7LW3r-H1O637QaxC4r6k8t6oZnO3YXqIjzlvVhB4sBYvQN9he-FG9aBYLmjJAKjOVAFuPWadJZ5KqsVCdFjkMHIhvbJmeZMYpCCOB6ME6A Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 6111202e81324d069fae641cc1606e77 Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:31:50.452270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6111202e81324d069fae641cc1606e77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6111202e81324d069fae641cc1606e77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6111202e81324d069fae641cc1606e77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6111202e81324d069fae641cc1606e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 6111202e81324d069fae641cc1606e77 Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-DeleteServersTestJSON-1632427155-project Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 79c2d686d2034765ac50f7ad75295197 Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-DeleteServersTestJSON-1632427155-project Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:50.453688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'f231479c-af6e-4233-8b90-27574ed9335f'} Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:31:50.454574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:50.455897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:31:50.457752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Returning 404 to user: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:31:50.457752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8f9caabc-f8ac-41ac-bba3-5557bcddb781 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 404 len: 111 microversion: 2.1 time: 0.033859 Aug 06 12:31:50.457752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 113/236] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:31:50 2022] DELETE /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 12:31:50.462172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:50.462824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] [instance: f231479c-af6e-4233-8b90-27574ed9335f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:50.468555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:50.469001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:50.469406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:50.470773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:50.471383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:50.471798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:50.486884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] HTTP exception thrown: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Request method failure captured: Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f HTTP/1.1 Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7ZwCqcSbAulV3YiKSnc7LUrWVpWnVFUjRZtb6eR--Aj5V1QusnkB4rEghyIiV6C_L5Z7LW3r-H1O637QaxC4r6k8t6oZnO3YXqIjzlvVhB4sBYvQN9he-FG9aBYLmjJAKjOVAFuPWadJZ5KqsVCdFjkMHIhvbJmeZMYpCCOB6ME6A Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 6111202e81324d069fae641cc1606e77 Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:31:50.488578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6111202e81324d069fae641cc1606e77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6111202e81324d069fae641cc1606e77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6111202e81324d069fae641cc1606e77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6111202e81324d069fae641cc1606e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 6111202e81324d069fae641cc1606e77 Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-DeleteServersTestJSON-1632427155 Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-DeleteServersTestJSON-1632427155-project Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 79c2d686d2034765ac50f7ad75295197 Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-DeleteServersTestJSON-1632427155-project Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:50.489778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'f231479c-af6e-4233-8b90-27574ed9335f'} Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:31:50.490819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. Aug 06 12:31:50.491945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:31:50.493070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] Returning 404 to user: Instance f231479c-af6e-4233-8b90-27574ed9335f could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:31:50.493070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-829bb056-7df5-4db4-83f5-fe21e714f525 tempest-DeleteServersTestJSON-1632427155 tempest-DeleteServersTestJSON-1632427155-project] 10.222.0.20 "GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f" status: 404 len: 111 microversion: 2.1 time: 0.031612 Aug 06 12:31:50.494388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 124/237] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:50 2022] GET /compute/v2.1/servers/f231479c-af6e-4233-8b90-27574ed9335f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 12:31:50.874873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9850d61f-08ef-4c0c-9aed-1b5ee6d670aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:50.875482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9850d61f-08ef-4c0c-9aed-1b5ee6d670aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:50.883042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9850d61f-08ef-4c0c-9aed-1b5ee6d670aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:50.883880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9850d61f-08ef-4c0c-9aed-1b5ee6d670aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:50.884332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9850d61f-08ef-4c0c-9aed-1b5ee6d670aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:50.885353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9850d61f-08ef-4c0c-9aed-1b5ee6d670aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:50.885806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9850d61f-08ef-4c0c-9aed-1b5ee6d670aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:50.886377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9850d61f-08ef-4c0c-9aed-1b5ee6d670aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:51.131718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9850d61f-08ef-4c0c-9aed-1b5ee6d670aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:51.139390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9850d61f-08ef-4c0c-9aed-1b5ee6d670aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.268492 Aug 06 12:31:51.140200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 114/238] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:50 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:51.360727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2b2981b5-b72f-4e4b-9f0c-ab2551e09cfe tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:51.361991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2b2981b5-b72f-4e4b-9f0c-ab2551e09cfe tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:51.369284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b2981b5-b72f-4e4b-9f0c-ab2551e09cfe tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:51.370133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b2981b5-b72f-4e4b-9f0c-ab2551e09cfe tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:51.371453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b2981b5-b72f-4e4b-9f0c-ab2551e09cfe tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:51.372445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b2981b5-b72f-4e4b-9f0c-ab2551e09cfe tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:51.373641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b2981b5-b72f-4e4b-9f0c-ab2551e09cfe tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:51.374264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b2981b5-b72f-4e4b-9f0c-ab2551e09cfe tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:51.460659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2b2981b5-b72f-4e4b-9f0c-ab2551e09cfe tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:51.468024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2b2981b5-b72f-4e4b-9f0c-ab2551e09cfe tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1284 microversion: 2.1 time: 0.111301 Aug 06 12:31:51.468669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 125/239] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:51 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:52.166717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-98d64574-300a-487a-94eb-670ff1330a3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:52.167374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-98d64574-300a-487a-94eb-670ff1330a3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:52.175471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98d64574-300a-487a-94eb-670ff1330a3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:52.176003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98d64574-300a-487a-94eb-670ff1330a3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:52.176473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98d64574-300a-487a-94eb-670ff1330a3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:52.177180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98d64574-300a-487a-94eb-670ff1330a3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:52.177636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98d64574-300a-487a-94eb-670ff1330a3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:52.178061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98d64574-300a-487a-94eb-670ff1330a3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:52.317313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-98d64574-300a-487a-94eb-670ff1330a3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:52.325133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-98d64574-300a-487a-94eb-670ff1330a3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.167782 Aug 06 12:31:52.325706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 115/240] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:52 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:52.491044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4babc13-f138-4ad2-a950-0e242bf419bd tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:52.492252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c4babc13-f138-4ad2-a950-0e242bf419bd tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:52.505497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4babc13-f138-4ad2-a950-0e242bf419bd tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:52.506319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4babc13-f138-4ad2-a950-0e242bf419bd tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:52.506977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4babc13-f138-4ad2-a950-0e242bf419bd tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:52.512403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4babc13-f138-4ad2-a950-0e242bf419bd tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:52.513151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4babc13-f138-4ad2-a950-0e242bf419bd tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:52.513788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4babc13-f138-4ad2-a950-0e242bf419bd tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:52.603188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c4babc13-f138-4ad2-a950-0e242bf419bd tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:52.611267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c4babc13-f138-4ad2-a950-0e242bf419bd tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1272 microversion: 2.1 time: 0.126035 Aug 06 12:31:52.611849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 126/241] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:52 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:53.346231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ca5b6b6f-7fbc-4990-ad5d-3737e88356ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:53.347017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ca5b6b6f-7fbc-4990-ad5d-3737e88356ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:53.353294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca5b6b6f-7fbc-4990-ad5d-3737e88356ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:53.353772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca5b6b6f-7fbc-4990-ad5d-3737e88356ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:53.354197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca5b6b6f-7fbc-4990-ad5d-3737e88356ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:53.354885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca5b6b6f-7fbc-4990-ad5d-3737e88356ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:53.355328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca5b6b6f-7fbc-4990-ad5d-3737e88356ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:53.355747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca5b6b6f-7fbc-4990-ad5d-3737e88356ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:53.606356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ca5b6b6f-7fbc-4990-ad5d-3737e88356ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:53.615935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ca5b6b6f-7fbc-4990-ad5d-3737e88356ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.274134 Aug 06 12:31:53.616660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 116/242] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:53 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:53.633734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4ff67a4-2f4b-411f-9db2-09c5291ed014 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:53.635006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c4ff67a4-2f4b-411f-9db2-09c5291ed014 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:53.643396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ff67a4-2f4b-411f-9db2-09c5291ed014 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:53.643883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ff67a4-2f4b-411f-9db2-09c5291ed014 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:53.644317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ff67a4-2f4b-411f-9db2-09c5291ed014 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:53.645033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ff67a4-2f4b-411f-9db2-09c5291ed014 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:53.645475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ff67a4-2f4b-411f-9db2-09c5291ed014 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:53.645892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ff67a4-2f4b-411f-9db2-09c5291ed014 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:53.724461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c4ff67a4-2f4b-411f-9db2-09c5291ed014 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:53.736472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c4ff67a4-2f4b-411f-9db2-09c5291ed014 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1272 microversion: 2.1 time: 0.106798 Aug 06 12:31:53.741001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 127/243] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:53 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:54.637327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-772ba04c-aca2-4913-80ad-95da40b3536c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:54.638135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-772ba04c-aca2-4913-80ad-95da40b3536c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:54.645665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-772ba04c-aca2-4913-80ad-95da40b3536c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:54.646255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-772ba04c-aca2-4913-80ad-95da40b3536c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:54.646756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-772ba04c-aca2-4913-80ad-95da40b3536c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:54.647535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-772ba04c-aca2-4913-80ad-95da40b3536c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:54.648171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-772ba04c-aca2-4913-80ad-95da40b3536c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:54.648621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-772ba04c-aca2-4913-80ad-95da40b3536c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:54.761340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f52ac26e-c4fd-46a2-8a58-eddd5ccaffe3 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:54.762078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f52ac26e-c4fd-46a2-8a58-eddd5ccaffe3 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:54.769739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f52ac26e-c4fd-46a2-8a58-eddd5ccaffe3 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:54.770805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f52ac26e-c4fd-46a2-8a58-eddd5ccaffe3 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:54.771244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f52ac26e-c4fd-46a2-8a58-eddd5ccaffe3 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:54.772109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f52ac26e-c4fd-46a2-8a58-eddd5ccaffe3 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:54.772860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f52ac26e-c4fd-46a2-8a58-eddd5ccaffe3 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:54.773200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f52ac26e-c4fd-46a2-8a58-eddd5ccaffe3 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:54.779089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:54.792479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-772ba04c-aca2-4913-80ad-95da40b3536c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:54.801292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-772ba04c-aca2-4913-80ad-95da40b3536c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.167906 Aug 06 12:31:54.802019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 117/244] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:54 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:54.840463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f52ac26e-c4fd-46a2-8a58-eddd5ccaffe3 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:54.849170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f52ac26e-c4fd-46a2-8a58-eddd5ccaffe3 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1272 microversion: 2.1 time: 0.093550 Aug 06 12:31:54.849730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 128/245] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:54 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:55.822257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3c758eee-483b-480e-b17e-b5189158e10a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:55.822868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3c758eee-483b-480e-b17e-b5189158e10a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:55.825243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:55.825911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:55.833094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c758eee-483b-480e-b17e-b5189158e10a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:55.833620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c758eee-483b-480e-b17e-b5189158e10a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:55.834432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c758eee-483b-480e-b17e-b5189158e10a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:55.835827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c758eee-483b-480e-b17e-b5189158e10a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:55.836273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c758eee-483b-480e-b17e-b5189158e10a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:55.836926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c758eee-483b-480e-b17e-b5189158e10a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:55.879497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-45763b29-382f-47ce-be81-155912fe5f20 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:55.882422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-45763b29-382f-47ce-be81-155912fe5f20 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:55.890099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45763b29-382f-47ce-be81-155912fe5f20 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:55.891398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45763b29-382f-47ce-be81-155912fe5f20 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:55.891827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45763b29-382f-47ce-be81-155912fe5f20 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:55.892589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45763b29-382f-47ce-be81-155912fe5f20 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:55.893021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45763b29-382f-47ce-be81-155912fe5f20 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:55.893438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45763b29-382f-47ce-be81-155912fe5f20 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:55.896180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:31:56.005237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3c758eee-483b-480e-b17e-b5189158e10a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:56.014831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3c758eee-483b-480e-b17e-b5189158e10a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.196408 Aug 06 12:31:56.015672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 118/246] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:55 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:56.093987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-45763b29-382f-47ce-be81-155912fe5f20 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:56.101937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-45763b29-382f-47ce-be81-155912fe5f20 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1314 microversion: 2.1 time: 0.233923 Aug 06 12:31:56.102562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 129/247] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:55 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:57.038174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f79c7d7c-c067-45bb-9865-df3832388ac2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:57.038778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f79c7d7c-c067-45bb-9865-df3832388ac2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:57.051394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f79c7d7c-c067-45bb-9865-df3832388ac2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:57.057450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f79c7d7c-c067-45bb-9865-df3832388ac2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:57.058068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f79c7d7c-c067-45bb-9865-df3832388ac2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:57.058997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f79c7d7c-c067-45bb-9865-df3832388ac2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:57.059656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f79c7d7c-c067-45bb-9865-df3832388ac2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:57.060235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f79c7d7c-c067-45bb-9865-df3832388ac2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:57.106132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-ac15bfe5-14c8-4ee7-bb4e-66d7eefd67cd req-dbea4d9f-1ffb-4a4c-9883-8ff772bd2252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60a6e36-4af4-4c66-ad99-2235f9caa594", "tag": "72678e85-00a6-4aaa-af3c-b4398d1dd4a0"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:31:57.125191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ac15bfe5-14c8-4ee7-bb4e-66d7eefd67cd req-dbea4d9f-1ffb-4a4c-9883-8ff772bd2252 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:57.126082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ac15bfe5-14c8-4ee7-bb4e-66d7eefd67cd req-dbea4d9f-1ffb-4a4c-9883-8ff772bd2252 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:57.126761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ac15bfe5-14c8-4ee7-bb4e-66d7eefd67cd req-dbea4d9f-1ffb-4a4c-9883-8ff772bd2252 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:57.144037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-ac15bfe5-14c8-4ee7-bb4e-66d7eefd67cd req-dbea4d9f-1ffb-4a4c-9883-8ff772bd2252 service nova] Creating event network-changed:72678e85-00a6-4aaa-af3c-b4398d1dd4a0 for instance d60a6e36-4af4-4c66-ad99-2235f9caa594 on hv-cinder-85199 Aug 06 12:31:57.149337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-ac15bfe5-14c8-4ee7-bb4e-66d7eefd67cd req-dbea4d9f-1ffb-4a4c-9883-8ff772bd2252 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048868 Aug 06 12:31:57.150243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 130/248] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:31:57.156159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-142ce5a4-439e-42f0-acd9-dbb8615e3e25 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:57.157670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-142ce5a4-439e-42f0-acd9-dbb8615e3e25 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:57.164919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-142ce5a4-439e-42f0-acd9-dbb8615e3e25 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:57.165694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-142ce5a4-439e-42f0-acd9-dbb8615e3e25 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:57.166787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-142ce5a4-439e-42f0-acd9-dbb8615e3e25 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:57.167804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-142ce5a4-439e-42f0-acd9-dbb8615e3e25 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:57.168636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-142ce5a4-439e-42f0-acd9-dbb8615e3e25 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:57.169354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-142ce5a4-439e-42f0-acd9-dbb8615e3e25 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:57.262155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f79c7d7c-c067-45bb-9865-df3832388ac2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:57.271475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f79c7d7c-c067-45bb-9865-df3832388ac2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1522 microversion: 2.1 time: 0.237452 Aug 06 12:31:57.291660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 119/249] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:57 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:57.506994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-142ce5a4-439e-42f0-acd9-dbb8615e3e25 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:57.517668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-142ce5a4-439e-42f0-acd9-dbb8615e3e25 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1314 microversion: 2.1 time: 0.364675 Aug 06 12:31:57.518946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 131/250] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:57 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:58.294073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f8838a8c-7784-4097-bdf7-7ad8b6fbe9e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:58.294719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f8838a8c-7784-4097-bdf7-7ad8b6fbe9e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:58.309605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8838a8c-7784-4097-bdf7-7ad8b6fbe9e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:58.310286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8838a8c-7784-4097-bdf7-7ad8b6fbe9e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:58.310989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8838a8c-7784-4097-bdf7-7ad8b6fbe9e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:58.311785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8838a8c-7784-4097-bdf7-7ad8b6fbe9e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:58.312335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8838a8c-7784-4097-bdf7-7ad8b6fbe9e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:58.312858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8838a8c-7784-4097-bdf7-7ad8b6fbe9e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:58.470990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f8838a8c-7784-4097-bdf7-7ad8b6fbe9e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:58.482514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f8838a8c-7784-4097-bdf7-7ad8b6fbe9e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1502 microversion: 2.1 time: 0.191110 Aug 06 12:31:58.483694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 120/251] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:58 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:58.517221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-450d96c7-b05c-4c2a-bad5-00f591afebe1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:58.518060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-450d96c7-b05c-4c2a-bad5-00f591afebe1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:58.533898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-450d96c7-b05c-4c2a-bad5-00f591afebe1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:58.534573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-450d96c7-b05c-4c2a-bad5-00f591afebe1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:58.535299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-450d96c7-b05c-4c2a-bad5-00f591afebe1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:58.536398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-450d96c7-b05c-4c2a-bad5-00f591afebe1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:58.537425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-450d96c7-b05c-4c2a-bad5-00f591afebe1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:58.538128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-450d96c7-b05c-4c2a-bad5-00f591afebe1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:58.538995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4f790f39-3853-468d-a12d-a511f70930e1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:58.539617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4f790f39-3853-468d-a12d-a511f70930e1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:58.554143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f790f39-3853-468d-a12d-a511f70930e1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:58.554644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f790f39-3853-468d-a12d-a511f70930e1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:58.555083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f790f39-3853-468d-a12d-a511f70930e1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:58.555792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f790f39-3853-468d-a12d-a511f70930e1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:58.556250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f790f39-3853-468d-a12d-a511f70930e1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:58.565347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f790f39-3853-468d-a12d-a511f70930e1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:58.845103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4f790f39-3853-468d-a12d-a511f70930e1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:58.855027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4f790f39-3853-468d-a12d-a511f70930e1 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1314 microversion: 2.1 time: 0.320100 Aug 06 12:31:58.856567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 121/252] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:58 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:31:58.920175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-450d96c7-b05c-4c2a-bad5-00f591afebe1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:31:58.927579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-450d96c7-b05c-4c2a-bad5-00f591afebe1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1516 microversion: 2.1 time: 0.427562 Aug 06 12:31:58.928141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 132/253] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:58 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1516 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:31:59.876014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19ae28e1-a7e6-453a-89d5-c4289a1e00b6 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:31:59.876657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19ae28e1-a7e6-453a-89d5-c4289a1e00b6 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:31:59.883533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ae28e1-a7e6-453a-89d5-c4289a1e00b6 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:59.884130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ae28e1-a7e6-453a-89d5-c4289a1e00b6 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:59.884798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ae28e1-a7e6-453a-89d5-c4289a1e00b6 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:31:59.885487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ae28e1-a7e6-453a-89d5-c4289a1e00b6 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:31:59.885929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ae28e1-a7e6-453a-89d5-c4289a1e00b6 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:31:59.886513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ae28e1-a7e6-453a-89d5-c4289a1e00b6 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:00.173569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-19ae28e1-a7e6-453a-89d5-c4289a1e00b6 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:00.182896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19ae28e1-a7e6-453a-89d5-c4289a1e00b6 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1314 microversion: 2.1 time: 0.310966 Aug 06 12:32:00.183820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 122/254] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:31:59 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:00.445389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-84083c4a-bad7-4bee-ac5e-3da97af2a328 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:00.447672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-84083c4a-bad7-4bee-ac5e-3da97af2a328 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:00.454598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84083c4a-bad7-4bee-ac5e-3da97af2a328 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:00.455084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84083c4a-bad7-4bee-ac5e-3da97af2a328 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:00.455777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84083c4a-bad7-4bee-ac5e-3da97af2a328 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:00.456710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84083c4a-bad7-4bee-ac5e-3da97af2a328 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:00.457345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84083c4a-bad7-4bee-ac5e-3da97af2a328 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:00.457955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84083c4a-bad7-4bee-ac5e-3da97af2a328 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:00.511644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-84083c4a-bad7-4bee-ac5e-3da97af2a328 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'flavor' on Instance uuid 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:32:00.702698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-84083c4a-bad7-4bee-ac5e-3da97af2a328 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88/action" status: 200 len: 32 microversion: 2.1 time: 0.262897 Aug 06 12:32:00.703298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 133/255] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 12:32:00 2022] POST /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 12:32:00.713300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b39b3a3d-c5ba-4fb5-bdb8-c03c3beeb768 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:00.713910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b39b3a3d-c5ba-4fb5-bdb8-c03c3beeb768 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:00.724799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39b3a3d-c5ba-4fb5-bdb8-c03c3beeb768 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:00.725300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39b3a3d-c5ba-4fb5-bdb8-c03c3beeb768 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:00.725719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39b3a3d-c5ba-4fb5-bdb8-c03c3beeb768 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:00.726417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39b3a3d-c5ba-4fb5-bdb8-c03c3beeb768 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:00.726854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39b3a3d-c5ba-4fb5-bdb8-c03c3beeb768 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:00.732018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39b3a3d-c5ba-4fb5-bdb8-c03c3beeb768 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:00.897080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b39b3a3d-c5ba-4fb5-bdb8-c03c3beeb768 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:00.907656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b39b3a3d-c5ba-4fb5-bdb8-c03c3beeb768 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.197489 Aug 06 12:32:00.908228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 123/256] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:00 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:00.956378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9a6ba3cf-f14e-496f-be70-b77a93ba4a80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Action: 'create', calling method: .version_select at 0x7f541ac10ee0>, body: {"keypair": {"name": "tempest-keypair-1207510847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyZ3fEDDbVM/MIVSeh2Pq+drMtH4VvF0GMk2rFXEQfvy/KySqPlNRHXnvka9mnoQ3kJobFr9hYkZBzgMow2QENnuUZKDux2QcNTDEy5GggagH5cfbzB7Km94d0fu6hIgA=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:00.972342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-9a6ba3cf-f14e-496f-be70-b77a93ba4a80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Getting quotas for project 4931a52d9cda40b89d15804b69b5a2d7. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:32:00.976939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-9a6ba3cf-f14e-496f-be70-b77a93ba4a80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Getting quotas for user 6844f315435f48f68488a2f0459bf155 and project 4931a52d9cda40b89d15804b69b5a2d7. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:32:01.006438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9a6ba3cf-f14e-496f-be70-b77a93ba4a80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.207811 Aug 06 12:32:01.007200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 134/257] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Aug 6 12:32:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:32:01.203617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3e8b132f-fa8a-45ea-8646-03e1145c88d0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:01.204596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3e8b132f-fa8a-45ea-8646-03e1145c88d0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:01.217680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e8b132f-fa8a-45ea-8646-03e1145c88d0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:01.218179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e8b132f-fa8a-45ea-8646-03e1145c88d0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:01.218688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e8b132f-fa8a-45ea-8646-03e1145c88d0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:01.219938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e8b132f-fa8a-45ea-8646-03e1145c88d0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:01.228200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e8b132f-fa8a-45ea-8646-03e1145c88d0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:01.228785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e8b132f-fa8a-45ea-8646-03e1145c88d0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:01.611091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3e8b132f-fa8a-45ea-8646-03e1145c88d0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:01.619227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3e8b132f-fa8a-45ea-8646-03e1145c88d0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1314 microversion: 2.1 time: 0.419299 Aug 06 12:32:01.624771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 124/258] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:01 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:01.931260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-02641592-c075-4be2-9f16-1ad970ba3489 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:01.932103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-02641592-c075-4be2-9f16-1ad970ba3489 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:01.947379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02641592-c075-4be2-9f16-1ad970ba3489 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:01.954812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02641592-c075-4be2-9f16-1ad970ba3489 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:01.956462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02641592-c075-4be2-9f16-1ad970ba3489 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:01.957882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02641592-c075-4be2-9f16-1ad970ba3489 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:01.962635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02641592-c075-4be2-9f16-1ad970ba3489 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:01.965054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02641592-c075-4be2-9f16-1ad970ba3489 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:02.305642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-02641592-c075-4be2-9f16-1ad970ba3489 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:02.318031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-02641592-c075-4be2-9f16-1ad970ba3489 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.390691 Aug 06 12:32:02.319860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 135/259] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:01 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:02.647225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-373d5934-e779-4406-8710-4c1dd7060a6e tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:02.647932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-373d5934-e779-4406-8710-4c1dd7060a6e tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:02.655457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-373d5934-e779-4406-8710-4c1dd7060a6e tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:02.656145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-373d5934-e779-4406-8710-4c1dd7060a6e tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:02.657113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-373d5934-e779-4406-8710-4c1dd7060a6e tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:02.658042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-373d5934-e779-4406-8710-4c1dd7060a6e tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:02.658427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-373d5934-e779-4406-8710-4c1dd7060a6e tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:02.658843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-373d5934-e779-4406-8710-4c1dd7060a6e tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:03.190216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-373d5934-e779-4406-8710-4c1dd7060a6e tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:03.209071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-373d5934-e779-4406-8710-4c1dd7060a6e tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1314 microversion: 2.1 time: 0.566278 Aug 06 12:32:03.210377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 125/260] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:02 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:03.340698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0d27af7d-bdc9-4916-ab92-2fb97db3fa39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:03.342157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0d27af7d-bdc9-4916-ab92-2fb97db3fa39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:03.355316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d27af7d-bdc9-4916-ab92-2fb97db3fa39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:03.356049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d27af7d-bdc9-4916-ab92-2fb97db3fa39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:03.356821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d27af7d-bdc9-4916-ab92-2fb97db3fa39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:03.358066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d27af7d-bdc9-4916-ab92-2fb97db3fa39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:03.358527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d27af7d-bdc9-4916-ab92-2fb97db3fa39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:03.358957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d27af7d-bdc9-4916-ab92-2fb97db3fa39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:03.393674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-0783bc4f-12b8-42a0-a53e-4f0de75a0e88 req-e186b48d-faf8-4864-8988-236394c04170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60a6e36-4af4-4c66-ad99-2235f9caa594", "name": "network-vif-plugged", "status": "completed", "tag": "72678e85-00a6-4aaa-af3c-b4398d1dd4a0"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:03.415232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0783bc4f-12b8-42a0-a53e-4f0de75a0e88 req-e186b48d-faf8-4864-8988-236394c04170 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:03.416285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0783bc4f-12b8-42a0-a53e-4f0de75a0e88 req-e186b48d-faf8-4864-8988-236394c04170 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:03.418131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0783bc4f-12b8-42a0-a53e-4f0de75a0e88 req-e186b48d-faf8-4864-8988-236394c04170 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:03.453558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-0783bc4f-12b8-42a0-a53e-4f0de75a0e88 req-e186b48d-faf8-4864-8988-236394c04170 service nova] Creating event network-vif-plugged:72678e85-00a6-4aaa-af3c-b4398d1dd4a0 for instance d60a6e36-4af4-4c66-ad99-2235f9caa594 on hv-cinder-85199 Aug 06 12:32:03.466774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-0783bc4f-12b8-42a0-a53e-4f0de75a0e88 req-e186b48d-faf8-4864-8988-236394c04170 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076401 Aug 06 12:32:03.469936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 126/261] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:32:03.591593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0d27af7d-bdc9-4916-ab92-2fb97db3fa39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:03.606421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0d27af7d-bdc9-4916-ab92-2fb97db3fa39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.269311 Aug 06 12:32:03.608437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 136/262] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:03 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:03.878432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-134809112", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4607ae07-6111-408a-837d-ad8e0cea7b9c"}], "security_groups": [{"name": "tempest-securitygroup--773012981"}], "key_name": "tempest-keypair-1207510847", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:04.020320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] validate_networks() for [('4607ae07-6111-408a-837d-ad8e0cea7b9c', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:32:04.230695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-68d8cf37-ef56-4372-8186-5e9dc7a49ede tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:04.231350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-68d8cf37-ef56-4372-8186-5e9dc7a49ede tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:04.246081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68d8cf37-ef56-4372-8186-5e9dc7a49ede tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:04.247108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68d8cf37-ef56-4372-8186-5e9dc7a49ede tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:04.247784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68d8cf37-ef56-4372-8186-5e9dc7a49ede tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:04.248717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68d8cf37-ef56-4372-8186-5e9dc7a49ede tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:04.249378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68d8cf37-ef56-4372-8186-5e9dc7a49ede tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:04.250076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68d8cf37-ef56-4372-8186-5e9dc7a49ede tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:04.410467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-68d8cf37-ef56-4372-8186-5e9dc7a49ede tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:04.419524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-68d8cf37-ef56-4372-8186-5e9dc7a49ede tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1314 microversion: 2.1 time: 0.192798 Aug 06 12:32:04.420100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 137/263] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:04 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:04.518209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:32:04.518790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:32:04.519271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:32:04.521688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:32:04.522144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:32:04.534419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:04.542464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:04.543198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:04.551771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:04.552458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:04.553079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:04.594981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Getting quotas for project 4931a52d9cda40b89d15804b69b5a2d7. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:32:04.599739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Getting quotas for user 6844f315435f48f68488a2f0459bf155 and project 4931a52d9cda40b89d15804b69b5a2d7. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:32:04.612110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:32:04.614775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:32:04.630820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ae8425b-02cd-43ea-abb1-bd9c95e7f0b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:04.631699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2ae8425b-02cd-43ea-abb1-bd9c95e7f0b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:04.640762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ae8425b-02cd-43ea-abb1-bd9c95e7f0b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:04.640762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ae8425b-02cd-43ea-abb1-bd9c95e7f0b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:04.641738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ae8425b-02cd-43ea-abb1-bd9c95e7f0b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:04.647002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ae8425b-02cd-43ea-abb1-bd9c95e7f0b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:04.647908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ae8425b-02cd-43ea-abb1-bd9c95e7f0b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:04.654803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ae8425b-02cd-43ea-abb1-bd9c95e7f0b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:04.705728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7462fea5-a685-4cf6-a1dd-5c778a312c26 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.831818 Aug 06 12:32:04.716236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 127/264] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:32:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 12:32:04.726849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-56406e16-91b7-4e69-bf1a-d2875f625a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:04.731145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-56406e16-91b7-4e69-bf1a-d2875f625a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:04.833708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-56406e16-91b7-4e69-bf1a-d2875f625a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:04.843350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-56406e16-91b7-4e69-bf1a-d2875f625a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1237 microversion: 2.1 time: 0.124995 Aug 06 12:32:04.849397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 128/265] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:04 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1237 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:04.900520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2ae8425b-02cd-43ea-abb1-bd9c95e7f0b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:04.908388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2ae8425b-02cd-43ea-abb1-bd9c95e7f0b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.281622 Aug 06 12:32:04.908960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 138/266] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:04 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:05.442873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a2e5d76a-d3b2-47f5-b703-1fba81c8c5f9 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:05.443610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a2e5d76a-d3b2-47f5-b703-1fba81c8c5f9 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:05.450694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2e5d76a-d3b2-47f5-b703-1fba81c8c5f9 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:05.451178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2e5d76a-d3b2-47f5-b703-1fba81c8c5f9 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:05.451611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2e5d76a-d3b2-47f5-b703-1fba81c8c5f9 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:05.452400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2e5d76a-d3b2-47f5-b703-1fba81c8c5f9 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:05.452769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2e5d76a-d3b2-47f5-b703-1fba81c8c5f9 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:05.453384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2e5d76a-d3b2-47f5-b703-1fba81c8c5f9 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:05.589225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a2e5d76a-d3b2-47f5-b703-1fba81c8c5f9 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:05.597014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a2e5d76a-d3b2-47f5-b703-1fba81c8c5f9 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1314 microversion: 2.1 time: 0.158831 Aug 06 12:32:05.597592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 129/267] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:05 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:05.865740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6ffbdae6-da05-46e4-9b1e-855df0d0e518 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:05.866366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6ffbdae6-da05-46e4-9b1e-855df0d0e518 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:05.872224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ffbdae6-da05-46e4-9b1e-855df0d0e518 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:05.872750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ffbdae6-da05-46e4-9b1e-855df0d0e518 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:05.873183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ffbdae6-da05-46e4-9b1e-855df0d0e518 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:05.873868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ffbdae6-da05-46e4-9b1e-855df0d0e518 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:05.874345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ffbdae6-da05-46e4-9b1e-855df0d0e518 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:05.874927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ffbdae6-da05-46e4-9b1e-855df0d0e518 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:05.929493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cbef309a-53a2-4a96-9bf4-ad574c0e2e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:05.930093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cbef309a-53a2-4a96-9bf4-ad574c0e2e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:05.936948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbef309a-53a2-4a96-9bf4-ad574c0e2e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:05.937435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbef309a-53a2-4a96-9bf4-ad574c0e2e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:05.938411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbef309a-53a2-4a96-9bf4-ad574c0e2e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:05.939363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbef309a-53a2-4a96-9bf4-ad574c0e2e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:05.939551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbef309a-53a2-4a96-9bf4-ad574c0e2e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:05.939966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbef309a-53a2-4a96-9bf4-ad574c0e2e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:05.941605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6ffbdae6-da05-46e4-9b1e-855df0d0e518 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:05.949423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6ffbdae6-da05-46e4-9b1e-855df0d0e518 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1233 microversion: 2.1 time: 0.087808 Aug 06 12:32:05.960357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 139/268] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:06.109019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cbef309a-53a2-4a96-9bf4-ad574c0e2e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:06.114546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:06.122482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cbef309a-53a2-4a96-9bf4-ad574c0e2e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.196892 Aug 06 12:32:06.123333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 130/269] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:05 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:06.617695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5b84a175-ba58-45db-b83f-dba6943ad89b tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:06.618293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5b84a175-ba58-45db-b83f-dba6943ad89b tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:06.625176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b84a175-ba58-45db-b83f-dba6943ad89b tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:06.625879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b84a175-ba58-45db-b83f-dba6943ad89b tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:06.626343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b84a175-ba58-45db-b83f-dba6943ad89b tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:06.627374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b84a175-ba58-45db-b83f-dba6943ad89b tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:06.627867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b84a175-ba58-45db-b83f-dba6943ad89b tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:06.628316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b84a175-ba58-45db-b83f-dba6943ad89b tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:06.858766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b84a175-ba58-45db-b83f-dba6943ad89b tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:06.867328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5b84a175-ba58-45db-b83f-dba6943ad89b tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1463 microversion: 2.1 time: 0.253651 Aug 06 12:32:06.868238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 140/270] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:06 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1463 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:06.919824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eae546f4-4310-4244-9e4c-d4d5706553fa tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:06.920363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eae546f4-4310-4244-9e4c-d4d5706553fa tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:06.929009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eae546f4-4310-4244-9e4c-d4d5706553fa tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:06.930012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eae546f4-4310-4244-9e4c-d4d5706553fa tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:06.930551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eae546f4-4310-4244-9e4c-d4d5706553fa tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:06.931264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eae546f4-4310-4244-9e4c-d4d5706553fa tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:06.931722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eae546f4-4310-4244-9e4c-d4d5706553fa tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:06.932181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eae546f4-4310-4244-9e4c-d4d5706553fa tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:06.958502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eae546f4-4310-4244-9e4c-d4d5706553fa tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 12:32:06.972793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-befe138e-8c5f-4847-9c2d-e543327ed1e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:06.973423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-befe138e-8c5f-4847-9c2d-e543327ed1e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:06.979236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-befe138e-8c5f-4847-9c2d-e543327ed1e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:06.979714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-befe138e-8c5f-4847-9c2d-e543327ed1e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:06.980142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-befe138e-8c5f-4847-9c2d-e543327ed1e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:06.980855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-befe138e-8c5f-4847-9c2d-e543327ed1e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:06.981302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-befe138e-8c5f-4847-9c2d-e543327ed1e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:06.981720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-befe138e-8c5f-4847-9c2d-e543327ed1e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:07.040488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eae546f4-4310-4244-9e4c-d4d5706553fa tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 204 len: 0 microversion: 2.1 time: 0.124254 Aug 06 12:32:07.041077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 131/271] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:32:06 2022] DELETE /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 12:32:07.050103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0b4d0fc2-695d-45d1-b338-229620b43467 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:07.050340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-befe138e-8c5f-4847-9c2d-e543327ed1e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:07.050780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0b4d0fc2-695d-45d1-b338-229620b43467 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:07.057011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4d0fc2-695d-45d1-b338-229620b43467 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:07.057488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4d0fc2-695d-45d1-b338-229620b43467 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:07.057914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4d0fc2-695d-45d1-b338-229620b43467 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:07.058295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-befe138e-8c5f-4847-9c2d-e543327ed1e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1295 microversion: 2.1 time: 0.089960 Aug 06 12:32:07.058697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4d0fc2-695d-45d1-b338-229620b43467 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:07.063007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 141/272] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:07.063131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4d0fc2-695d-45d1-b338-229620b43467 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:07.063131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4d0fc2-695d-45d1-b338-229620b43467 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:07.146456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6191d182-78ec-4e01-9369-b03777576b8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:07.146986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6191d182-78ec-4e01-9369-b03777576b8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:07.153114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6191d182-78ec-4e01-9369-b03777576b8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:07.153601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6191d182-78ec-4e01-9369-b03777576b8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:07.154026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6191d182-78ec-4e01-9369-b03777576b8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:07.154749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6191d182-78ec-4e01-9369-b03777576b8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:07.155357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6191d182-78ec-4e01-9369-b03777576b8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:07.155929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6191d182-78ec-4e01-9369-b03777576b8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:07.209854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0b4d0fc2-695d-45d1-b338-229620b43467 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:07.217527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0b4d0fc2-695d-45d1-b338-229620b43467 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1469 microversion: 2.1 time: 0.172067 Aug 06 12:32:07.218098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 132/273] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:07 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:07.403552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6191d182-78ec-4e01-9369-b03777576b8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:07.411609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6191d182-78ec-4e01-9369-b03777576b8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.269535 Aug 06 12:32:07.412170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 142/274] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:07 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:08.080172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-41d08a0e-c295-43a5-a965-907c35910135 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:08.080833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-41d08a0e-c295-43a5-a965-907c35910135 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:08.088123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d08a0e-c295-43a5-a965-907c35910135 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:08.088773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d08a0e-c295-43a5-a965-907c35910135 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:08.089342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d08a0e-c295-43a5-a965-907c35910135 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:08.090126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d08a0e-c295-43a5-a965-907c35910135 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:08.090645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d08a0e-c295-43a5-a965-907c35910135 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:08.091137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d08a0e-c295-43a5-a965-907c35910135 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:08.239758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b83ec436-e915-4410-b1ea-798107a19e94 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:08.241341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b83ec436-e915-4410-b1ea-798107a19e94 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:08.248251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b83ec436-e915-4410-b1ea-798107a19e94 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:08.249121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b83ec436-e915-4410-b1ea-798107a19e94 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:08.250128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b83ec436-e915-4410-b1ea-798107a19e94 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:08.251651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b83ec436-e915-4410-b1ea-798107a19e94 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:08.252539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b83ec436-e915-4410-b1ea-798107a19e94 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:08.253393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b83ec436-e915-4410-b1ea-798107a19e94 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:08.259997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-41d08a0e-c295-43a5-a965-907c35910135 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:08.267910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-41d08a0e-c295-43a5-a965-907c35910135 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.192613 Aug 06 12:32:08.268906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 133/275] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:08.417751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b83ec436-e915-4410-b1ea-798107a19e94 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:08.425320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b83ec436-e915-4410-b1ea-798107a19e94 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1469 microversion: 2.1 time: 0.190377 Aug 06 12:32:08.425880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 143/276] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:08 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1469 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:08.432505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d0345ebc-cfc1-4488-9ef1-af051a03f4af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:08.433414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d0345ebc-cfc1-4488-9ef1-af051a03f4af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:08.441538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0345ebc-cfc1-4488-9ef1-af051a03f4af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:08.442093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0345ebc-cfc1-4488-9ef1-af051a03f4af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:08.442594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0345ebc-cfc1-4488-9ef1-af051a03f4af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:08.443339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0345ebc-cfc1-4488-9ef1-af051a03f4af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:08.443860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0345ebc-cfc1-4488-9ef1-af051a03f4af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:08.444489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0345ebc-cfc1-4488-9ef1-af051a03f4af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:08.587423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d0345ebc-cfc1-4488-9ef1-af051a03f4af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:08.596236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d0345ebc-cfc1-4488-9ef1-af051a03f4af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.168231 Aug 06 12:32:08.596838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 134/277] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:08 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:09.150673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-259b547d-2f33-4678-bbd6-87820b89d4c0 req-0a6bbf9c-a373-4017-b092-714bdd09f7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe4447d-8246-4c34-8a89-98d7c5ac616c", "tag": "5c5e32b7-d380-492c-b171-a592fe2514b2"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:09.161059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-259b547d-2f33-4678-bbd6-87820b89d4c0 req-0a6bbf9c-a373-4017-b092-714bdd09f7f5 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:09.161560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-259b547d-2f33-4678-bbd6-87820b89d4c0 req-0a6bbf9c-a373-4017-b092-714bdd09f7f5 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:09.162106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-259b547d-2f33-4678-bbd6-87820b89d4c0 req-0a6bbf9c-a373-4017-b092-714bdd09f7f5 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:09.174095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-259b547d-2f33-4678-bbd6-87820b89d4c0 req-0a6bbf9c-a373-4017-b092-714bdd09f7f5 service nova] Creating event network-changed:5c5e32b7-d380-492c-b171-a592fe2514b2 for instance efe4447d-8246-4c34-8a89-98d7c5ac616c on hv-cinder-85199 Aug 06 12:32:09.179291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-259b547d-2f33-4678-bbd6-87820b89d4c0 req-0a6bbf9c-a373-4017-b092-714bdd09f7f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032123 Aug 06 12:32:09.179888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 144/278] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:32:09.290371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a7d6cea9-1cee-4a87-940a-760c71c82a1f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:09.293121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a7d6cea9-1cee-4a87-940a-760c71c82a1f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:09.300944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7d6cea9-1cee-4a87-940a-760c71c82a1f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:09.301512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7d6cea9-1cee-4a87-940a-760c71c82a1f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:09.302149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7d6cea9-1cee-4a87-940a-760c71c82a1f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:09.302991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7d6cea9-1cee-4a87-940a-760c71c82a1f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:09.303510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7d6cea9-1cee-4a87-940a-760c71c82a1f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:09.303996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7d6cea9-1cee-4a87-940a-760c71c82a1f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:09.449381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8df45e05-efad-4f3e-b65c-eabc17191152 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:09.451242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8df45e05-efad-4f3e-b65c-eabc17191152 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:09.459959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8df45e05-efad-4f3e-b65c-eabc17191152 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:09.460804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8df45e05-efad-4f3e-b65c-eabc17191152 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:09.461461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8df45e05-efad-4f3e-b65c-eabc17191152 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:09.462354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8df45e05-efad-4f3e-b65c-eabc17191152 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:09.462948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8df45e05-efad-4f3e-b65c-eabc17191152 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:09.463509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8df45e05-efad-4f3e-b65c-eabc17191152 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:09.502636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:09.605765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a7d6cea9-1cee-4a87-940a-760c71c82a1f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:09.622624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a7d6cea9-1cee-4a87-940a-760c71c82a1f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.336075 Aug 06 12:32:09.623708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 135/279] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:09.630153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19fa49b9-8c34-4369-b5d0-fec1d3530986 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:09.630966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19fa49b9-8c34-4369-b5d0-fec1d3530986 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:09.643786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19fa49b9-8c34-4369-b5d0-fec1d3530986 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:09.644527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19fa49b9-8c34-4369-b5d0-fec1d3530986 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:09.645125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19fa49b9-8c34-4369-b5d0-fec1d3530986 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:09.645993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19fa49b9-8c34-4369-b5d0-fec1d3530986 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:09.646599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19fa49b9-8c34-4369-b5d0-fec1d3530986 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:09.653279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19fa49b9-8c34-4369-b5d0-fec1d3530986 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:09.811673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8df45e05-efad-4f3e-b65c-eabc17191152 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:09.819469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8df45e05-efad-4f3e-b65c-eabc17191152 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1469 microversion: 2.1 time: 0.376867 Aug 06 12:32:09.820363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 145/280] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:09 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1469 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:10.010939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-19fa49b9-8c34-4369-b5d0-fec1d3530986 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:10.020025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19fa49b9-8c34-4369-b5d0-fec1d3530986 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.395034 Aug 06 12:32:10.032614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 136/281] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:09 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:10.642922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c3d8fca9-412c-43fc-8780-496c73e293ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:10.643547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c3d8fca9-412c-43fc-8780-496c73e293ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:10.649456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3d8fca9-412c-43fc-8780-496c73e293ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:10.649965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3d8fca9-412c-43fc-8780-496c73e293ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:10.650393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3d8fca9-412c-43fc-8780-496c73e293ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:10.651070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3d8fca9-412c-43fc-8780-496c73e293ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:10.651519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3d8fca9-412c-43fc-8780-496c73e293ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:10.651940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3d8fca9-412c-43fc-8780-496c73e293ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:10.789703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c3d8fca9-412c-43fc-8780-496c73e293ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:10.799136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c3d8fca9-412c-43fc-8780-496c73e293ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.160034 Aug 06 12:32:10.811010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 146/282] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:10.840693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:10.841299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:10.848891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:10.849472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:10.850033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:10.850896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:10.851499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:10.852004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:10.883610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:10.884092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:10.884545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:10.885008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lazy-loading 'fault' on Instance uuid d60a6e36-4af4-4c66-ad99-2235f9caa594 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:32:10.929240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:10.936486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5a7b467a-2a74-4fc0-926f-a8d25bd2983d tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1304 microversion: 2.1 time: 0.099655 Aug 06 12:32:10.937048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 137/283] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:10 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:11.052870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a20d8c7-949a-4086-a6c3-fa09bf79bf81 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:11.054359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6a20d8c7-949a-4086-a6c3-fa09bf79bf81 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:11.055308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:11.060580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a20d8c7-949a-4086-a6c3-fa09bf79bf81 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:11.061059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a20d8c7-949a-4086-a6c3-fa09bf79bf81 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:11.061492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a20d8c7-949a-4086-a6c3-fa09bf79bf81 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:11.062176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a20d8c7-949a-4086-a6c3-fa09bf79bf81 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:11.062624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a20d8c7-949a-4086-a6c3-fa09bf79bf81 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:11.063045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a20d8c7-949a-4086-a6c3-fa09bf79bf81 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:11.197277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-8e9f3831-6394-4f79-9287-fd4245ab3fa5 req-e0238e5c-1e20-4c6f-831a-527faa1f9248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60a6e36-4af4-4c66-ad99-2235f9caa594", "name": "network-vif-deleted", "tag": "72678e85-00a6-4aaa-af3c-b4398d1dd4a0"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:11.201681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6a20d8c7-949a-4086-a6c3-fa09bf79bf81 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:11.206565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8e9f3831-6394-4f79-9287-fd4245ab3fa5 req-e0238e5c-1e20-4c6f-831a-527faa1f9248 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:11.207037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8e9f3831-6394-4f79-9287-fd4245ab3fa5 req-e0238e5c-1e20-4c6f-831a-527faa1f9248 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:11.207459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8e9f3831-6394-4f79-9287-fd4245ab3fa5 req-e0238e5c-1e20-4c6f-831a-527faa1f9248 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:11.209314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6a20d8c7-949a-4086-a6c3-fa09bf79bf81 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.160303 Aug 06 12:32:11.209883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 147/284] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:11 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:11.219902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-8e9f3831-6394-4f79-9287-fd4245ab3fa5 req-e0238e5c-1e20-4c6f-831a-527faa1f9248 service nova] Creating event network-vif-deleted:72678e85-00a6-4aaa-af3c-b4398d1dd4a0 for instance d60a6e36-4af4-4c66-ad99-2235f9caa594 on hv-cinder-85199 Aug 06 12:32:11.225488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-8e9f3831-6394-4f79-9287-fd4245ab3fa5 req-e0238e5c-1e20-4c6f-831a-527faa1f9248 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031739 Aug 06 12:32:11.226274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 138/285] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:32:11.819444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-785d5d04-2f35-4eb7-910b-4dd3a55b904b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:11.819931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-785d5d04-2f35-4eb7-910b-4dd3a55b904b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:11.825889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-785d5d04-2f35-4eb7-910b-4dd3a55b904b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:11.826361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-785d5d04-2f35-4eb7-910b-4dd3a55b904b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:11.826784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-785d5d04-2f35-4eb7-910b-4dd3a55b904b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:11.827464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-785d5d04-2f35-4eb7-910b-4dd3a55b904b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:11.827904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-785d5d04-2f35-4eb7-910b-4dd3a55b904b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:11.828346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-785d5d04-2f35-4eb7-910b-4dd3a55b904b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:11.959257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:11.960085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:11.965131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-785d5d04-2f35-4eb7-910b-4dd3a55b904b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:11.966287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:11.966766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:11.967200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:11.967887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:11.968365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:11.968789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:11.973117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-785d5d04-2f35-4eb7-910b-4dd3a55b904b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.157829 Aug 06 12:32:11.973671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 148/286] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:12.000022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:12.000531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:12.000958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:12.001396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lazy-loading 'fault' on Instance uuid d60a6e36-4af4-4c66-ad99-2235f9caa594 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:32:12.043634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:12.051080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-03d03902-1cd6-4422-b60e-3746881e1f91 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1304 microversion: 2.1 time: 0.097027 Aug 06 12:32:12.051645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 139/287] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:11 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:12.233191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-220d14d4-d892-4cf8-aec3-373639ebc0c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:12.233708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-220d14d4-d892-4cf8-aec3-373639ebc0c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:12.240185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-220d14d4-d892-4cf8-aec3-373639ebc0c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:12.240696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-220d14d4-d892-4cf8-aec3-373639ebc0c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:12.241125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-220d14d4-d892-4cf8-aec3-373639ebc0c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:12.241821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-220d14d4-d892-4cf8-aec3-373639ebc0c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:12.242269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-220d14d4-d892-4cf8-aec3-373639ebc0c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:12.242694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-220d14d4-d892-4cf8-aec3-373639ebc0c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:12.376830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-220d14d4-d892-4cf8-aec3-373639ebc0c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:12.384105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-220d14d4-d892-4cf8-aec3-373639ebc0c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.154882 Aug 06 12:32:12.384706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 149/288] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:12 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:12.994231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2fbd1d6c-dd57-4168-80d4-f307ffb35d0b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:12.994999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2fbd1d6c-dd57-4168-80d4-f307ffb35d0b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:13.002139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fbd1d6c-dd57-4168-80d4-f307ffb35d0b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:13.002487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fbd1d6c-dd57-4168-80d4-f307ffb35d0b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:13.002936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fbd1d6c-dd57-4168-80d4-f307ffb35d0b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:13.003673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fbd1d6c-dd57-4168-80d4-f307ffb35d0b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:13.004129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fbd1d6c-dd57-4168-80d4-f307ffb35d0b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:13.004586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fbd1d6c-dd57-4168-80d4-f307ffb35d0b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:13.071192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:13.071792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:13.077645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:13.078125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:13.078553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:13.079240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:13.079688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:13.080103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:13.112356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:13.112846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:13.113353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:13.113843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lazy-loading 'fault' on Instance uuid d60a6e36-4af4-4c66-ad99-2235f9caa594 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:32:13.144399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2fbd1d6c-dd57-4168-80d4-f307ffb35d0b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:13.152259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2fbd1d6c-dd57-4168-80d4-f307ffb35d0b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.162221 Aug 06 12:32:13.152982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 140/289] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:13.161420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36ce80ae6a942f1866cd2b0a5fe4c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cbbde8a7a342d6a74e14d9010e91e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:13.168717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-343407a0-0133-4ac6-bbad-5205a32aadbc tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 200 len: 1304 microversion: 2.1 time: 0.101608 Aug 06 12:32:13.169269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 150/290] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:13 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:13.405922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90a60392-7491-4f97-ad65-dbc8f804b4cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:13.406442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90a60392-7491-4f97-ad65-dbc8f804b4cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:13.413066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90a60392-7491-4f97-ad65-dbc8f804b4cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:13.413529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90a60392-7491-4f97-ad65-dbc8f804b4cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:13.413966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90a60392-7491-4f97-ad65-dbc8f804b4cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:13.414649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90a60392-7491-4f97-ad65-dbc8f804b4cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:13.415099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90a60392-7491-4f97-ad65-dbc8f804b4cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:13.415523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90a60392-7491-4f97-ad65-dbc8f804b4cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:13.545424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90a60392-7491-4f97-ad65-dbc8f804b4cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:13.552877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90a60392-7491-4f97-ad65-dbc8f804b4cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.151179 Aug 06 12:32:13.553439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 141/291] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:13 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:14.173908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-49d0fc27-2c55-4bc4-a3ee-d5bcaf136bf5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:14.174452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-49d0fc27-2c55-4bc4-a3ee-d5bcaf136bf5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:14.180379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49d0fc27-2c55-4bc4-a3ee-d5bcaf136bf5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:14.180856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49d0fc27-2c55-4bc4-a3ee-d5bcaf136bf5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:14.181283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49d0fc27-2c55-4bc4-a3ee-d5bcaf136bf5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:14.181960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49d0fc27-2c55-4bc4-a3ee-d5bcaf136bf5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:14.182406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49d0fc27-2c55-4bc4-a3ee-d5bcaf136bf5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:14.182825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49d0fc27-2c55-4bc4-a3ee-d5bcaf136bf5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:14.190990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:14.191597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] [instance: d60a6e36-4af4-4c66-ad99-2235f9caa594] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:14.198011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:14.198499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:14.198977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:14.199676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:14.200192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:14.200649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:14.216527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] HTTP exception thrown: Instance d60a6e36-4af4-4c66-ad99-2235f9caa594 could not be found. Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Request method failure captured: Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 HTTP/1.1 Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l8uDAgOect9UnPBwqDIwRdRiL17LDoeRDdVLdDCql5-T_qPqkElpCcRkNlMt5x243T-BbKGV6YU-u0cZAP0ioOFfuC4u_mEz2PETeVOGG90OwfEGutgLCPmueZGK0Zi5jBxz9_z-DIBdCdVCO7T0ZZQeuMsvHv8LqAAekisXjBTSw8 Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: c1cbbde8a7a342d6a74e14d9010e91e0 Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesNegativeTest-2145678974 Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:32:14.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c1cbbde8a7a342d6a74e14d9010e91e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c1cbbde8a7a342d6a74e14d9010e91e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c1cbbde8a7a342d6a74e14d9010e91e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c1cbbde8a7a342d6a74e14d9010e91e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesNegativeTest-2145678974 Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: c1cbbde8a7a342d6a74e14d9010e91e0 Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesNegativeTest-2145678974 Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesNegativeTest-2145678974-project Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: d36ce80ae6a942f1866cd2b0a5fe4c01 Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesNegativeTest-2145678974-project Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance d60a6e36-4af4-4c66-ad99-2235f9caa594 could not be found. Aug 06 12:32:14.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'd60a6e36-4af4-4c66-ad99-2235f9caa594'} Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d60a6e36-4af4-4c66-ad99-2235f9caa594 could not be found. Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:32:14.220234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60a6e36-4af4-4c66-ad99-2235f9caa594 could not be found. Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60a6e36-4af4-4c66-ad99-2235f9caa594 could not be found. Aug 06 12:32:14.221625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:32:14.222567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] Returning 404 to user: Instance d60a6e36-4af4-4c66-ad99-2235f9caa594 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:32:14.222567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e5a88cb-e7b6-406b-8a5f-60e22565ffd0 tempest-VolumesNegativeTest-2145678974 tempest-VolumesNegativeTest-2145678974-project] 10.222.0.20 "GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594" status: 404 len: 111 microversion: 2.1 time: 0.033448 Aug 06 12:32:14.222567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 142/292] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:14 2022] GET /compute/v2.1/servers/d60a6e36-4af4-4c66-ad99-2235f9caa594 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 12:32:14.318057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-49d0fc27-2c55-4bc4-a3ee-d5bcaf136bf5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:14.325427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-49d0fc27-2c55-4bc4-a3ee-d5bcaf136bf5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.155963 Aug 06 12:32:14.325980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 151/293] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:14.573932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5a3e3883-9340-4036-9295-1341e7a0b8fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:14.574614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5a3e3883-9340-4036-9295-1341e7a0b8fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:14.576634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:14.582269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a3e3883-9340-4036-9295-1341e7a0b8fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:14.582751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a3e3883-9340-4036-9295-1341e7a0b8fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:14.583187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a3e3883-9340-4036-9295-1341e7a0b8fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:14.583878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a3e3883-9340-4036-9295-1341e7a0b8fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:14.584352 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a3e3883-9340-4036-9295-1341e7a0b8fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:14.584814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a3e3883-9340-4036-9295-1341e7a0b8fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:14.727539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5a3e3883-9340-4036-9295-1341e7a0b8fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:14.736362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5a3e3883-9340-4036-9295-1341e7a0b8fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.165746 Aug 06 12:32:14.736925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 143/294] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:14 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:15.347088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f434e31f-234b-4db6-876c-0d020622fee2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:15.348679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f434e31f-234b-4db6-876c-0d020622fee2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:15.351490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:15.357499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f434e31f-234b-4db6-876c-0d020622fee2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:15.358160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f434e31f-234b-4db6-876c-0d020622fee2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:15.358669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f434e31f-234b-4db6-876c-0d020622fee2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:15.360220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f434e31f-234b-4db6-876c-0d020622fee2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:15.360764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f434e31f-234b-4db6-876c-0d020622fee2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:15.361380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f434e31f-234b-4db6-876c-0d020622fee2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:15.509262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f434e31f-234b-4db6-876c-0d020622fee2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:15.517373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f434e31f-234b-4db6-876c-0d020622fee2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.173856 Aug 06 12:32:15.517926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 152/295] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:15.761889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4aa8c936-065e-4439-86d4-bc8f17a4751d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:15.764825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4aa8c936-065e-4439-86d4-bc8f17a4751d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:15.767897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=8 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:15.772319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4aa8c936-065e-4439-86d4-bc8f17a4751d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:15.772833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4aa8c936-065e-4439-86d4-bc8f17a4751d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:15.773271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4aa8c936-065e-4439-86d4-bc8f17a4751d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:15.773972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4aa8c936-065e-4439-86d4-bc8f17a4751d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:15.774417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4aa8c936-065e-4439-86d4-bc8f17a4751d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:15.775026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4aa8c936-065e-4439-86d4-bc8f17a4751d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:15.920850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4aa8c936-065e-4439-86d4-bc8f17a4751d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:15.931895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4aa8c936-065e-4439-86d4-bc8f17a4751d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.176880 Aug 06 12:32:15.932987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 144/296] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:15 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:16.538863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4aa1fb4e-c08d-43b2-8ae1-939358bec240 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:16.539494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4aa1fb4e-c08d-43b2-8ae1-939358bec240 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:16.545469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aa1fb4e-c08d-43b2-8ae1-939358bec240 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:16.545945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aa1fb4e-c08d-43b2-8ae1-939358bec240 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:16.546373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aa1fb4e-c08d-43b2-8ae1-939358bec240 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:16.547053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aa1fb4e-c08d-43b2-8ae1-939358bec240 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:16.547503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aa1fb4e-c08d-43b2-8ae1-939358bec240 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:16.547923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aa1fb4e-c08d-43b2-8ae1-939358bec240 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:16.689380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4aa1fb4e-c08d-43b2-8ae1-939358bec240 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:16.697190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4aa1fb4e-c08d-43b2-8ae1-939358bec240 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.162640 Aug 06 12:32:16.697762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 153/297] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:16.952854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d653c7e-20f2-4618-8e7f-167c465a4494 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:16.953456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d653c7e-20f2-4618-8e7f-167c465a4494 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:16.959724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d653c7e-20f2-4618-8e7f-167c465a4494 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:16.960197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d653c7e-20f2-4618-8e7f-167c465a4494 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:16.960659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d653c7e-20f2-4618-8e7f-167c465a4494 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:16.961331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d653c7e-20f2-4618-8e7f-167c465a4494 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:16.961776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d653c7e-20f2-4618-8e7f-167c465a4494 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:16.962202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d653c7e-20f2-4618-8e7f-167c465a4494 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:17.105414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d653c7e-20f2-4618-8e7f-167c465a4494 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:17.118725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d653c7e-20f2-4618-8e7f-167c465a4494 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.169585 Aug 06 12:32:17.119299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 145/298] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:16 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:17.606879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-fffeec8c-639a-4475-8eb3-57f9e2310532 req-749093b1-406a-4f12-b4c3-dd40aad00ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe4447d-8246-4c34-8a89-98d7c5ac616c", "name": "network-vif-plugged", "status": "completed", "tag": "5c5e32b7-d380-492c-b171-a592fe2514b2"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:17.625656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-fffeec8c-639a-4475-8eb3-57f9e2310532 req-749093b1-406a-4f12-b4c3-dd40aad00ca7 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:17.626266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-fffeec8c-639a-4475-8eb3-57f9e2310532 req-749093b1-406a-4f12-b4c3-dd40aad00ca7 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:17.626951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-fffeec8c-639a-4475-8eb3-57f9e2310532 req-749093b1-406a-4f12-b4c3-dd40aad00ca7 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:17.638759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-fffeec8c-639a-4475-8eb3-57f9e2310532 req-749093b1-406a-4f12-b4c3-dd40aad00ca7 service nova] Creating event network-vif-plugged:5c5e32b7-d380-492c-b171-a592fe2514b2 for instance efe4447d-8246-4c34-8a89-98d7c5ac616c on hv-cinder-85199 Aug 06 12:32:17.644352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-fffeec8c-639a-4475-8eb3-57f9e2310532 req-749093b1-406a-4f12-b4c3-dd40aad00ca7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041232 Aug 06 12:32:17.644921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 154/299] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:32:17.723348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e271ff6d-fad8-49f9-987c-27fa68b35a70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:17.723348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e271ff6d-fad8-49f9-987c-27fa68b35a70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:17.727440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e271ff6d-fad8-49f9-987c-27fa68b35a70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:17.728258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e271ff6d-fad8-49f9-987c-27fa68b35a70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:17.728993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e271ff6d-fad8-49f9-987c-27fa68b35a70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:17.730119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e271ff6d-fad8-49f9-987c-27fa68b35a70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:17.730825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e271ff6d-fad8-49f9-987c-27fa68b35a70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:17.731323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e271ff6d-fad8-49f9-987c-27fa68b35a70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:17.764958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:17.922797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e271ff6d-fad8-49f9-987c-27fa68b35a70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:17.935171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e271ff6d-fad8-49f9-987c-27fa68b35a70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.221194 Aug 06 12:32:17.935939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 146/300] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:18.139588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4ed338b-def5-4a40-888d-d56739ca36c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:18.140345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d4ed338b-def5-4a40-888d-d56739ca36c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:18.148526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ed338b-def5-4a40-888d-d56739ca36c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:18.149031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ed338b-def5-4a40-888d-d56739ca36c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:18.149441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ed338b-def5-4a40-888d-d56739ca36c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:18.150291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ed338b-def5-4a40-888d-d56739ca36c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:18.150775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ed338b-def5-4a40-888d-d56739ca36c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:18.151227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ed338b-def5-4a40-888d-d56739ca36c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:18.312345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d4ed338b-def5-4a40-888d-d56739ca36c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:18.321017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d4ed338b-def5-4a40-888d-d56739ca36c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.185570 Aug 06 12:32:18.321898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 155/301] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:18 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:18.961014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e1719854-20f8-4238-9d1e-30e71e337210 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:18.961622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e1719854-20f8-4238-9d1e-30e71e337210 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:18.963932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:18.969017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e1719854-20f8-4238-9d1e-30e71e337210 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:18.969499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e1719854-20f8-4238-9d1e-30e71e337210 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:18.969929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e1719854-20f8-4238-9d1e-30e71e337210 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:18.970612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e1719854-20f8-4238-9d1e-30e71e337210 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:18.971059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e1719854-20f8-4238-9d1e-30e71e337210 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:18.971481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e1719854-20f8-4238-9d1e-30e71e337210 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:19.102790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e1719854-20f8-4238-9d1e-30e71e337210 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:19.110470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e1719854-20f8-4238-9d1e-30e71e337210 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.153314 Aug 06 12:32:19.111150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 147/302] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:18 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:19.342862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9cca2ea6-7e22-47ee-8620-f37d0a3b1369 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:19.343488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9cca2ea6-7e22-47ee-8620-f37d0a3b1369 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:19.350054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cca2ea6-7e22-47ee-8620-f37d0a3b1369 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:19.350528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cca2ea6-7e22-47ee-8620-f37d0a3b1369 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:19.350951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cca2ea6-7e22-47ee-8620-f37d0a3b1369 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:19.351624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cca2ea6-7e22-47ee-8620-f37d0a3b1369 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:19.352064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cca2ea6-7e22-47ee-8620-f37d0a3b1369 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:19.352507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cca2ea6-7e22-47ee-8620-f37d0a3b1369 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:19.483354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9cca2ea6-7e22-47ee-8620-f37d0a3b1369 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:19.490958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9cca2ea6-7e22-47ee-8620-f37d0a3b1369 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.151997 Aug 06 12:32:19.491507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 156/303] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:19 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:20.137031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-978dd16e-1e7a-44c8-ac65-1f5cadca7004 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:20.137780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-978dd16e-1e7a-44c8-ac65-1f5cadca7004 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:20.144252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-978dd16e-1e7a-44c8-ac65-1f5cadca7004 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:20.144766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-978dd16e-1e7a-44c8-ac65-1f5cadca7004 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:20.145223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-978dd16e-1e7a-44c8-ac65-1f5cadca7004 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:20.146046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-978dd16e-1e7a-44c8-ac65-1f5cadca7004 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:20.146506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-978dd16e-1e7a-44c8-ac65-1f5cadca7004 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:20.147056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-978dd16e-1e7a-44c8-ac65-1f5cadca7004 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:20.290114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-978dd16e-1e7a-44c8-ac65-1f5cadca7004 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:20.298500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-978dd16e-1e7a-44c8-ac65-1f5cadca7004 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1362 microversion: 2.1 time: 0.166188 Aug 06 12:32:20.299227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 148/304] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:20.512645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5a1d07fe-16a5-43e5-b3c7-9eaee4d406c8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:20.513400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5a1d07fe-16a5-43e5-b3c7-9eaee4d406c8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:20.521172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1d07fe-16a5-43e5-b3c7-9eaee4d406c8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:20.521922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1d07fe-16a5-43e5-b3c7-9eaee4d406c8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:20.522518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1d07fe-16a5-43e5-b3c7-9eaee4d406c8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:20.523387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1d07fe-16a5-43e5-b3c7-9eaee4d406c8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:20.523996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1d07fe-16a5-43e5-b3c7-9eaee4d406c8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:20.524679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1d07fe-16a5-43e5-b3c7-9eaee4d406c8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:20.662992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5a1d07fe-16a5-43e5-b3c7-9eaee4d406c8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:20.670315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5a1d07fe-16a5-43e5-b3c7-9eaee4d406c8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1502 microversion: 2.1 time: 0.162335 Aug 06 12:32:20.670866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 157/305] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:20 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:20.691226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cb43721-ec8d-4f85-9dce-5d226a32ce9b"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:20.693713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:20.700839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:20.701333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:20.701772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:20.702475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:20.702932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:20.703364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:20.726672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Cannot 'attach_volume' instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 while it is in vm_state rescued Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: POST /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88/os-volume_attachments HTTP/1.1 Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 74 Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:32:20.728255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {"volumeAttachment": {"volumeId": "4cb43721-ec8d-4f85-9dce-5d226a32ce9b"}} Aug 06 12:32:20.729738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Cannot 'attach_volume' instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 while it is in vm_state rescued Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88', 'body': {'volumeAttachment': {'volumeId': '4cb43721-ec8d-4f85-9dce-5d226a32ce9b'}}} Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:32:20.730919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 while it is in vm_state rescued Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:32:20.732217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:32:20.734157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:32:20.734157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:32:20.734157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 while it is in vm_state rescued Aug 06 12:32:20.734157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:32:20.734157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 409 to user: Cannot 'attach_volume' instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 while it is in vm_state rescued {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:32:20.734157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e4742e08-8049-4225-bc4f-87af7d6cc270 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042504 Aug 06 12:32:20.734157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 149/306] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 12:32:20 2022] POST /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 12:32:20.739283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3940bbee-c634-4585-9ee1-6705896602e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:20.740061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3940bbee-c634-4585-9ee1-6705896602e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:20.745924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3940bbee-c634-4585-9ee1-6705896602e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:20.746403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3940bbee-c634-4585-9ee1-6705896602e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:20.746827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3940bbee-c634-4585-9ee1-6705896602e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:20.747508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3940bbee-c634-4585-9ee1-6705896602e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:20.747950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3940bbee-c634-4585-9ee1-6705896602e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:20.748394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3940bbee-c634-4585-9ee1-6705896602e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:20.819557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3940bbee-c634-4585-9ee1-6705896602e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88/action" status: 202 len: 0 microversion: 2.1 time: 0.083817 Aug 06 12:32:20.820375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 158/307] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 12:32:20 2022] POST /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:32:20.829103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e393f2a-0878-41c9-9606-32dfb2026784 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:20.830011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1e393f2a-0878-41c9-9606-32dfb2026784 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:20.836365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e393f2a-0878-41c9-9606-32dfb2026784 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:20.836841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e393f2a-0878-41c9-9606-32dfb2026784 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:20.837345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e393f2a-0878-41c9-9606-32dfb2026784 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:20.838029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e393f2a-0878-41c9-9606-32dfb2026784 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:20.838482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e393f2a-0878-41c9-9606-32dfb2026784 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:20.838899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e393f2a-0878-41c9-9606-32dfb2026784 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:20.982015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1e393f2a-0878-41c9-9606-32dfb2026784 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:20.989600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1e393f2a-0878-41c9-9606-32dfb2026784 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.164669 Aug 06 12:32:20.990511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 150/308] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:20 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:21.320606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2d483b51-9814-4464-8e84-bdde5512b568 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:21.321300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2d483b51-9814-4464-8e84-bdde5512b568 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:21.327307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d483b51-9814-4464-8e84-bdde5512b568 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:21.327791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d483b51-9814-4464-8e84-bdde5512b568 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:21.328232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d483b51-9814-4464-8e84-bdde5512b568 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:21.329083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d483b51-9814-4464-8e84-bdde5512b568 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:21.329585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d483b51-9814-4464-8e84-bdde5512b568 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:21.330659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d483b51-9814-4464-8e84-bdde5512b568 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:21.470490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2d483b51-9814-4464-8e84-bdde5512b568 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:21.478365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2d483b51-9814-4464-8e84-bdde5512b568 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1548 microversion: 2.1 time: 0.162324 Aug 06 12:32:21.478920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 159/309] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:21 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:21.499264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e4a021d6-47e2-4820-aa40-db5dfe9efd34 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:21.499747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e4a021d6-47e2-4820-aa40-db5dfe9efd34 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:21.506002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a021d6-47e2-4820-aa40-db5dfe9efd34 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:21.506482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a021d6-47e2-4820-aa40-db5dfe9efd34 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:21.506913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a021d6-47e2-4820-aa40-db5dfe9efd34 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:21.507593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a021d6-47e2-4820-aa40-db5dfe9efd34 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:21.508042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a021d6-47e2-4820-aa40-db5dfe9efd34 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:21.508495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a021d6-47e2-4820-aa40-db5dfe9efd34 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:21.588620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e4a021d6-47e2-4820-aa40-db5dfe9efd34 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093066 Aug 06 12:32:21.589219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 151/310] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Aug 6 12:32:21 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:32:22.011302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c7493bc0-8ca5-43b4-8046-6c0d6e1033e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:22.012007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c7493bc0-8ca5-43b4-8046-6c0d6e1033e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:22.018440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7493bc0-8ca5-43b4-8046-6c0d6e1033e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:22.018960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7493bc0-8ca5-43b4-8046-6c0d6e1033e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:22.019463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7493bc0-8ca5-43b4-8046-6c0d6e1033e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:22.020206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7493bc0-8ca5-43b4-8046-6c0d6e1033e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:22.020739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7493bc0-8ca5-43b4-8046-6c0d6e1033e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:22.021210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7493bc0-8ca5-43b4-8046-6c0d6e1033e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:22.166895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c7493bc0-8ca5-43b4-8046-6c0d6e1033e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:22.174990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c7493bc0-8ca5-43b4-8046-6c0d6e1033e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.167681 Aug 06 12:32:22.175558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 160/311] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:22 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:23.196495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bfc13aac-246b-435e-945d-b47c56b9085b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:23.197107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bfc13aac-246b-435e-945d-b47c56b9085b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:23.203258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc13aac-246b-435e-945d-b47c56b9085b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:23.203814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc13aac-246b-435e-945d-b47c56b9085b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:23.204592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc13aac-246b-435e-945d-b47c56b9085b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:23.212098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc13aac-246b-435e-945d-b47c56b9085b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:23.212737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc13aac-246b-435e-945d-b47c56b9085b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:23.213255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc13aac-246b-435e-945d-b47c56b9085b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:23.707390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bfc13aac-246b-435e-945d-b47c56b9085b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:23.714818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bfc13aac-246b-435e-945d-b47c56b9085b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.522958 Aug 06 12:32:23.715525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 152/312] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:23 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:23.850428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-2087c7aa-b207-479b-9380-b292b815b81a req-694fbbb6-1ca1-4543-876e-f42b2e8b3765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe4447d-8246-4c34-8a89-98d7c5ac616c", "tag": "5c5e32b7-d380-492c-b171-a592fe2514b2"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:23.859483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-2087c7aa-b207-479b-9380-b292b815b81a req-694fbbb6-1ca1-4543-876e-f42b2e8b3765 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:23.859882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-2087c7aa-b207-479b-9380-b292b815b81a req-694fbbb6-1ca1-4543-876e-f42b2e8b3765 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:23.860312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-2087c7aa-b207-479b-9380-b292b815b81a req-694fbbb6-1ca1-4543-876e-f42b2e8b3765 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:23.863382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:23.873741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-2087c7aa-b207-479b-9380-b292b815b81a req-694fbbb6-1ca1-4543-876e-f42b2e8b3765 service nova] Creating event network-changed:5c5e32b7-d380-492c-b171-a592fe2514b2 for instance efe4447d-8246-4c34-8a89-98d7c5ac616c on hv-cinder-85199 Aug 06 12:32:23.879241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-2087c7aa-b207-479b-9380-b292b815b81a req-694fbbb6-1ca1-4543-876e-f42b2e8b3765 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032544 Aug 06 12:32:23.879825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 161/313] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:32:24.737003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5b16a872-88b3-42ac-99e2-16b6c5e929ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:24.737606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5b16a872-88b3-42ac-99e2-16b6c5e929ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:24.744005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b16a872-88b3-42ac-99e2-16b6c5e929ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:24.744516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b16a872-88b3-42ac-99e2-16b6c5e929ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:24.744953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b16a872-88b3-42ac-99e2-16b6c5e929ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:24.745639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b16a872-88b3-42ac-99e2-16b6c5e929ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:24.746153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b16a872-88b3-42ac-99e2-16b6c5e929ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:24.746515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b16a872-88b3-42ac-99e2-16b6c5e929ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:24.882417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b16a872-88b3-42ac-99e2-16b6c5e929ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:24.890313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5b16a872-88b3-42ac-99e2-16b6c5e929ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.157709 Aug 06 12:32:24.890953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 153/314] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:24 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:25.912952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9de0bf7c-f19e-41a7-a21d-a739585bb132 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:25.913567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9de0bf7c-f19e-41a7-a21d-a739585bb132 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:25.919816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9de0bf7c-f19e-41a7-a21d-a739585bb132 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:25.920321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9de0bf7c-f19e-41a7-a21d-a739585bb132 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:25.920750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9de0bf7c-f19e-41a7-a21d-a739585bb132 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:25.921429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9de0bf7c-f19e-41a7-a21d-a739585bb132 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:25.921879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9de0bf7c-f19e-41a7-a21d-a739585bb132 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:25.922300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9de0bf7c-f19e-41a7-a21d-a739585bb132 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:26.052153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9de0bf7c-f19e-41a7-a21d-a739585bb132 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:26.059495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9de0bf7c-f19e-41a7-a21d-a739585bb132 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.151988 Aug 06 12:32:26.060048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 162/315] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:25 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:27.079811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3224333c-2b30-49d3-9ccc-3a2963c0df7a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:27.080378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3224333c-2b30-49d3-9ccc-3a2963c0df7a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:27.088211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3224333c-2b30-49d3-9ccc-3a2963c0df7a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:27.088211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3224333c-2b30-49d3-9ccc-3a2963c0df7a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:27.088483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3224333c-2b30-49d3-9ccc-3a2963c0df7a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:27.089176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3224333c-2b30-49d3-9ccc-3a2963c0df7a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:27.089629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3224333c-2b30-49d3-9ccc-3a2963c0df7a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:27.090054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3224333c-2b30-49d3-9ccc-3a2963c0df7a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:27.219532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3224333c-2b30-49d3-9ccc-3a2963c0df7a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:27.226889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3224333c-2b30-49d3-9ccc-3a2963c0df7a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.151030 Aug 06 12:32:27.227447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 154/316] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:27 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:28.247536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac056ad4-8044-462c-ab35-1c7adfec01ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:28.248135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac056ad4-8044-462c-ab35-1c7adfec01ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:28.254721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac056ad4-8044-462c-ab35-1c7adfec01ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:28.255138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac056ad4-8044-462c-ab35-1c7adfec01ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:28.255562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac056ad4-8044-462c-ab35-1c7adfec01ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:28.256242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac056ad4-8044-462c-ab35-1c7adfec01ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:28.256701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac056ad4-8044-462c-ab35-1c7adfec01ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:28.257123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac056ad4-8044-462c-ab35-1c7adfec01ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:28.388792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ac056ad4-8044-462c-ab35-1c7adfec01ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:28.396816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac056ad4-8044-462c-ab35-1c7adfec01ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.153050 Aug 06 12:32:28.397425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 163/317] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:28 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:29.417869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-88a71835-2d9e-4868-8550-ca6b99ab5d2a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:29.418512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-88a71835-2d9e-4868-8550-ca6b99ab5d2a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:29.425696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88a71835-2d9e-4868-8550-ca6b99ab5d2a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:29.426180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88a71835-2d9e-4868-8550-ca6b99ab5d2a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:29.426624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88a71835-2d9e-4868-8550-ca6b99ab5d2a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:29.427312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88a71835-2d9e-4868-8550-ca6b99ab5d2a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:29.427770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88a71835-2d9e-4868-8550-ca6b99ab5d2a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:29.428195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88a71835-2d9e-4868-8550-ca6b99ab5d2a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:29.553745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-88a71835-2d9e-4868-8550-ca6b99ab5d2a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:29.561101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-88a71835-2d9e-4868-8550-ca6b99ab5d2a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.147108 Aug 06 12:32:29.561686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 155/318] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:29 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:30.582300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f629630d-9a0c-447d-b9a3-76c63662084f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:30.582893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f629630d-9a0c-447d-b9a3-76c63662084f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:30.588778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f629630d-9a0c-447d-b9a3-76c63662084f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:30.589245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f629630d-9a0c-447d-b9a3-76c63662084f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:30.589669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f629630d-9a0c-447d-b9a3-76c63662084f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:30.590338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f629630d-9a0c-447d-b9a3-76c63662084f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:30.590778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f629630d-9a0c-447d-b9a3-76c63662084f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:30.591191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f629630d-9a0c-447d-b9a3-76c63662084f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:30.853048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f629630d-9a0c-447d-b9a3-76c63662084f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:30.860612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f629630d-9a0c-447d-b9a3-76c63662084f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.282058 Aug 06 12:32:30.861625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 164/319] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:30 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:31.882005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-17ba7351-416b-42b7-8131-36b116fdb704 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:31.883155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-17ba7351-416b-42b7-8131-36b116fdb704 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:31.889782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17ba7351-416b-42b7-8131-36b116fdb704 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:31.890274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17ba7351-416b-42b7-8131-36b116fdb704 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:31.890763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17ba7351-416b-42b7-8131-36b116fdb704 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:31.891405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17ba7351-416b-42b7-8131-36b116fdb704 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:31.892730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17ba7351-416b-42b7-8131-36b116fdb704 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:31.893164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17ba7351-416b-42b7-8131-36b116fdb704 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:32.046740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-17ba7351-416b-42b7-8131-36b116fdb704 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:32.054156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-17ba7351-416b-42b7-8131-36b116fdb704 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.176186 Aug 06 12:32:32.054719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 156/320] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:31 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:33.074860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-34f629a5-24ab-424a-a0d3-8c7ecfc5e7a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:33.075462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-34f629a5-24ab-424a-a0d3-8c7ecfc5e7a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:33.082484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f629a5-24ab-424a-a0d3-8c7ecfc5e7a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:33.082958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f629a5-24ab-424a-a0d3-8c7ecfc5e7a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:33.083386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f629a5-24ab-424a-a0d3-8c7ecfc5e7a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:33.084064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f629a5-24ab-424a-a0d3-8c7ecfc5e7a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:33.084543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f629a5-24ab-424a-a0d3-8c7ecfc5e7a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:33.084959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f629a5-24ab-424a-a0d3-8c7ecfc5e7a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:33.211434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34f629a5-24ab-424a-a0d3-8c7ecfc5e7a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:33.218677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-34f629a5-24ab-424a-a0d3-8c7ecfc5e7a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.147656 Aug 06 12:32:33.219244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 165/321] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:33 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:34.239884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b07a1fbd-b8a6-4019-9d6d-766aa1938551 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:34.240515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b07a1fbd-b8a6-4019-9d6d-766aa1938551 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:34.246372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b07a1fbd-b8a6-4019-9d6d-766aa1938551 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:34.246849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b07a1fbd-b8a6-4019-9d6d-766aa1938551 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:34.247276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b07a1fbd-b8a6-4019-9d6d-766aa1938551 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:34.247955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b07a1fbd-b8a6-4019-9d6d-766aa1938551 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:34.248436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b07a1fbd-b8a6-4019-9d6d-766aa1938551 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:34.248855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b07a1fbd-b8a6-4019-9d6d-766aa1938551 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:34.378030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b07a1fbd-b8a6-4019-9d6d-766aa1938551 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:34.385744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b07a1fbd-b8a6-4019-9d6d-766aa1938551 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1510 microversion: 2.1 time: 0.150173 Aug 06 12:32:34.386402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 157/322] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:34 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:35.407610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0700659b-e97e-44f1-9b07-f457d2b57e99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:35.408763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0700659b-e97e-44f1-9b07-f457d2b57e99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:35.414698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0700659b-e97e-44f1-9b07-f457d2b57e99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:35.415167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0700659b-e97e-44f1-9b07-f457d2b57e99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:35.415593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0700659b-e97e-44f1-9b07-f457d2b57e99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:35.416277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0700659b-e97e-44f1-9b07-f457d2b57e99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:35.416760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0700659b-e97e-44f1-9b07-f457d2b57e99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:35.417175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0700659b-e97e-44f1-9b07-f457d2b57e99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:35.554778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0700659b-e97e-44f1-9b07-f457d2b57e99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:35.562655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0700659b-e97e-44f1-9b07-f457d2b57e99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1516 microversion: 2.1 time: 0.158897 Aug 06 12:32:35.563210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 166/323] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:35 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:38.026863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc933f8d-fd15-4688-994f-0daa3312add8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'create', calling method: .version_select at 0x7f541aa0edc0>, body: {"keypair": {"name": "tempest-keypair-1906258088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEynPGiTG0kZEYPtSzW2lS8MdocyZ2iFBJIpkXvpd+jfWww55Y4GKOTehKEW9zZ/1hIc6e+mYgmTIjijoRjjBc66dzffNHCVl9D7uf6SOIGQa1YFABdsiKYcbkbhAEEnJg=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:38.044208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-cc933f8d-fd15-4688-994f-0daa3312add8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Getting quotas for project 6dea90217d154c2ab843c86c2a5ebb49. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:32:38.048598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-cc933f8d-fd15-4688-994f-0daa3312add8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Getting quotas for user 7c520a94e20245ca9cc898dee3ab89bc and project 6dea90217d154c2ab843c86c2a5ebb49. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:32:38.073417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc933f8d-fd15-4688-994f-0daa3312add8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050306 Aug 06 12:32:38.074075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 158/324] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Aug 6 12:32:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:32:39.759483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-943226175", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9772107-4faf-4fb2-a5c9-81f3bb613c65"}], "security_groups": [{"name": "tempest-securitygroup--1456375121"}], "key_name": "tempest-keypair-1906258088", "user_data": "}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:39.906639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] validate_networks() for [('f9772107-4faf-4fb2-a5c9-81f3bb613c65', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:32:40.635718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:32:40.637158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:32:40.638073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:32:40.638653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:32:40.639232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:32:40.649292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:40.650030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:40.650937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:40.651746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:40.652226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:40.652845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:40.673058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Getting quotas for project 6dea90217d154c2ab843c86c2a5ebb49. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:32:40.677835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Getting quotas for user 7c520a94e20245ca9cc898dee3ab89bc and project 6dea90217d154c2ab843c86c2a5ebb49. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:32:40.691761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:32:40.694339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:32:40.755456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3e8ecc59-56eb-4f69-9ad3-157cd599bc83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.000145 Aug 06 12:32:40.756094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 167/325] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:32:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 12:32:40.772467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7987e29a-304a-4aca-a719-36bdc337b8e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:40.773080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7987e29a-304a-4aca-a719-36bdc337b8e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:40.863191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7987e29a-304a-4aca-a719-36bdc337b8e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:40.872651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7987e29a-304a-4aca-a719-36bdc337b8e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1245 microversion: 2.1 time: 0.109483 Aug 06 12:32:40.873789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 159/326] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:41.894347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a344cc19-d7e5-44d8-9382-74c8c81e5ead tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:41.894950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a344cc19-d7e5-44d8-9382-74c8c81e5ead tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:41.901778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a344cc19-d7e5-44d8-9382-74c8c81e5ead tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:41.902292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a344cc19-d7e5-44d8-9382-74c8c81e5ead tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:41.902721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a344cc19-d7e5-44d8-9382-74c8c81e5ead tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:41.903590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a344cc19-d7e5-44d8-9382-74c8c81e5ead tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:41.904037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a344cc19-d7e5-44d8-9382-74c8c81e5ead tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:41.904805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a344cc19-d7e5-44d8-9382-74c8c81e5ead tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:41.991407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a344cc19-d7e5-44d8-9382-74c8c81e5ead tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:42.016462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a344cc19-d7e5-44d8-9382-74c8c81e5ead tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1297 microversion: 2.1 time: 0.126572 Aug 06 12:32:42.017045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 168/327] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:41 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1297 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:43.042799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d94b7e71-7faa-4bd6-9796-f3451361f81f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:43.044123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d94b7e71-7faa-4bd6-9796-f3451361f81f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:43.054850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d94b7e71-7faa-4bd6-9796-f3451361f81f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:43.055596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d94b7e71-7faa-4bd6-9796-f3451361f81f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:43.056259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d94b7e71-7faa-4bd6-9796-f3451361f81f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:43.057592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d94b7e71-7faa-4bd6-9796-f3451361f81f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:43.058272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d94b7e71-7faa-4bd6-9796-f3451361f81f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:43.059028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d94b7e71-7faa-4bd6-9796-f3451361f81f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:43.488111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d94b7e71-7faa-4bd6-9796-f3451361f81f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:43.500703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d94b7e71-7faa-4bd6-9796-f3451361f81f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.465041 Aug 06 12:32:43.515734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 160/328] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:44.400245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-f9df490a-f50f-4092-9ba8-bc0cd6da9481 req-f4c33eaf-a303-4120-8026-995d3d4853d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8a8915-eeca-4909-aab7-6fe8381ced6e", "tag": "57231bce-1a43-402f-869f-8f5913fcf388"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:44.429958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-f9df490a-f50f-4092-9ba8-bc0cd6da9481 req-f4c33eaf-a303-4120-8026-995d3d4853d4 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:44.430697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-f9df490a-f50f-4092-9ba8-bc0cd6da9481 req-f4c33eaf-a303-4120-8026-995d3d4853d4 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:44.431285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-f9df490a-f50f-4092-9ba8-bc0cd6da9481 req-f4c33eaf-a303-4120-8026-995d3d4853d4 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:44.489690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-f9df490a-f50f-4092-9ba8-bc0cd6da9481 req-f4c33eaf-a303-4120-8026-995d3d4853d4 service nova] Creating event network-changed:57231bce-1a43-402f-869f-8f5913fcf388 for instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e on hv-cinder-85199 Aug 06 12:32:44.518946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-f9df490a-f50f-4092-9ba8-bc0cd6da9481 req-f4c33eaf-a303-4120-8026-995d3d4853d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135645 Aug 06 12:32:44.521089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 169/329] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:32:44.525759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-011980b0-101b-41ba-aca7-143b617444bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:44.526430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-011980b0-101b-41ba-aca7-143b617444bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:44.538199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011980b0-101b-41ba-aca7-143b617444bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:44.541449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011980b0-101b-41ba-aca7-143b617444bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:44.544414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011980b0-101b-41ba-aca7-143b617444bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:44.545851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011980b0-101b-41ba-aca7-143b617444bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:44.546534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011980b0-101b-41ba-aca7-143b617444bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:44.549820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011980b0-101b-41ba-aca7-143b617444bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:44.874234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-011980b0-101b-41ba-aca7-143b617444bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:44.883398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-011980b0-101b-41ba-aca7-143b617444bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.364058 Aug 06 12:32:44.889901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 161/330] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:45.912046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9cfd0028-9858-4c1d-8d8c-c73dc8ebb8c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:45.912761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9cfd0028-9858-4c1d-8d8c-c73dc8ebb8c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:45.914729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:45.922744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cfd0028-9858-4c1d-8d8c-c73dc8ebb8c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:45.923334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cfd0028-9858-4c1d-8d8c-c73dc8ebb8c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:45.923967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cfd0028-9858-4c1d-8d8c-c73dc8ebb8c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:45.925135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cfd0028-9858-4c1d-8d8c-c73dc8ebb8c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:45.925585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cfd0028-9858-4c1d-8d8c-c73dc8ebb8c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:45.926003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cfd0028-9858-4c1d-8d8c-c73dc8ebb8c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:46.123480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9cfd0028-9858-4c1d-8d8c-c73dc8ebb8c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:46.134192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9cfd0028-9858-4c1d-8d8c-c73dc8ebb8c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.226061 Aug 06 12:32:46.143896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 170/331] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:47.155643 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a56a053e-36bb-4e37-aa67-97e6fc3c9a37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:47.156387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a56a053e-36bb-4e37-aa67-97e6fc3c9a37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:47.165247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a56a053e-36bb-4e37-aa67-97e6fc3c9a37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:47.165979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a56a053e-36bb-4e37-aa67-97e6fc3c9a37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:47.166428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a56a053e-36bb-4e37-aa67-97e6fc3c9a37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:47.167117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a56a053e-36bb-4e37-aa67-97e6fc3c9a37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:47.167705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a56a053e-36bb-4e37-aa67-97e6fc3c9a37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:47.168132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a56a053e-36bb-4e37-aa67-97e6fc3c9a37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:47.385408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a56a053e-36bb-4e37-aa67-97e6fc3c9a37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:47.393701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a56a053e-36bb-4e37-aa67-97e6fc3c9a37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.242747 Aug 06 12:32:47.394269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 162/332] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:48.167371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98fabf23-491d-46b0-b065-4e93a17ff29f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Action: 'create', calling method: .version_select at 0x7f541acf6790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1739615405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHG+X6V1Cov0tLZO9vRvv1ICVNtiSDWU601qyV/gv2C367Ni7dAQJx3FUGCtIDGubYOdDFnYgOhRAvnh80KD2jEB+PbRmusjhIQlCtlgxZCnfkPGSw0dBFYvCAXf0phV4g=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:48.183246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-98fabf23-491d-46b0-b065-4e93a17ff29f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Getting quotas for project c6cb1f1b37a34fedbd0db091e7e830ad. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:32:48.187047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-98fabf23-491d-46b0-b065-4e93a17ff29f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Getting quotas for user 439c730ea489445998ec6fa480257b5e and project c6cb1f1b37a34fedbd0db091e7e830ad. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:32:48.210775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98fabf23-491d-46b0-b065-4e93a17ff29f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.221672 Aug 06 12:32:48.218124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 171/333] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Aug 6 12:32:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:32:48.414776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d0f58c69-d866-4fc9-976c-17539c0650ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:48.415389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d0f58c69-d866-4fc9-976c-17539c0650ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:48.422557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0f58c69-d866-4fc9-976c-17539c0650ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:48.423719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0f58c69-d866-4fc9-976c-17539c0650ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:48.424598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0f58c69-d866-4fc9-976c-17539c0650ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:48.425329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0f58c69-d866-4fc9-976c-17539c0650ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:48.425805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0f58c69-d866-4fc9-976c-17539c0650ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:48.426225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0f58c69-d866-4fc9-976c-17539c0650ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:48.430691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=83 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:48.597398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d0f58c69-d866-4fc9-976c-17539c0650ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:48.605376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d0f58c69-d866-4fc9-976c-17539c0650ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.194469 Aug 06 12:32:48.612780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 163/334] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:49.626818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e5d793b0-7577-4564-ba4d-86c79cc89344 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:49.627852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e5d793b0-7577-4564-ba4d-86c79cc89344 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:49.634156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d793b0-7577-4564-ba4d-86c79cc89344 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:49.634776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d793b0-7577-4564-ba4d-86c79cc89344 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:49.635311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d793b0-7577-4564-ba4d-86c79cc89344 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:49.636828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d793b0-7577-4564-ba4d-86c79cc89344 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:49.638145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d793b0-7577-4564-ba4d-86c79cc89344 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:49.638789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d793b0-7577-4564-ba4d-86c79cc89344 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:49.807335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e5d793b0-7577-4564-ba4d-86c79cc89344 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:49.814966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e5d793b0-7577-4564-ba4d-86c79cc89344 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.192389 Aug 06 12:32:49.815516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 172/335] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:50.835926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd70f62d-e1a3-41c1-a408-433542950e1a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:50.836560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd70f62d-e1a3-41c1-a408-433542950e1a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:50.839418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:50.845627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd70f62d-e1a3-41c1-a408-433542950e1a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:50.846119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd70f62d-e1a3-41c1-a408-433542950e1a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:50.846674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd70f62d-e1a3-41c1-a408-433542950e1a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:50.847288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd70f62d-e1a3-41c1-a408-433542950e1a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:50.847745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd70f62d-e1a3-41c1-a408-433542950e1a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:50.848170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd70f62d-e1a3-41c1-a408-433542950e1a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:50.871415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:51.006307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd70f62d-e1a3-41c1-a408-433542950e1a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:51.014082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd70f62d-e1a3-41c1-a408-433542950e1a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.182160 Aug 06 12:32:51.017887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 164/336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:52.035349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-284c09a7-eea8-458f-bf7f-bbc6d7cc49b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:52.036084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-284c09a7-eea8-458f-bf7f-bbc6d7cc49b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:52.037959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:52.043155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-284c09a7-eea8-458f-bf7f-bbc6d7cc49b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:52.043637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-284c09a7-eea8-458f-bf7f-bbc6d7cc49b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:52.044071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-284c09a7-eea8-458f-bf7f-bbc6d7cc49b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:52.044804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-284c09a7-eea8-458f-bf7f-bbc6d7cc49b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:52.045260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-284c09a7-eea8-458f-bf7f-bbc6d7cc49b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:52.045685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-284c09a7-eea8-458f-bf7f-bbc6d7cc49b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:52.197622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-284c09a7-eea8-458f-bf7f-bbc6d7cc49b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:52.206646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-284c09a7-eea8-458f-bf7f-bbc6d7cc49b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.175633 Aug 06 12:32:52.207548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 173/337] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:53.229057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-de24a358-ec34-4ecd-9d66-36041c741e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:53.229749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-de24a358-ec34-4ecd-9d66-36041c741e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:53.236552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24a358-ec34-4ecd-9d66-36041c741e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:53.237036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24a358-ec34-4ecd-9d66-36041c741e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:53.237474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24a358-ec34-4ecd-9d66-36041c741e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:53.238170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24a358-ec34-4ecd-9d66-36041c741e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:53.238633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24a358-ec34-4ecd-9d66-36041c741e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:53.239067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24a358-ec34-4ecd-9d66-36041c741e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:53.385128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-de24a358-ec34-4ecd-9d66-36041c741e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:53.395228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-de24a358-ec34-4ecd-9d66-36041c741e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.170016 Aug 06 12:32:53.395887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 165/338] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:54.417371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f8c33937-8f97-4616-bbbc-48ed9423ca18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:54.417971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f8c33937-8f97-4616-bbbc-48ed9423ca18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:54.423908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8c33937-8f97-4616-bbbc-48ed9423ca18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:54.424354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8c33937-8f97-4616-bbbc-48ed9423ca18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:54.424786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8c33937-8f97-4616-bbbc-48ed9423ca18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:54.425470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8c33937-8f97-4616-bbbc-48ed9423ca18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:54.425919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8c33937-8f97-4616-bbbc-48ed9423ca18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:54.426337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8c33937-8f97-4616-bbbc-48ed9423ca18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:54.563333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f8c33937-8f97-4616-bbbc-48ed9423ca18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:54.571368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f8c33937-8f97-4616-bbbc-48ed9423ca18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.157970 Aug 06 12:32:54.571926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 174/339] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:55.233605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-38136215-436d-439c-8503-5893e2e46702 req-9454775a-79e5-4153-8934-754a540c9539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8a8915-eeca-4909-aab7-6fe8381ced6e", "name": "network-vif-plugged", "status": "completed", "tag": "57231bce-1a43-402f-869f-8f5913fcf388"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:32:55.243727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-38136215-436d-439c-8503-5893e2e46702 req-9454775a-79e5-4153-8934-754a540c9539 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:55.244210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-38136215-436d-439c-8503-5893e2e46702 req-9454775a-79e5-4153-8934-754a540c9539 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:55.244667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-38136215-436d-439c-8503-5893e2e46702 req-9454775a-79e5-4153-8934-754a540c9539 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:55.255931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-38136215-436d-439c-8503-5893e2e46702 req-9454775a-79e5-4153-8934-754a540c9539 service nova] Creating event network-vif-plugged:57231bce-1a43-402f-869f-8f5913fcf388 for instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e on hv-cinder-85199 Aug 06 12:32:55.260873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-38136215-436d-439c-8503-5893e2e46702 req-9454775a-79e5-4153-8934-754a540c9539 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030974 Aug 06 12:32:55.261675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 166/340] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:32:55.591157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-49fafb49-e661-406e-9a87-4be811f4c90c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:55.591782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-49fafb49-e661-406e-9a87-4be811f4c90c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:55.598507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fafb49-e661-406e-9a87-4be811f4c90c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:55.598985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fafb49-e661-406e-9a87-4be811f4c90c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:55.599412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fafb49-e661-406e-9a87-4be811f4c90c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:55.600097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fafb49-e661-406e-9a87-4be811f4c90c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:55.600580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fafb49-e661-406e-9a87-4be811f4c90c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:55.601004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fafb49-e661-406e-9a87-4be811f4c90c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:55.734972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-49fafb49-e661-406e-9a87-4be811f4c90c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:55.743381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-49fafb49-e661-406e-9a87-4be811f4c90c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.156087 Aug 06 12:32:55.743922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 175/341] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:32:56.764080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7ec0d119-cb42-48ef-afcf-ab27e7b07a0a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:56.765572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7ec0d119-cb42-48ef-afcf-ab27e7b07a0a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:56.771845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ec0d119-cb42-48ef-afcf-ab27e7b07a0a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:56.772359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ec0d119-cb42-48ef-afcf-ab27e7b07a0a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:56.772725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ec0d119-cb42-48ef-afcf-ab27e7b07a0a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:56.773425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ec0d119-cb42-48ef-afcf-ab27e7b07a0a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:56.773886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ec0d119-cb42-48ef-afcf-ab27e7b07a0a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:56.774337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ec0d119-cb42-48ef-afcf-ab27e7b07a0a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:56.917181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7ec0d119-cb42-48ef-afcf-ab27e7b07a0a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:56.925091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7ec0d119-cb42-48ef-afcf-ab27e7b07a0a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.165837 Aug 06 12:32:56.925646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 167/342] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:57.949353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-17ce1c75-a1c5-4ee3-b920-d2d142b86612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:57.949967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-17ce1c75-a1c5-4ee3-b920-d2d142b86612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:57.957300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17ce1c75-a1c5-4ee3-b920-d2d142b86612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:57.957779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17ce1c75-a1c5-4ee3-b920-d2d142b86612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:57.958208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17ce1c75-a1c5-4ee3-b920-d2d142b86612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:57.958968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17ce1c75-a1c5-4ee3-b920-d2d142b86612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:57.959432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17ce1c75-a1c5-4ee3-b920-d2d142b86612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:57.959853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17ce1c75-a1c5-4ee3-b920-d2d142b86612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:57.962486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=72 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:58.120357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-17ce1c75-a1c5-4ee3-b920-d2d142b86612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:58.128665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-17ce1c75-a1c5-4ee3-b920-d2d142b86612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1371 microversion: 2.1 time: 0.183135 Aug 06 12:32:58.129489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 176/343] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:59.149524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2c6783b0-0a0a-44f6-843c-e82076cb0dbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:59.150189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2c6783b0-0a0a-44f6-843c-e82076cb0dbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:59.156360 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c6783b0-0a0a-44f6-843c-e82076cb0dbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:59.157072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c6783b0-0a0a-44f6-843c-e82076cb0dbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:59.157681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c6783b0-0a0a-44f6-843c-e82076cb0dbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:59.158399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c6783b0-0a0a-44f6-843c-e82076cb0dbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:59.159006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c6783b0-0a0a-44f6-843c-e82076cb0dbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:59.159430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c6783b0-0a0a-44f6-843c-e82076cb0dbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:59.309546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c6783b0-0a0a-44f6-843c-e82076cb0dbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:32:59.311524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2c6783b0-0a0a-44f6-843c-e82076cb0dbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1566 microversion: 2.1 time: 0.166474 Aug 06 12:32:59.312289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 168/344] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:32:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:32:59.333698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b077809b-c2b8-428e-ac45-a97dd43082c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:32:59.334320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b077809b-c2b8-428e-ac45-a97dd43082c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:32:59.341773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=10 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:32:59.344255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b077809b-c2b8-428e-ac45-a97dd43082c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:59.345463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b077809b-c2b8-428e-ac45-a97dd43082c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:59.346108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b077809b-c2b8-428e-ac45-a97dd43082c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:59.347260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b077809b-c2b8-428e-ac45-a97dd43082c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:32:59.348335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b077809b-c2b8-428e-ac45-a97dd43082c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:32:59.348830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b077809b-c2b8-428e-ac45-a97dd43082c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:32:59.433032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b077809b-c2b8-428e-ac45-a97dd43082c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104439 Aug 06 12:32:59.433627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 177/345] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Aug 6 12:32:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:33:00.383074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-74814bb0-bf88-4053-92bd-f933dfb1b114 req-d94e3390-2526-484e-9e8b-1738229d5d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8a8915-eeca-4909-aab7-6fe8381ced6e", "tag": "57231bce-1a43-402f-869f-8f5913fcf388"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:00.394190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-74814bb0-bf88-4053-92bd-f933dfb1b114 req-d94e3390-2526-484e-9e8b-1738229d5d46 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:00.394990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-74814bb0-bf88-4053-92bd-f933dfb1b114 req-d94e3390-2526-484e-9e8b-1738229d5d46 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:00.395505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-74814bb0-bf88-4053-92bd-f933dfb1b114 req-d94e3390-2526-484e-9e8b-1738229d5d46 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:00.409670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-74814bb0-bf88-4053-92bd-f933dfb1b114 req-d94e3390-2526-484e-9e8b-1738229d5d46 service nova] Creating event network-changed:57231bce-1a43-402f-869f-8f5913fcf388 for instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e on hv-cinder-85199 Aug 06 12:33:00.415228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-74814bb0-bf88-4053-92bd-f933dfb1b114 req-d94e3390-2526-484e-9e8b-1738229d5d46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036653 Aug 06 12:33:00.416284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 169/346] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:33:01.531614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-95035721", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "networks": [{"uuid": "c8f9b58d-e4cf-46db-b86b-2d40bd023127"}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:01.589331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] validate_networks() for [('c8f9b58d-e4cf-46db-b86b-2d40bd023127', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:33:01.941931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:33:01.942346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:33:01.942814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:33:01.943218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:33:01.943619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:33:01.953084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:01.953557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:01.954492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:01.955208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:01.955654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:01.956072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:01.972881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Getting quotas for project 94cc3ab0fa2d47008fc45f600ff1613a. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:33:01.976908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Getting quotas for user 3fc91d2e9cd24694a5aa62e9d579c8e0 and project 94cc3ab0fa2d47008fc45f600ff1613a. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:33:01.987605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:33:01.990173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:33:02.035061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9a242eac-e6fa-4dfb-a1b5-eb3bd1959b43 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507423 Aug 06 12:33:02.035687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 178/347] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 12:33:02.046834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4137e129-4e26-4cc3-98cf-009fc8fa6c65 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:02.048059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4137e129-4e26-4cc3-98cf-009fc8fa6c65 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:02.107481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4137e129-4e26-4cc3-98cf-009fc8fa6c65 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:02.115991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4137e129-4e26-4cc3-98cf-009fc8fa6c65 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1217 microversion: 2.1 time: 0.073138 Aug 06 12:33:02.116618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 170/348] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:02 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:03.136811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4abaf643-4aca-47b8-a373-f8d7af777b4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:03.137424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4abaf643-4aca-47b8-a373-f8d7af777b4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:03.144201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abaf643-4aca-47b8-a373-f8d7af777b4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:03.144705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abaf643-4aca-47b8-a373-f8d7af777b4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:03.145134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abaf643-4aca-47b8-a373-f8d7af777b4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:03.145820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abaf643-4aca-47b8-a373-f8d7af777b4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:03.146304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abaf643-4aca-47b8-a373-f8d7af777b4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:03.146722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abaf643-4aca-47b8-a373-f8d7af777b4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:03.214824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4abaf643-4aca-47b8-a373-f8d7af777b4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:03.222968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4abaf643-4aca-47b8-a373-f8d7af777b4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1277 microversion: 2.1 time: 0.090512 Aug 06 12:33:03.228354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 179/349] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:03 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:04.245105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c93ba0ff-d048-4684-b7d5-3c6aadbd277d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:04.245774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c93ba0ff-d048-4684-b7d5-3c6aadbd277d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:04.254136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c93ba0ff-d048-4684-b7d5-3c6aadbd277d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:04.254626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c93ba0ff-d048-4684-b7d5-3c6aadbd277d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:04.255229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c93ba0ff-d048-4684-b7d5-3c6aadbd277d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:04.256117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c93ba0ff-d048-4684-b7d5-3c6aadbd277d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:04.256612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c93ba0ff-d048-4684-b7d5-3c6aadbd277d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:04.257040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c93ba0ff-d048-4684-b7d5-3c6aadbd277d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:04.469132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c93ba0ff-d048-4684-b7d5-3c6aadbd277d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:04.480293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c93ba0ff-d048-4684-b7d5-3c6aadbd277d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1317 microversion: 2.1 time: 0.239887 Aug 06 12:33:04.480985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 171/350] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:04 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:04.521194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-ee85ca93-e03b-44df-b829-92cafd383e38 req-2c770579-ca5a-49cc-8dd0-11700b3a3d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149b38d1-c9ad-43f0-a48e-13048fb953e2", "tag": "7395e2a4-14fe-497c-b6fb-576b75349030"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:04.530792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ee85ca93-e03b-44df-b829-92cafd383e38 req-2c770579-ca5a-49cc-8dd0-11700b3a3d10 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:04.531501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ee85ca93-e03b-44df-b829-92cafd383e38 req-2c770579-ca5a-49cc-8dd0-11700b3a3d10 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:04.532960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-ee85ca93-e03b-44df-b829-92cafd383e38 req-2c770579-ca5a-49cc-8dd0-11700b3a3d10 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:04.546244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-ee85ca93-e03b-44df-b829-92cafd383e38 req-2c770579-ca5a-49cc-8dd0-11700b3a3d10 service nova] Creating event network-changed:7395e2a4-14fe-497c-b6fb-576b75349030 for instance 149b38d1-c9ad-43f0-a48e-13048fb953e2 on hv-cinder-85199 Aug 06 12:33:04.551207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-ee85ca93-e03b-44df-b829-92cafd383e38 req-2c770579-ca5a-49cc-8dd0-11700b3a3d10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033647 Aug 06 12:33:04.551860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 180/351] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:33:05.502278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0b92db2c-bdf9-4a91-b5c5-befd93189acb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:05.503078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0b92db2c-bdf9-4a91-b5c5-befd93189acb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:05.510081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b92db2c-bdf9-4a91-b5c5-befd93189acb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:05.510730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b92db2c-bdf9-4a91-b5c5-befd93189acb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:05.510984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b92db2c-bdf9-4a91-b5c5-befd93189acb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:05.511672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b92db2c-bdf9-4a91-b5c5-befd93189acb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:05.512120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b92db2c-bdf9-4a91-b5c5-befd93189acb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:05.512731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b92db2c-bdf9-4a91-b5c5-befd93189acb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:05.640342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0b92db2c-bdf9-4a91-b5c5-befd93189acb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:05.648215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0b92db2c-bdf9-4a91-b5c5-befd93189acb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1317 microversion: 2.1 time: 0.149929 Aug 06 12:33:05.648808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 172/352] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:05 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:06.669236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-03baa2f1-9d9d-48f7-9c7e-a7236f466c64 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:06.669934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-03baa2f1-9d9d-48f7-9c7e-a7236f466c64 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:06.676800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03baa2f1-9d9d-48f7-9c7e-a7236f466c64 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:06.677283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03baa2f1-9d9d-48f7-9c7e-a7236f466c64 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:06.677709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03baa2f1-9d9d-48f7-9c7e-a7236f466c64 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:06.678397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03baa2f1-9d9d-48f7-9c7e-a7236f466c64 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:06.678839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03baa2f1-9d9d-48f7-9c7e-a7236f466c64 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:06.679255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03baa2f1-9d9d-48f7-9c7e-a7236f466c64 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:06.810541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-03baa2f1-9d9d-48f7-9c7e-a7236f466c64 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:06.819184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-03baa2f1-9d9d-48f7-9c7e-a7236f466c64 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1317 microversion: 2.1 time: 0.154190 Aug 06 12:33:06.819774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 181/353] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:06 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:33:07.840039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d0f7998-d968-4798-97c2-1bfbc69eadde tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:07.840663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d0f7998-d968-4798-97c2-1bfbc69eadde tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:07.847093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d0f7998-d968-4798-97c2-1bfbc69eadde tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:07.847565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d0f7998-d968-4798-97c2-1bfbc69eadde tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:07.847991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d0f7998-d968-4798-97c2-1bfbc69eadde tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:07.848696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d0f7998-d968-4798-97c2-1bfbc69eadde tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:07.849142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d0f7998-d968-4798-97c2-1bfbc69eadde tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:07.849561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d0f7998-d968-4798-97c2-1bfbc69eadde tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:07.979985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d0f7998-d968-4798-97c2-1bfbc69eadde tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:07.987905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d0f7998-d968-4798-97c2-1bfbc69eadde tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1317 microversion: 2.1 time: 0.151653 Aug 06 12:33:07.988499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 173/354] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:07 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:09.010613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e1d12f3b-f5b0-4387-8903-2259a2a84ed1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:09.011216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e1d12f3b-f5b0-4387-8903-2259a2a84ed1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:09.017162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1d12f3b-f5b0-4387-8903-2259a2a84ed1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:09.017640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1d12f3b-f5b0-4387-8903-2259a2a84ed1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:09.018067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1d12f3b-f5b0-4387-8903-2259a2a84ed1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:09.018752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1d12f3b-f5b0-4387-8903-2259a2a84ed1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:09.019200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1d12f3b-f5b0-4387-8903-2259a2a84ed1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:09.019619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1d12f3b-f5b0-4387-8903-2259a2a84ed1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:09.151015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e1d12f3b-f5b0-4387-8903-2259a2a84ed1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:09.158702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e1d12f3b-f5b0-4387-8903-2259a2a84ed1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1317 microversion: 2.1 time: 0.151920 Aug 06 12:33:09.166287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 182/355] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:09 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:10.179270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d1f9448d-7d2f-4456-ae50-28f4b12b6dcf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:10.179864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d1f9448d-7d2f-4456-ae50-28f4b12b6dcf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:10.186388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1f9448d-7d2f-4456-ae50-28f4b12b6dcf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:10.186865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1f9448d-7d2f-4456-ae50-28f4b12b6dcf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:10.187297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1f9448d-7d2f-4456-ae50-28f4b12b6dcf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:10.188010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1f9448d-7d2f-4456-ae50-28f4b12b6dcf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:10.188585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1f9448d-7d2f-4456-ae50-28f4b12b6dcf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:10.189007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1f9448d-7d2f-4456-ae50-28f4b12b6dcf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:10.320372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d1f9448d-7d2f-4456-ae50-28f4b12b6dcf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:10.327680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d1f9448d-7d2f-4456-ae50-28f4b12b6dcf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1317 microversion: 2.1 time: 0.152292 Aug 06 12:33:10.328764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 174/356] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:10 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:11.349449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f057a72d-1242-4d71-a21b-83cbf538d46d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:11.350049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f057a72d-1242-4d71-a21b-83cbf538d46d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:11.355920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f057a72d-1242-4d71-a21b-83cbf538d46d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:11.356429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f057a72d-1242-4d71-a21b-83cbf538d46d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:11.356868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f057a72d-1242-4d71-a21b-83cbf538d46d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:11.357546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f057a72d-1242-4d71-a21b-83cbf538d46d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:11.357992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f057a72d-1242-4d71-a21b-83cbf538d46d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:11.358411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f057a72d-1242-4d71-a21b-83cbf538d46d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:11.490498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f057a72d-1242-4d71-a21b-83cbf538d46d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:11.498269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f057a72d-1242-4d71-a21b-83cbf538d46d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1317 microversion: 2.1 time: 0.152839 Aug 06 12:33:11.499048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 183/357] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:11 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:11.587938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-84a7a875-4ccf-4b3e-a132-d9af4562cc11 req-69d3c7ab-6dd7-48f9-8440-cef2f8579896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149b38d1-c9ad-43f0-a48e-13048fb953e2", "name": "network-vif-plugged", "status": "completed", "tag": "7395e2a4-14fe-497c-b6fb-576b75349030"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:11.598188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-84a7a875-4ccf-4b3e-a132-d9af4562cc11 req-69d3c7ab-6dd7-48f9-8440-cef2f8579896 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:11.598742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-84a7a875-4ccf-4b3e-a132-d9af4562cc11 req-69d3c7ab-6dd7-48f9-8440-cef2f8579896 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:11.599206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-84a7a875-4ccf-4b3e-a132-d9af4562cc11 req-69d3c7ab-6dd7-48f9-8440-cef2f8579896 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:11.610166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-84a7a875-4ccf-4b3e-a132-d9af4562cc11 req-69d3c7ab-6dd7-48f9-8440-cef2f8579896 service nova] Creating event network-vif-plugged:7395e2a4-14fe-497c-b6fb-576b75349030 for instance 149b38d1-c9ad-43f0-a48e-13048fb953e2 on hv-cinder-85199 Aug 06 12:33:11.615219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-84a7a875-4ccf-4b3e-a132-d9af4562cc11 req-69d3c7ab-6dd7-48f9-8440-cef2f8579896 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031057 Aug 06 12:33:11.616104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 175/358] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:33:12.519115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7643a489-bc5e-407d-ae2b-f49f77878c73 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:12.519744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7643a489-bc5e-407d-ae2b-f49f77878c73 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:12.521698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:12.522333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:12.528596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7643a489-bc5e-407d-ae2b-f49f77878c73 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:12.529083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7643a489-bc5e-407d-ae2b-f49f77878c73 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:12.529551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7643a489-bc5e-407d-ae2b-f49f77878c73 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:12.530270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7643a489-bc5e-407d-ae2b-f49f77878c73 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:12.530721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7643a489-bc5e-407d-ae2b-f49f77878c73 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:12.531148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7643a489-bc5e-407d-ae2b-f49f77878c73 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:12.657492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7643a489-bc5e-407d-ae2b-f49f77878c73 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:12.664744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7643a489-bc5e-407d-ae2b-f49f77878c73 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1317 microversion: 2.1 time: 0.149482 Aug 06 12:33:12.665289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 184/359] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:12 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:13.683220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:13.688277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0a944cc1-4bfe-4033-890f-c6e8449a5b31 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:13.689043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0a944cc1-4bfe-4033-890f-c6e8449a5b31 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:13.695423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a944cc1-4bfe-4033-890f-c6e8449a5b31 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:13.695903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a944cc1-4bfe-4033-890f-c6e8449a5b31 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:13.696373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a944cc1-4bfe-4033-890f-c6e8449a5b31 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:13.697507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a944cc1-4bfe-4033-890f-c6e8449a5b31 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:13.698290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a944cc1-4bfe-4033-890f-c6e8449a5b31 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:13.699015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a944cc1-4bfe-4033-890f-c6e8449a5b31 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:13.834273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0a944cc1-4bfe-4033-890f-c6e8449a5b31 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:13.841576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0a944cc1-4bfe-4033-890f-c6e8449a5b31 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1317 microversion: 2.1 time: 0.159289 Aug 06 12:33:13.842236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 176/360] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:13 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:14.862748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-664f335f-36de-4096-a11a-751069970891 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:14.863381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-664f335f-36de-4096-a11a-751069970891 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:14.869529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664f335f-36de-4096-a11a-751069970891 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:14.870004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664f335f-36de-4096-a11a-751069970891 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:14.870433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664f335f-36de-4096-a11a-751069970891 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:14.871112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664f335f-36de-4096-a11a-751069970891 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:14.871559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664f335f-36de-4096-a11a-751069970891 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:14.871979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664f335f-36de-4096-a11a-751069970891 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:15.008260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-664f335f-36de-4096-a11a-751069970891 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:15.015745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-664f335f-36de-4096-a11a-751069970891 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1506 microversion: 2.1 time: 0.156940 Aug 06 12:33:15.016969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 185/361] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:14 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:15.155011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1126123986", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1739615405", "security_groups": [{"name": "tempest-secgroup-smoke-1788268216"}], "block_device_mapping_v2": [{"uuid": "341840a3-5dab-4371-973a-4b8b14924b14", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f413475b-599d-4bfb-9984-cac04fe5306b"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:15.269750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] validate_networks() for [('f413475b-599d-4bfb-9984-cac04fe5306b', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:33:15.654573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:33:15.654573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:33:15.654573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:33:15.655074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:33:15.655552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:33:15.664398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:15.664876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:15.665310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:15.666028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:15.666478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:15.666901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:15.683624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Getting quotas for project c6cb1f1b37a34fedbd0db091e7e830ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:33:15.687630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Getting quotas for user 439c730ea489445998ec6fa480257b5e and project c6cb1f1b37a34fedbd0db091e7e830ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:33:15.747004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:33:15.749346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='341840a3-5dab-4371-973a-4b8b14924b14',volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:33:15.882479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a1353cff-0911-42a8-8083-df257ca2ac33 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731349 Aug 06 12:33:15.883474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 177/362] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:33:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 12:33:15.894145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-268854ae-f9d5-430a-8206-386ef489e249 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:15.894763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-268854ae-f9d5-430a-8206-386ef489e249 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:15.953107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-268854ae-f9d5-430a-8206-386ef489e249 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:15.959861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-268854ae-f9d5-430a-8206-386ef489e249 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1095 microversion: 2.1 time: 0.069422 Aug 06 12:33:15.960497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 186/363] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:15 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:33:16.983092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9819eb35-973f-4d43-82e8-f4d58ce81576 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:16.983783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9819eb35-973f-4d43-82e8-f4d58ce81576 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:16.990293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9819eb35-973f-4d43-82e8-f4d58ce81576 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:16.990772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9819eb35-973f-4d43-82e8-f4d58ce81576 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:16.991201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9819eb35-973f-4d43-82e8-f4d58ce81576 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:16.991884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9819eb35-973f-4d43-82e8-f4d58ce81576 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:16.992351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9819eb35-973f-4d43-82e8-f4d58ce81576 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:16.992783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9819eb35-973f-4d43-82e8-f4d58ce81576 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:17.055349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9819eb35-973f-4d43-82e8-f4d58ce81576 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:17.062664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9819eb35-973f-4d43-82e8-f4d58ce81576 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1193 microversion: 2.1 time: 0.083974 Aug 06 12:33:17.063228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 178/364] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:16 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:18.085817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3a0f8ed3-dc01-48be-a4bd-fecb8cf037e0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:18.086508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3a0f8ed3-dc01-48be-a4bd-fecb8cf037e0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:18.089424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:18.092766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a0f8ed3-dc01-48be-a4bd-fecb8cf037e0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:18.093243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a0f8ed3-dc01-48be-a4bd-fecb8cf037e0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:18.093670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a0f8ed3-dc01-48be-a4bd-fecb8cf037e0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:18.094355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a0f8ed3-dc01-48be-a4bd-fecb8cf037e0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:18.094967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a0f8ed3-dc01-48be-a4bd-fecb8cf037e0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:18.095382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a0f8ed3-dc01-48be-a4bd-fecb8cf037e0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:18.159615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3a0f8ed3-dc01-48be-a4bd-fecb8cf037e0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:18.167265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3a0f8ed3-dc01-48be-a4bd-fecb8cf037e0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1211 microversion: 2.1 time: 0.086766 Aug 06 12:33:18.168036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 187/365] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:18 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:19.187018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7a6a1959-8122-45d9-b3ed-f75ec63aaea2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:19.187612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7a6a1959-8122-45d9-b3ed-f75ec63aaea2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:19.194061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a6a1959-8122-45d9-b3ed-f75ec63aaea2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:19.194543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a6a1959-8122-45d9-b3ed-f75ec63aaea2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:19.194971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a6a1959-8122-45d9-b3ed-f75ec63aaea2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:19.195901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a6a1959-8122-45d9-b3ed-f75ec63aaea2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:19.196601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a6a1959-8122-45d9-b3ed-f75ec63aaea2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:19.197031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a6a1959-8122-45d9-b3ed-f75ec63aaea2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:19.202353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=74 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:19.233356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-7c8c0df7-4625-4660-af73-63ae7f94daf8 req-034d1820-b2ff-434f-9b4e-f144d4e5b61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cc50006-2952-4463-9098-a8a944a259e3", "tag": "586919cc-a13c-423a-bbd6-47811a8e0a67"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:19.250070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-7c8c0df7-4625-4660-af73-63ae7f94daf8 req-034d1820-b2ff-434f-9b4e-f144d4e5b61f service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:19.250659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-7c8c0df7-4625-4660-af73-63ae7f94daf8 req-034d1820-b2ff-434f-9b4e-f144d4e5b61f service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:19.251091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-7c8c0df7-4625-4660-af73-63ae7f94daf8 req-034d1820-b2ff-434f-9b4e-f144d4e5b61f service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:19.262353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-7c8c0df7-4625-4660-af73-63ae7f94daf8 req-034d1820-b2ff-434f-9b4e-f144d4e5b61f service nova] Creating event network-changed:586919cc-a13c-423a-bbd6-47811a8e0a67 for instance 5cc50006-2952-4463-9098-a8a944a259e3 on hv-cinder-85199 Aug 06 12:33:19.267662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-7c8c0df7-4625-4660-af73-63ae7f94daf8 req-034d1820-b2ff-434f-9b4e-f144d4e5b61f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037905 Aug 06 12:33:19.268245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 188/366] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:33:19.415612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a6a1959-8122-45d9-b3ed-f75ec63aaea2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:19.424329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7a6a1959-8122-45d9-b3ed-f75ec63aaea2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.241102 Aug 06 12:33:19.424921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 179/367] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:19 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:20.445375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-edd1f7bb-1606-447c-a592-630fc5c120f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:20.446063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-edd1f7bb-1606-447c-a592-630fc5c120f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:20.452104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edd1f7bb-1606-447c-a592-630fc5c120f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:20.452608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edd1f7bb-1606-447c-a592-630fc5c120f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:20.453040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edd1f7bb-1606-447c-a592-630fc5c120f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:20.453721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edd1f7bb-1606-447c-a592-630fc5c120f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:20.454169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edd1f7bb-1606-447c-a592-630fc5c120f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:20.454588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edd1f7bb-1606-447c-a592-630fc5c120f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:20.586165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-edd1f7bb-1606-447c-a592-630fc5c120f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:20.593504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-edd1f7bb-1606-447c-a592-630fc5c120f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.152292 Aug 06 12:33:20.594061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 189/368] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:20 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:21.615517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-339acb58-33f6-4196-acb5-df07a85f8e97 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:21.616120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-339acb58-33f6-4196-acb5-df07a85f8e97 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:21.618476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:21.632112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-339acb58-33f6-4196-acb5-df07a85f8e97 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:21.632668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-339acb58-33f6-4196-acb5-df07a85f8e97 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:21.633103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-339acb58-33f6-4196-acb5-df07a85f8e97 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:21.633811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-339acb58-33f6-4196-acb5-df07a85f8e97 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:21.634263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-339acb58-33f6-4196-acb5-df07a85f8e97 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:21.634688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-339acb58-33f6-4196-acb5-df07a85f8e97 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:21.772677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-339acb58-33f6-4196-acb5-df07a85f8e97 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:21.779060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-339acb58-33f6-4196-acb5-df07a85f8e97 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.168608 Aug 06 12:33:21.785385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 180/369] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:21 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:22.800709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b9ff0238-ee1f-4b3e-abfc-c1ea42706de5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:22.801234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b9ff0238-ee1f-4b3e-abfc-c1ea42706de5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:22.807314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ff0238-ee1f-4b3e-abfc-c1ea42706de5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:22.807767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ff0238-ee1f-4b3e-abfc-c1ea42706de5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:22.808200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ff0238-ee1f-4b3e-abfc-c1ea42706de5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:22.808911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ff0238-ee1f-4b3e-abfc-c1ea42706de5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:22.809361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ff0238-ee1f-4b3e-abfc-c1ea42706de5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:22.809781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ff0238-ee1f-4b3e-abfc-c1ea42706de5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:22.943625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b9ff0238-ee1f-4b3e-abfc-c1ea42706de5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:22.952925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b9ff0238-ee1f-4b3e-abfc-c1ea42706de5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.156708 Aug 06 12:33:22.953532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 190/370] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:22 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:23.356322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e75b4ef8-309a-4784-a5da-0fc66562fb8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:23.356930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e75b4ef8-309a-4784-a5da-0fc66562fb8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:23.365457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e75b4ef8-309a-4784-a5da-0fc66562fb8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:23.365935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e75b4ef8-309a-4784-a5da-0fc66562fb8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:23.366367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e75b4ef8-309a-4784-a5da-0fc66562fb8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:23.367057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e75b4ef8-309a-4784-a5da-0fc66562fb8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:23.367509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e75b4ef8-309a-4784-a5da-0fc66562fb8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:23.367929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e75b4ef8-309a-4784-a5da-0fc66562fb8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:23.390908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e75b4ef8-309a-4784-a5da-0fc66562fb8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/ips" status: 200 len: 149 microversion: 2.1 time: 0.039052 Aug 06 12:33:23.392147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 181/371] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Aug 6 12:33:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:33:23.973661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-58fe1253-9a95-476e-b036-fdd5f7960b91 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:23.974223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-58fe1253-9a95-476e-b036-fdd5f7960b91 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:23.980036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58fe1253-9a95-476e-b036-fdd5f7960b91 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:23.980562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58fe1253-9a95-476e-b036-fdd5f7960b91 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:23.980995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58fe1253-9a95-476e-b036-fdd5f7960b91 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:23.981672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58fe1253-9a95-476e-b036-fdd5f7960b91 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:23.982119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58fe1253-9a95-476e-b036-fdd5f7960b91 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:23.982539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58fe1253-9a95-476e-b036-fdd5f7960b91 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:24.115510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-58fe1253-9a95-476e-b036-fdd5f7960b91 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:24.122835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-58fe1253-9a95-476e-b036-fdd5f7960b91 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.153138 Aug 06 12:33:24.123388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 191/372] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:23 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:24.775232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9de09f28-3ba8-4182-b013-12738dc6b0a8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7d60bf4-e0ab-460f-a2f1-966d5f0333ef"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:24.777661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9de09f28-3ba8-4182-b013-12738dc6b0a8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:24.783998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9de09f28-3ba8-4182-b013-12738dc6b0a8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:24.784519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9de09f28-3ba8-4182-b013-12738dc6b0a8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:24.784953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9de09f28-3ba8-4182-b013-12738dc6b0a8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:24.785630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9de09f28-3ba8-4182-b013-12738dc6b0a8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:24.786153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9de09f28-3ba8-4182-b013-12738dc6b0a8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:24.786501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9de09f28-3ba8-4182-b013-12738dc6b0a8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:25.077960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9de09f28-3ba8-4182-b013-12738dc6b0a8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306449 Aug 06 12:33:25.078574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 182/373] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 12:33:24 2022] POST /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:33:25.143214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-84c6c75d-2c23-436d-9df3-2b32c9314923 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:25.143928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-84c6c75d-2c23-436d-9df3-2b32c9314923 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:25.149989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84c6c75d-2c23-436d-9df3-2b32c9314923 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:25.150469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84c6c75d-2c23-436d-9df3-2b32c9314923 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:25.150898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84c6c75d-2c23-436d-9df3-2b32c9314923 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:25.151571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84c6c75d-2c23-436d-9df3-2b32c9314923 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:25.152014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84c6c75d-2c23-436d-9df3-2b32c9314923 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:25.152464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84c6c75d-2c23-436d-9df3-2b32c9314923 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:25.289435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-84c6c75d-2c23-436d-9df3-2b32c9314923 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:25.297124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-84c6c75d-2c23-436d-9df3-2b32c9314923 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.157988 Aug 06 12:33:25.298251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 192/374] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:25 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:25.563657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0df74e5f-eeaa-4347-9870-aaab85887581 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:25.564386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0df74e5f-eeaa-4347-9870-aaab85887581 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:25.570591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0df74e5f-eeaa-4347-9870-aaab85887581 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:25.571147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0df74e5f-eeaa-4347-9870-aaab85887581 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:25.571575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0df74e5f-eeaa-4347-9870-aaab85887581 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:25.572270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0df74e5f-eeaa-4347-9870-aaab85887581 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:25.572735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0df74e5f-eeaa-4347-9870-aaab85887581 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:25.573150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0df74e5f-eeaa-4347-9870-aaab85887581 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:25.596606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0df74e5f-eeaa-4347-9870-aaab85887581 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/ips" status: 200 len: 152 microversion: 2.20 time: 0.038306 Aug 06 12:33:25.597268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 183/375] 10.222.0.20 () {60 vars in 1289 bytes} [Sat Aug 6 12:33:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:33:26.315480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:26.319361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7abbd63f-aa54-4b40-82d5-0e45b2b4a22b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:26.320016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7abbd63f-aa54-4b40-82d5-0e45b2b4a22b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:26.326153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7abbd63f-aa54-4b40-82d5-0e45b2b4a22b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:26.326661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7abbd63f-aa54-4b40-82d5-0e45b2b4a22b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:26.327067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7abbd63f-aa54-4b40-82d5-0e45b2b4a22b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:26.327748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7abbd63f-aa54-4b40-82d5-0e45b2b4a22b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:26.328203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7abbd63f-aa54-4b40-82d5-0e45b2b4a22b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:26.329291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7abbd63f-aa54-4b40-82d5-0e45b2b4a22b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:26.463699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7abbd63f-aa54-4b40-82d5-0e45b2b4a22b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:26.471227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7abbd63f-aa54-4b40-82d5-0e45b2b4a22b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.156833 Aug 06 12:33:26.471787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 193/376] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:26 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:27.491356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c98b5ff1-5f78-4d57-9c0c-691e6c5e561e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:27.491876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c98b5ff1-5f78-4d57-9c0c-691e6c5e561e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:27.493855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:27.495016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:27.500953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c98b5ff1-5f78-4d57-9c0c-691e6c5e561e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:27.501423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c98b5ff1-5f78-4d57-9c0c-691e6c5e561e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:27.501851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c98b5ff1-5f78-4d57-9c0c-691e6c5e561e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:27.502533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c98b5ff1-5f78-4d57-9c0c-691e6c5e561e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:27.502979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c98b5ff1-5f78-4d57-9c0c-691e6c5e561e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:27.503392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c98b5ff1-5f78-4d57-9c0c-691e6c5e561e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:27.638277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c98b5ff1-5f78-4d57-9c0c-691e6c5e561e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:27.646314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c98b5ff1-5f78-4d57-9c0c-691e6c5e561e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.159154 Aug 06 12:33:27.646871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 184/377] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:27 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:28.126332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-c38f1532-9307-4e92-be4b-419d95ea4299 req-926c1b14-89f4-4242-be20-1076a5533290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cc50006-2952-4463-9098-a8a944a259e3", "name": "network-vif-plugged", "status": "completed", "tag": "586919cc-a13c-423a-bbd6-47811a8e0a67"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:28.135719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-c38f1532-9307-4e92-be4b-419d95ea4299 req-926c1b14-89f4-4242-be20-1076a5533290 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:28.136492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-c38f1532-9307-4e92-be4b-419d95ea4299 req-926c1b14-89f4-4242-be20-1076a5533290 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:28.136922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-c38f1532-9307-4e92-be4b-419d95ea4299 req-926c1b14-89f4-4242-be20-1076a5533290 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:28.141136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=88 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:28.153028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-c38f1532-9307-4e92-be4b-419d95ea4299 req-926c1b14-89f4-4242-be20-1076a5533290 service nova] Creating event network-vif-plugged:586919cc-a13c-423a-bbd6-47811a8e0a67 for instance 5cc50006-2952-4463-9098-a8a944a259e3 on hv-cinder-85199 Aug 06 12:33:28.158464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-c38f1532-9307-4e92-be4b-419d95ea4299 req-926c1b14-89f4-4242-be20-1076a5533290 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036389 Aug 06 12:33:28.159247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 194/378] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:33:28.667429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-747d9837-d5b3-408d-9812-9246b27612e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:28.668025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-747d9837-d5b3-408d-9812-9246b27612e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:28.674963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-747d9837-d5b3-408d-9812-9246b27612e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:28.675441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-747d9837-d5b3-408d-9812-9246b27612e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:28.675870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-747d9837-d5b3-408d-9812-9246b27612e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:28.676575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-747d9837-d5b3-408d-9812-9246b27612e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:28.677024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-747d9837-d5b3-408d-9812-9246b27612e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:28.677440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-747d9837-d5b3-408d-9812-9246b27612e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:28.813704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-747d9837-d5b3-408d-9812-9246b27612e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:28.821354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-747d9837-d5b3-408d-9812-9246b27612e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.158030 Aug 06 12:33:28.821947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 185/379] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:28 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:28.836796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4ba8fe19-dd13-4b81-9e16-b1c9e785160f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:28.837434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4ba8fe19-dd13-4b81-9e16-b1c9e785160f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:28.843416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ba8fe19-dd13-4b81-9e16-b1c9e785160f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:28.843913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ba8fe19-dd13-4b81-9e16-b1c9e785160f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:28.844430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ba8fe19-dd13-4b81-9e16-b1c9e785160f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:28.845111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ba8fe19-dd13-4b81-9e16-b1c9e785160f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:28.845552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ba8fe19-dd13-4b81-9e16-b1c9e785160f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:28.845966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ba8fe19-dd13-4b81-9e16-b1c9e785160f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:28.867607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-4ba8fe19-dd13-4b81-9e16-b1c9e785160f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lazy-loading 'flavor' on Instance uuid dc407ff3-fc1e-44bf-9c20-73203361a20f {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:33:29.042489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4ba8fe19-dd13-4b81-9e16-b1c9e785160f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/action" status: 202 len: 0 microversion: 2.20 time: 0.209641 Aug 06 12:33:29.043065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 195/380] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Aug 6 12:33:28 2022] POST /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 12:33:29.052012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:29.052643 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:29.059230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:29.059724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:29.060257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:29.061003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:29.061455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:29.061961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:29.203425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:29.211308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:29.212822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:29.213969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f2144a45-6800-486c-9964-bdbc795a705a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.165858 Aug 06 12:33:29.214528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 186/381] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:29.842791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c8241a5f-c3a4-4ebc-8f8c-b22d9661166e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:29.843520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c8241a5f-c3a4-4ebc-8f8c-b22d9661166e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:29.850255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8241a5f-c3a4-4ebc-8f8c-b22d9661166e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:29.850731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8241a5f-c3a4-4ebc-8f8c-b22d9661166e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:29.851161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8241a5f-c3a4-4ebc-8f8c-b22d9661166e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:29.851838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8241a5f-c3a4-4ebc-8f8c-b22d9661166e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:29.852286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8241a5f-c3a4-4ebc-8f8c-b22d9661166e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:29.852730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8241a5f-c3a4-4ebc-8f8c-b22d9661166e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:29.984632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c8241a5f-c3a4-4ebc-8f8c-b22d9661166e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:29.992249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c8241a5f-c3a4-4ebc-8f8c-b22d9661166e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.153659 Aug 06 12:33:29.992847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 196/382] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:29 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:30.237038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:30.237573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:30.244145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:30.244665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:30.245099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:30.245780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:30.246231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:30.246650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:30.373835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:30.381893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:30.383382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:30.384565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0f31d0f-c4ad-42d5-8081-47089d45494c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.152093 Aug 06 12:33:30.385329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 187/383] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:31.012571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4a7c6549-38ea-4946-be9e-530b151464c8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:31.013169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4a7c6549-38ea-4946-be9e-530b151464c8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:31.019579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a7c6549-38ea-4946-be9e-530b151464c8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:31.020050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a7c6549-38ea-4946-be9e-530b151464c8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:31.020586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a7c6549-38ea-4946-be9e-530b151464c8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:31.021264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a7c6549-38ea-4946-be9e-530b151464c8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:31.021706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a7c6549-38ea-4946-be9e-530b151464c8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:31.022120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a7c6549-38ea-4946-be9e-530b151464c8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:31.150887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4a7c6549-38ea-4946-be9e-530b151464c8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:31.158157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4a7c6549-38ea-4946-be9e-530b151464c8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1267 microversion: 2.1 time: 0.149439 Aug 06 12:33:31.158711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 197/384] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:31 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:33:31.407001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:31.407605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:31.414479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:31.414965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:31.415424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:31.416151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:31.416652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:31.417109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:31.551230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:31.559033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:31.560729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:31.561880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-353080a3-865b-42fa-819e-51c31c798881 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.158747 Aug 06 12:33:31.562429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 188/385] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:32.178697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9e7381e5-444b-4430-ae66-f57bdcaedc6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:32.179327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9e7381e5-444b-4430-ae66-f57bdcaedc6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:32.185206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e7381e5-444b-4430-ae66-f57bdcaedc6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:32.185682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e7381e5-444b-4430-ae66-f57bdcaedc6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:32.186111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e7381e5-444b-4430-ae66-f57bdcaedc6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:32.186789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e7381e5-444b-4430-ae66-f57bdcaedc6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:32.187237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e7381e5-444b-4430-ae66-f57bdcaedc6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:32.188274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e7381e5-444b-4430-ae66-f57bdcaedc6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:32.314571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e7381e5-444b-4430-ae66-f57bdcaedc6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:32.322288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9e7381e5-444b-4430-ae66-f57bdcaedc6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1454 microversion: 2.1 time: 0.147460 Aug 06 12:33:32.322838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 198/386] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:32 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:32.341546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-593b9abe-fc99-41f6-9ee9-64c5394ff92d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:32.342148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-593b9abe-fc99-41f6-9ee9-64c5394ff92d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:32.349485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-593b9abe-fc99-41f6-9ee9-64c5394ff92d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:32.349958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-593b9abe-fc99-41f6-9ee9-64c5394ff92d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:32.350385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-593b9abe-fc99-41f6-9ee9-64c5394ff92d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:32.351067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-593b9abe-fc99-41f6-9ee9-64c5394ff92d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:32.351532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-593b9abe-fc99-41f6-9ee9-64c5394ff92d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:32.351950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-593b9abe-fc99-41f6-9ee9-64c5394ff92d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:32.478274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-593b9abe-fc99-41f6-9ee9-64c5394ff92d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:32.485770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-593b9abe-fc99-41f6-9ee9-64c5394ff92d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1454 microversion: 2.1 time: 0.147992 Aug 06 12:33:32.486322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 189/387] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:32 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:33:32.585288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:32.585885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:32.591958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:32.592481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:32.592909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:32.593596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:32.594584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:32.594999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:32.843516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:32.851892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:32.853406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:32.854559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-61b525d3-22b0-4b40-91a8-9e17df49774a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.273120 Aug 06 12:33:32.855107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 199/388] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:33:33.664349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cb2d2aa2-c1c1-48d2-89f8-21cb39c0d05f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: .version_select at 0x7f541aae2f70>, body: {"keypair": {"name": "tempest-keypair-1219361234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjy84HfiOFj+pMlbif6SW2FjUdLpQ09Bo6Zs73eBeOq6tEKcjE3RFcNQTLkzAdFbh5BOV5w9Up2bRinu9i908QCqOthfc65Y5FqJe6i3SKh6yrIUN9ptdZ2mhKwm9lnrw=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:33.680588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-cb2d2aa2-c1c1-48d2-89f8-21cb39c0d05f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:33:33.684725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-cb2d2aa2-c1c1-48d2-89f8-21cb39c0d05f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for user 1125a0b93c9d45ccb2d3f28f188dfd04 and project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:33:33.706617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cb2d2aa2-c1c1-48d2-89f8-21cb39c0d05f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046145 Aug 06 12:33:33.707239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 190/389] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Aug 6 12:33:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:33:33.878297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:33.878999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:33.884879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:33.885360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:33.885789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:33.886478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:33.886928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:33.887349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:34.146691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:34.154878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:34.156399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:34.157563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-677e68e8-f673-4442-9c77-9f5bd9f3ff7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.283827 Aug 06 12:33:34.158116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 200/390] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:33:35.068601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-41dcd680-bb3f-45a7-a0ec-7ef1daaa3745 req-f1f0a95b-663e-4f02-9454-505e0827398b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cc50006-2952-4463-9098-a8a944a259e3", "tag": "586919cc-a13c-423a-bbd6-47811a8e0a67"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:35.080815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-41dcd680-bb3f-45a7-a0ec-7ef1daaa3745 req-f1f0a95b-663e-4f02-9454-505e0827398b service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:35.081601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-41dcd680-bb3f-45a7-a0ec-7ef1daaa3745 req-f1f0a95b-663e-4f02-9454-505e0827398b service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:35.082115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-41dcd680-bb3f-45a7-a0ec-7ef1daaa3745 req-f1f0a95b-663e-4f02-9454-505e0827398b service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:35.093398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-41dcd680-bb3f-45a7-a0ec-7ef1daaa3745 req-f1f0a95b-663e-4f02-9454-505e0827398b service nova] Creating event network-changed:586919cc-a13c-423a-bbd6-47811a8e0a67 for instance 5cc50006-2952-4463-9098-a8a944a259e3 on hv-cinder-85199 Aug 06 12:33:35.098463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-41dcd680-bb3f-45a7-a0ec-7ef1daaa3745 req-f1f0a95b-663e-4f02-9454-505e0827398b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033703 Aug 06 12:33:35.099284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 191/391] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:33:35.182785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:35.183743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:35.190431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:35.191669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:35.192595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:35.193162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:35.193974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:35.194463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:35.432169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:35.451798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:35.455142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:35.456421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b8949022-7f49-41cf-b7f6-c9297bbb1dd7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.277817 Aug 06 12:33:35.470311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 201/392] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:35.693990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-117306350", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eedc16df-3c43-4b30-b37e-93e76fe94c3d"}], "security_groups": [{"name": "tempest-securitygroup--1816117363"}], "key_name": "tempest-keypair-1219361234", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:35.807377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] validate_networks() for [('eedc16df-3c43-4b30-b37e-93e76fe94c3d', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:33:36.199555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:33:36.200201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:33:36.200637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:33:36.201112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:33:36.201624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:33:36.211098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:36.211578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:36.212008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:36.212768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:36.213219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:36.213642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:36.230063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:33:36.234011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for user 1125a0b93c9d45ccb2d3f28f188dfd04 and project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:33:36.245340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:33:36.247614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:33:36.295349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9d565563-fcfb-45ed-9704-3dce96b7a6ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.605920 Aug 06 12:33:36.295983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 192/393] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:33:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 12:33:36.307156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a578f9b8-e191-4d6a-82f0-df1767698ba3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:36.307655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a578f9b8-e191-4d6a-82f0-df1767698ba3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:36.377650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a578f9b8-e191-4d6a-82f0-df1767698ba3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:36.384645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a578f9b8-e191-4d6a-82f0-df1767698ba3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1241 microversion: 2.1 time: 0.081268 Aug 06 12:33:36.385085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 202/394] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:36 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:36.481297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:36.481907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:36.489641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:36.490206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:36.490722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:36.491506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:36.492111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:36.492730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:36.634869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:36.642912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:36.644624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:36.645788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a3680d3c-1df2-4d5f-b3c4-83c211fd2e05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.168439 Aug 06 12:33:36.658201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 193/395] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:37.405562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7c4b6910-ef44-4df8-8a97-f61ada03d1af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:37.406657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7c4b6910-ef44-4df8-8a97-f61ada03d1af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:37.412585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c4b6910-ef44-4df8-8a97-f61ada03d1af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:37.413067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c4b6910-ef44-4df8-8a97-f61ada03d1af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:37.413502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c4b6910-ef44-4df8-8a97-f61ada03d1af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:37.414185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c4b6910-ef44-4df8-8a97-f61ada03d1af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:37.414636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c4b6910-ef44-4df8-8a97-f61ada03d1af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:37.415058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c4b6910-ef44-4df8-8a97-f61ada03d1af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:37.477086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7c4b6910-ef44-4df8-8a97-f61ada03d1af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:37.484271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7c4b6910-ef44-4df8-8a97-f61ada03d1af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1293 microversion: 2.1 time: 0.082557 Aug 06 12:33:37.484853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 203/396] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:37 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:37.667906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:37.668504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:37.675309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:37.675939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:37.676402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:37.677092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:37.677539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:37.677952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:37.893041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:37.900810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:37.902288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:37.903431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5bd62754-adab-4649-8d46-c13d78538f76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.239535 Aug 06 12:33:37.903978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 194/397] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:33:38.505812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4bc63fd-7873-47b5-8243-22127c7fcb34 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:38.506446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c4bc63fd-7873-47b5-8243-22127c7fcb34 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:38.512551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4bc63fd-7873-47b5-8243-22127c7fcb34 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:38.513041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4bc63fd-7873-47b5-8243-22127c7fcb34 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:38.513471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4bc63fd-7873-47b5-8243-22127c7fcb34 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:38.514269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4bc63fd-7873-47b5-8243-22127c7fcb34 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:38.514747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4bc63fd-7873-47b5-8243-22127c7fcb34 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:38.515252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4bc63fd-7873-47b5-8243-22127c7fcb34 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:38.660995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c4bc63fd-7873-47b5-8243-22127c7fcb34 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:38.670155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c4bc63fd-7873-47b5-8243-22127c7fcb34 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1367 microversion: 2.1 time: 0.168135 Aug 06 12:33:38.670733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 204/398] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:38 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:38.925939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:38.926535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:38.932819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:38.933328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:38.933753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:38.934434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:38.934960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:38.935381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:39.393474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:39.401390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:39.402883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:39.404251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-405378da-ba70-435a-848c-ff8162b807d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.482280 Aug 06 12:33:39.404834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 195/399] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:39.517688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-51580a2b-315f-42f5-ad99-1efbdfc92fea req-2b70f3ee-e47f-4006-879b-85f5d54c4ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c96e9f1-196d-4e86-a163-58a64e30ae58", "tag": "6390bd46-0ea5-482b-9163-12625693fc0b"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:39.533961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-51580a2b-315f-42f5-ad99-1efbdfc92fea req-2b70f3ee-e47f-4006-879b-85f5d54c4ee5 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:39.534434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-51580a2b-315f-42f5-ad99-1efbdfc92fea req-2b70f3ee-e47f-4006-879b-85f5d54c4ee5 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:39.534851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-51580a2b-315f-42f5-ad99-1efbdfc92fea req-2b70f3ee-e47f-4006-879b-85f5d54c4ee5 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:39.545865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-51580a2b-315f-42f5-ad99-1efbdfc92fea req-2b70f3ee-e47f-4006-879b-85f5d54c4ee5 service nova] Creating event network-changed:6390bd46-0ea5-482b-9163-12625693fc0b for instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 on hv-cinder-85199 Aug 06 12:33:39.551229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-51580a2b-315f-42f5-ad99-1efbdfc92fea req-2b70f3ee-e47f-4006-879b-85f5d54c4ee5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037161 Aug 06 12:33:39.552431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 205/400] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:33:39.703328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8c6e9f9-6a63-460f-98fa-64c213b388cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:39.704055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8c6e9f9-6a63-460f-98fa-64c213b388cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:39.710085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c6e9f9-6a63-460f-98fa-64c213b388cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:39.710679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c6e9f9-6a63-460f-98fa-64c213b388cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:39.711228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c6e9f9-6a63-460f-98fa-64c213b388cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:39.712021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c6e9f9-6a63-460f-98fa-64c213b388cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:39.712601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c6e9f9-6a63-460f-98fa-64c213b388cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:39.713119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c6e9f9-6a63-460f-98fa-64c213b388cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:39.937472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8c6e9f9-6a63-460f-98fa-64c213b388cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:39.944945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8c6e9f9-6a63-460f-98fa-64c213b388cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1367 microversion: 2.1 time: 0.245788 Aug 06 12:33:39.945413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 196/401] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:39 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:40.427500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:40.428190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:40.434343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:40.434821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:40.435253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:40.435938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:40.436421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:40.436847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:40.569039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:40.577284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:40.579518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:40.580714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9e5fa064-8e45-443f-b532-f09860a36ab0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.157460 Aug 06 12:33:40.581262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 206/402] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:40.965090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ec21937a-fa75-4d61-85fa-945db593b1ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:40.965694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ec21937a-fa75-4d61-85fa-945db593b1ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:40.972755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec21937a-fa75-4d61-85fa-945db593b1ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:40.973267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec21937a-fa75-4d61-85fa-945db593b1ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:40.973699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec21937a-fa75-4d61-85fa-945db593b1ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:40.974382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec21937a-fa75-4d61-85fa-945db593b1ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:40.974833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec21937a-fa75-4d61-85fa-945db593b1ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:40.975252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec21937a-fa75-4d61-85fa-945db593b1ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:40.990275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:41.120270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ec21937a-fa75-4d61-85fa-945db593b1ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:41.127668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ec21937a-fa75-4d61-85fa-945db593b1ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1367 microversion: 2.1 time: 0.166445 Aug 06 12:33:41.128230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 197/403] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:40 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:41.603502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:41.604101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:41.610099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:41.610571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:41.610994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:41.611673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:41.612164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:41.612649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:41.739944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:41.747820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:41.749379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:41.751079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f085133a-4b3b-42f1-afe8-6a07c719b64d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.151440 Aug 06 12:33:41.751623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 207/404] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:41.854163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-31a73eb8-5192-485e-b83a-0ed0644ec1ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b06352f6-f253-4e35-a2e6-783d391edbd0", "device": "/dev/sdb"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:41.857087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-31a73eb8-5192-485e-b83a-0ed0644ec1ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:41.863485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a73eb8-5192-485e-b83a-0ed0644ec1ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:41.864235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a73eb8-5192-485e-b83a-0ed0644ec1ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:41.864697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a73eb8-5192-485e-b83a-0ed0644ec1ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:41.865395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a73eb8-5192-485e-b83a-0ed0644ec1ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:41.865851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a73eb8-5192-485e-b83a-0ed0644ec1ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:41.866279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a73eb8-5192-485e-b83a-0ed0644ec1ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:42.148576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3347b370-f563-41a2-8a21-de0b7301b7c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:42.149105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3347b370-f563-41a2-8a21-de0b7301b7c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:42.154946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3347b370-f563-41a2-8a21-de0b7301b7c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:42.155414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3347b370-f563-41a2-8a21-de0b7301b7c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:42.156428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3347b370-f563-41a2-8a21-de0b7301b7c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:42.157099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3347b370-f563-41a2-8a21-de0b7301b7c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:42.157541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3347b370-f563-41a2-8a21-de0b7301b7c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:42.157953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3347b370-f563-41a2-8a21-de0b7301b7c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:42.282558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3347b370-f563-41a2-8a21-de0b7301b7c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:42.289822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3347b370-f563-41a2-8a21-de0b7301b7c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1367 microversion: 2.1 time: 0.145173 Aug 06 12:33:42.290471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 208/405] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:42 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:33:42.773670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:42.774291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:42.780071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:42.780577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:42.781332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:42.782008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:42.782449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:42.782862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:42.910306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:42.918033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:42.919512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:42.920675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1590e155-84d7-43f6-b389-f0837a81a914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.150902 Aug 06 12:33:42.921225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 209/406] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:33:43.310983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ab9c0f21-83d6-482f-80ac-e9d8e5de4629 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:43.311589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ab9c0f21-83d6-482f-80ac-e9d8e5de4629 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:43.317496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab9c0f21-83d6-482f-80ac-e9d8e5de4629 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:43.318038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab9c0f21-83d6-482f-80ac-e9d8e5de4629 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:43.318467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab9c0f21-83d6-482f-80ac-e9d8e5de4629 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:43.319143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab9c0f21-83d6-482f-80ac-e9d8e5de4629 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:43.319592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab9c0f21-83d6-482f-80ac-e9d8e5de4629 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:43.320006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab9c0f21-83d6-482f-80ac-e9d8e5de4629 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:43.456863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ab9c0f21-83d6-482f-80ac-e9d8e5de4629 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:43.465745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ab9c0f21-83d6-482f-80ac-e9d8e5de4629 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1367 microversion: 2.1 time: 0.158539 Aug 06 12:33:43.470763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 210/407] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:43 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:33:43.567351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-31a73eb8-5192-485e-b83a-0ed0644ec1ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "POST /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.717021 Aug 06 12:33:43.568268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 198/408] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 12:33:41 2022] POST /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2/os-volume_attachments => generated 194 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:33:43.943505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:43.944112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:43.950082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:43.950556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:43.950987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:43.951669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:43.952124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:43.953092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:43.955686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:44.089035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:44.096995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:44.098474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:44.099616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7115b163-ad9c-4f10-940a-a1409995921a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.160128 Aug 06 12:33:44.100159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 211/409] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:44.488056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-926effd6-aaa9-4a68-976a-11ae62970ce8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:44.489040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-926effd6-aaa9-4a68-976a-11ae62970ce8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:44.495244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926effd6-aaa9-4a68-976a-11ae62970ce8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:44.495705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926effd6-aaa9-4a68-976a-11ae62970ce8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:44.496135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926effd6-aaa9-4a68-976a-11ae62970ce8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:44.496845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926effd6-aaa9-4a68-976a-11ae62970ce8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:44.497298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926effd6-aaa9-4a68-976a-11ae62970ce8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:44.497718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926effd6-aaa9-4a68-976a-11ae62970ce8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:44.635258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-926effd6-aaa9-4a68-976a-11ae62970ce8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:44.642927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-926effd6-aaa9-4a68-976a-11ae62970ce8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1367 microversion: 2.1 time: 0.160059 Aug 06 12:33:44.643488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 199/410] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:44 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:45.122681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:45.123304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:45.129632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:45.130097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:45.130520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:45.131186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:45.131626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:45.132034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:45.259094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:45.267746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:45.269288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:45.270433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8cae4f3a-477f-4df3-ae93-4de5539aac4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1724 microversion: 2.20 time: 0.151859 Aug 06 12:33:45.270983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 212/411] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:45.663346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-218bbf2d-518b-4681-b0d2-2b96d7c2975a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:45.663958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-218bbf2d-518b-4681-b0d2-2b96d7c2975a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:45.670407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218bbf2d-518b-4681-b0d2-2b96d7c2975a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:45.670891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218bbf2d-518b-4681-b0d2-2b96d7c2975a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:45.671836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218bbf2d-518b-4681-b0d2-2b96d7c2975a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:45.672559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218bbf2d-518b-4681-b0d2-2b96d7c2975a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:45.673013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218bbf2d-518b-4681-b0d2-2b96d7c2975a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:45.673438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218bbf2d-518b-4681-b0d2-2b96d7c2975a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:45.802796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-218bbf2d-518b-4681-b0d2-2b96d7c2975a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:45.810734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-218bbf2d-518b-4681-b0d2-2b96d7c2975a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1367 microversion: 2.1 time: 0.151177 Aug 06 12:33:45.811301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 200/412] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:45 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:46.292836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:46.293446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:46.299886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:46.300533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:46.301023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:46.301728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:46.302292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:46.302771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:46.385374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:46.433566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:46.442043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:46.443541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:46.444715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-473c54c5-fabd-45c8-aa56-7060b3c9fddc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1745 microversion: 2.20 time: 0.155730 Aug 06 12:33:46.445271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 213/413] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:33:46.831887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0b70fab3-22ec-4c3e-9453-1161cc852afe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:46.832634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0b70fab3-22ec-4c3e-9453-1161cc852afe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:46.835114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:46.835848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=10 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:46.842272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b70fab3-22ec-4c3e-9453-1161cc852afe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:46.842870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b70fab3-22ec-4c3e-9453-1161cc852afe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:46.843821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b70fab3-22ec-4c3e-9453-1161cc852afe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:46.844605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b70fab3-22ec-4c3e-9453-1161cc852afe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:46.845102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b70fab3-22ec-4c3e-9453-1161cc852afe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:46.845529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b70fab3-22ec-4c3e-9453-1161cc852afe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:46.907557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-dc26837b-5aa4-4ca2-a644-be266562f439 req-464ebde1-9b16-4c17-bb77-55243f6b640f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c96e9f1-196d-4e86-a163-58a64e30ae58", "name": "network-vif-plugged", "status": "completed", "tag": "6390bd46-0ea5-482b-9163-12625693fc0b"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:46.922354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-dc26837b-5aa4-4ca2-a644-be266562f439 req-464ebde1-9b16-4c17-bb77-55243f6b640f service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:46.923388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-dc26837b-5aa4-4ca2-a644-be266562f439 req-464ebde1-9b16-4c17-bb77-55243f6b640f service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:46.923992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-dc26837b-5aa4-4ca2-a644-be266562f439 req-464ebde1-9b16-4c17-bb77-55243f6b640f service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:46.937455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-dc26837b-5aa4-4ca2-a644-be266562f439 req-464ebde1-9b16-4c17-bb77-55243f6b640f service nova] Creating event network-vif-plugged:6390bd46-0ea5-482b-9163-12625693fc0b for instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 on hv-cinder-85199 Aug 06 12:33:46.942589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-dc26837b-5aa4-4ca2-a644-be266562f439 req-464ebde1-9b16-4c17-bb77-55243f6b640f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038576 Aug 06 12:33:46.943271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 214/414] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:33:46.993810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0b70fab3-22ec-4c3e-9453-1161cc852afe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:47.001928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0b70fab3-22ec-4c3e-9453-1161cc852afe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1367 microversion: 2.1 time: 0.174001 Aug 06 12:33:47.002488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 201/415] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:46 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:47.468610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:47.469223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:47.475246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:47.475723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:47.476148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:47.476849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:47.477296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:47.477716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:47.608227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:47.616962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:47.618480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:47.619620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b00d4e0c-2253-4a48-b833-4a5765e7dba0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1745 microversion: 2.20 time: 0.155873 Aug 06 12:33:47.620172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 215/416] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:48.022150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f3a6e093-1db3-4aac-b96c-5dc3abc4dc53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:48.022753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f3a6e093-1db3-4aac-b96c-5dc3abc4dc53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:48.029383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3a6e093-1db3-4aac-b96c-5dc3abc4dc53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:48.029864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3a6e093-1db3-4aac-b96c-5dc3abc4dc53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:48.030297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3a6e093-1db3-4aac-b96c-5dc3abc4dc53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:48.031679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3a6e093-1db3-4aac-b96c-5dc3abc4dc53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:48.032133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3a6e093-1db3-4aac-b96c-5dc3abc4dc53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:48.032582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3a6e093-1db3-4aac-b96c-5dc3abc4dc53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:48.162410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f3a6e093-1db3-4aac-b96c-5dc3abc4dc53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:48.169711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f3a6e093-1db3-4aac-b96c-5dc3abc4dc53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1367 microversion: 2.1 time: 0.151429 Aug 06 12:33:48.170305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 202/417] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:48 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:48.642847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:48.643442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:48.645412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=60 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:48.650669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:48.651144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:48.651574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:48.652257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:48.652731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:48.653147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:48.781989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:48.789963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:48.791423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:48.792583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5b682a12-88e7-478f-8f6c-6064711af19e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1745 microversion: 2.20 time: 0.154118 Aug 06 12:33:48.793133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 216/418] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:49.190682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e616b1c-7eec-4a2e-8ce0-c3f197b03b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:49.191286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e616b1c-7eec-4a2e-8ce0-c3f197b03b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:49.197654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e616b1c-7eec-4a2e-8ce0-c3f197b03b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:49.198127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e616b1c-7eec-4a2e-8ce0-c3f197b03b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:49.198558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e616b1c-7eec-4a2e-8ce0-c3f197b03b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:49.199242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e616b1c-7eec-4a2e-8ce0-c3f197b03b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:49.199699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e616b1c-7eec-4a2e-8ce0-c3f197b03b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:49.200119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e616b1c-7eec-4a2e-8ce0-c3f197b03b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:49.329884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e616b1c-7eec-4a2e-8ce0-c3f197b03b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:49.337316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e616b1c-7eec-4a2e-8ce0-c3f197b03b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1367 microversion: 2.1 time: 0.151126 Aug 06 12:33:49.337880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 203/419] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:49 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:33:49.815546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:49.816145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:49.822001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:49.822472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:49.822896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:49.823567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:49.824010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:49.824455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:49.961403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:49.969473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:49.970965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:49.972193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-55ea4e7a-478f-48c7-96cf-b24207cf6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1745 microversion: 2.20 time: 0.160966 Aug 06 12:33:49.972772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 217/420] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:50.357472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1b21fcba-5d88-4749-84c4-2c0b8f87d296 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:50.358071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1b21fcba-5d88-4749-84c4-2c0b8f87d296 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:50.365291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b21fcba-5d88-4749-84c4-2c0b8f87d296 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:50.365769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b21fcba-5d88-4749-84c4-2c0b8f87d296 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:50.366195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b21fcba-5d88-4749-84c4-2c0b8f87d296 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:50.366870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b21fcba-5d88-4749-84c4-2c0b8f87d296 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:50.367317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b21fcba-5d88-4749-84c4-2c0b8f87d296 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:50.367733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b21fcba-5d88-4749-84c4-2c0b8f87d296 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:50.502254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1b21fcba-5d88-4749-84c4-2c0b8f87d296 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:50.509604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1b21fcba-5d88-4749-84c4-2c0b8f87d296 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1557 microversion: 2.1 time: 0.156057 Aug 06 12:33:50.510165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 204/421] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:33:50 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:33:50.529780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f7d4d867-e48d-42e9-aa53-1c18716300d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:50.530785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f7d4d867-e48d-42e9-aa53-1c18716300d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:50.536534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d4d867-e48d-42e9-aa53-1c18716300d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:50.537006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d4d867-e48d-42e9-aa53-1c18716300d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:50.537429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d4d867-e48d-42e9-aa53-1c18716300d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:50.538100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d4d867-e48d-42e9-aa53-1c18716300d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:50.538544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d4d867-e48d-42e9-aa53-1c18716300d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:50.538957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d4d867-e48d-42e9-aa53-1c18716300d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:50.614766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f7d4d867-e48d-42e9-aa53-1c18716300d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089220 Aug 06 12:33:50.615339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 218/422] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Aug 6 12:33:50 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:33:50.919142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-fcf3c2a7-8149-4eeb-80ed-94d497378128 req-da144e68-b317-4f3b-beed-5cc768e524d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc407ff3-fc1e-44bf-9c20-73203361a20f", "name": "network-vif-plugged", "status": "completed", "tag": "38e012d9-8547-43fd-8f63-fc6e18d35361"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:50.931117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-fcf3c2a7-8149-4eeb-80ed-94d497378128 req-da144e68-b317-4f3b-beed-5cc768e524d6 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:50.931599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-fcf3c2a7-8149-4eeb-80ed-94d497378128 req-da144e68-b317-4f3b-beed-5cc768e524d6 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:50.932027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-fcf3c2a7-8149-4eeb-80ed-94d497378128 req-da144e68-b317-4f3b-beed-5cc768e524d6 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:50.944000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-fcf3c2a7-8149-4eeb-80ed-94d497378128 req-da144e68-b317-4f3b-beed-5cc768e524d6 service nova] Creating event network-vif-plugged:38e012d9-8547-43fd-8f63-fc6e18d35361 for instance dc407ff3-fc1e-44bf-9c20-73203361a20f on hv-cinder-85199 Aug 06 12:33:50.949890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-fcf3c2a7-8149-4eeb-80ed-94d497378128 req-da144e68-b317-4f3b-beed-5cc768e524d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034748 Aug 06 12:33:50.950849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 205/423] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:33:50.996523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:50.998255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:51.009912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:51.010750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:51.011187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:51.012013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:51.012492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:51.013074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:51.316629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:51.324834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:51.326597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:51.328566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a4d180e2-c25f-4beb-8379-763da7bf63ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1745 microversion: 2.20 time: 0.337253 Aug 06 12:33:51.329119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 219/424] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1745 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:51.879846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-78d61b1d-c361-4c2f-aead-4f578b8514d9 req-d6f2acc5-efb6-4ba5-b3a7-e55da935da42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c96e9f1-196d-4e86-a163-58a64e30ae58", "tag": "6390bd46-0ea5-482b-9163-12625693fc0b"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:33:51.884762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:33:51.892242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-78d61b1d-c361-4c2f-aead-4f578b8514d9 req-d6f2acc5-efb6-4ba5-b3a7-e55da935da42 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:51.892849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-78d61b1d-c361-4c2f-aead-4f578b8514d9 req-d6f2acc5-efb6-4ba5-b3a7-e55da935da42 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:51.893321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-78d61b1d-c361-4c2f-aead-4f578b8514d9 req-d6f2acc5-efb6-4ba5-b3a7-e55da935da42 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:51.904728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-78d61b1d-c361-4c2f-aead-4f578b8514d9 req-d6f2acc5-efb6-4ba5-b3a7-e55da935da42 service nova] Creating event network-changed:6390bd46-0ea5-482b-9163-12625693fc0b for instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 on hv-cinder-85199 Aug 06 12:33:51.910011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-78d61b1d-c361-4c2f-aead-4f578b8514d9 req-d6f2acc5-efb6-4ba5-b3a7-e55da935da42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034818 Aug 06 12:33:51.913647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 206/425] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:33:52.350840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:52.351437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:52.360500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:52.360985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:52.361416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:52.367350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:52.367831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:52.368257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:52.525313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:52.534850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:52.536478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:52.537920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2112276c-36ba-4f98-aaf2-330500b2642d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1745 microversion: 2.20 time: 0.191002 Aug 06 12:33:52.538671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 220/426] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:53.562548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:53.563231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:53.569713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:53.570192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:53.570621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:53.571309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:53.571756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:53.572174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:53.702149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:53.709942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:53.711440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:53.712659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-112c5598-22cb-4870-a406-5aa473510d13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1745 microversion: 2.20 time: 0.155462 Aug 06 12:33:53.713230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 207/427] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:54.737726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:54.739272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:54.745405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:54.745877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:54.746299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:54.746985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:54.747427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:54.747841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:54.880281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:54.888113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:54.889636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:54.890797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-07fda25f-cf40-42aa-9440-427337721165 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1745 microversion: 2.20 time: 0.157767 Aug 06 12:33:54.891334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 221/428] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:55.913102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:55.913698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:55.920141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:55.920646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:55.921075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:55.922249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:55.922691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:55.923106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:56.049480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:56.057321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:56.058819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:56.059960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a991084e-c5d9-4e71-987b-55a26ab9537c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1745 microversion: 2.20 time: 0.150689 Aug 06 12:33:56.060549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 208/429] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:57.083077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:57.083710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:57.089681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:57.090153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:57.090586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:57.091263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:57.091710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:57.092127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:57.220811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:57.228657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:57.230158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:57.231300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-522cc349-0feb-4b40-9200-678bc1fc6788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1745 microversion: 2.20 time: 0.152193 Aug 06 12:33:57.231852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 222/430] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:58.253140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:58.253771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:58.260135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:58.260646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:58.261075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:58.261774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:58.262217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:58.262671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:58.412765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:58.421050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:58.422956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:58.424102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-462ca25d-d081-406e-92b7-e560b806dd05 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.175035 Aug 06 12:33:58.425239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 209/431] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:33:59.447922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:33:59.448628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:33:59.454889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:59.455711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:59.456402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:59.457217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:33:59.457812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:33:59.458179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:33:59.627515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:59.638816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:59.640588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:33:59.641934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2e9280ac-d177-498e-bebd-283f0a3dbd3c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.197787 Aug 06 12:33:59.642640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 223/432] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:33:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:00.666061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:00.666895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:00.673888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:00.674401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:00.674833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:00.675527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:00.675977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:00.676433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:00.822568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:00.833752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:00.835298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:00.836612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5dbaf541-0ed1-4454-b84a-56a4686dc9f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.174827 Aug 06 12:34:00.837346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 210/433] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:34:01.860745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:01.861348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:01.871644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:01.875092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:01.875539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:01.876253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:01.876993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:01.877413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:02.042833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:02.053514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:02.055129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:02.056333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-58226f4c-5a17-46b7-ba3b-baf0fc93c948 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.199636 Aug 06 12:34:02.056879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 224/434] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:03.084087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:03.085657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:03.092575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:03.093301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:03.093892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:03.094752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:03.095350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:03.095919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:03.292706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:03.301561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:03.303066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:03.304270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db0fca61-a6f0-4cea-b5b1-ce2a92b2177f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.224729 Aug 06 12:34:03.304872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 211/435] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:04.328986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:04.329600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:04.335436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:04.335908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:04.336358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:04.337061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:04.337508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:04.337922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:04.477662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:04.486248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:04.487734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:04.489377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bdb12ced-02ff-47c8-ad1e-1a77cf712fff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.164869 Aug 06 12:34:04.490080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 225/436] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:05.513209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:05.514776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:05.521179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:05.521740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:05.522402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:05.523178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:05.523786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:05.524434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:05.675341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:05.683497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:05.685033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:05.686193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-00322c27-d73d-44b4-bc19-f1c964fa9cff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.176980 Aug 06 12:34:05.686769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 212/437] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:06.709220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:06.709847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:06.716411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:06.717195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:06.717810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:06.719214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:06.719888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:06.720496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:06.872216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:06.884821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:06.886323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:06.887496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-00d450ff-4a32-466f-a8d2-2d55ba9edb12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.182168 Aug 06 12:34:06.888051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 226/438] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:06 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:07.912372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:07.912968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:07.921903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:07.922435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:07.922873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:07.923566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:07.924021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:07.924484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:08.067100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:08.075301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:08.076864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:08.078017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-56d11c95-7dc4-4442-a108-284b25a18f88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.170948 Aug 06 12:34:08.078583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 213/439] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:07 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:09.100603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:09.101235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:09.107143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:09.107618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:09.108050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:09.109359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:09.109815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:09.110233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:09.238290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:09.246376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:09.247861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:09.249070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5e41a074-c52b-4943-810f-c8757ff0639f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.152378 Aug 06 12:34:09.249632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 227/440] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:10.272008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:10.272583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:10.279103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:10.279540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:10.279968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:10.281339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:10.281788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:10.282210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:10.286101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:34:10.413425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:10.421322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:10.422819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:10.423965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc95c2f3-a1fc-466b-8f96-d4fda07cfe1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1740 microversion: 2.20 time: 0.155943 Aug 06 12:34:10.424549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 214/441] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:10 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:11.446366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:11.446971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:11.452959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:11.453435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:11.453887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:11.454550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:11.455000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:11.455425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:11.582150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:11.584400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:34:11.591448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:11.592913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:11.594069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4aea0425-45ed-40dd-8449-3281fae841bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1722 microversion: 2.20 time: 0.151612 Aug 06 12:34:11.594624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 228/442] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:11 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:12.617342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:12.617950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:12.624605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:12.625125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:12.625583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:12.626273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:12.626744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:12.627209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:12.756690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:12.765138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:12.766637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:12.767809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3888e9d4-53a5-431a-87dd-09c330ac6be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1722 microversion: 2.20 time: 0.154566 Aug 06 12:34:12.768755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 215/443] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:12 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:13.792414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:13.793012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:13.799354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:13.800294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:13.800747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:13.801426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:13.801872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:13.802288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:13.928448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:13.936457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:13.937972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:13.939119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-42cba3f8-3040-4592-a748-2c51436f4175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1722 microversion: 2.20 time: 0.150842 Aug 06 12:34:13.939682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 229/444] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:13 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:14.672452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad2a3566-bb1c-4d71-86e3-41ac2bcb1ccf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:14.672941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad2a3566-bb1c-4d71-86e3-41ac2bcb1ccf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:14.679386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad2a3566-bb1c-4d71-86e3-41ac2bcb1ccf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:14.679862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad2a3566-bb1c-4d71-86e3-41ac2bcb1ccf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:14.680324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad2a3566-bb1c-4d71-86e3-41ac2bcb1ccf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:14.681049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad2a3566-bb1c-4d71-86e3-41ac2bcb1ccf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:14.681503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad2a3566-bb1c-4d71-86e3-41ac2bcb1ccf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:14.681928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad2a3566-bb1c-4d71-86e3-41ac2bcb1ccf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:14.811690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-ad2a3566-bb1c-4d71-86e3-41ac2bcb1ccf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'services' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:14.934039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad2a3566-bb1c-4d71-86e3-41ac2bcb1ccf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2/os-volume_attachments/b06352f6-f253-4e35-a2e6-783d391edbd0" status: 202 len: 0 microversion: 2.1 time: 0.265247 Aug 06 12:34:14.934670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 216/445] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:34:14 2022] DELETE /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2/os-volume_attachments/b06352f6-f253-4e35-a2e6-783d391edbd0 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:34:14.963921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:14.965612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:14.972918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-7d6c876e-3bdb-40a9-bce9-09206add4db2 req-37269f17-4423-4b1a-aa25-1a33c76e2e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc407ff3-fc1e-44bf-9c20-73203361a20f", "name": "network-vif-unplugged", "status": "completed", "tag": "38e012d9-8547-43fd-8f63-fc6e18d35361"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:34:14.974333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:14.975177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:14.975847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:14.977017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:14.978448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:14.979116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:15.000595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-7d6c876e-3bdb-40a9-bce9-09206add4db2 req-37269f17-4423-4b1a-aa25-1a33c76e2e55 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:15.001905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-7d6c876e-3bdb-40a9-bce9-09206add4db2 req-37269f17-4423-4b1a-aa25-1a33c76e2e55 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:15.002486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-7d6c876e-3bdb-40a9-bce9-09206add4db2 req-37269f17-4423-4b1a-aa25-1a33c76e2e55 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:15.014831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.compute.server_external_events [req-7d6c876e-3bdb-40a9-bce9-09206add4db2 req-37269f17-4423-4b1a-aa25-1a33c76e2e55 service nova] Unable to find a host for instance dc407ff3-fc1e-44bf-9c20-73203361a20f. Dropping event network-vif-unplugged {{(pid=117825) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 12:34:15.015861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-7d6c876e-3bdb-40a9-bce9-09206add4db2 req-37269f17-4423-4b1a-aa25-1a33c76e2e55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048314 Aug 06 12:34:15.017010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 217/446] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 06 12:34:15.132573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:15.140341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:15.141828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:15.142954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fd1b0e28-ca20-4bfb-8720-1c54f25b3c11 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1665 microversion: 2.20 time: 0.183946 Aug 06 12:34:15.144223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 230/447] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1665 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:34:15.165312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aef0b9bd-26f7-45b1-8d82-83ffc32ef441 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6836193-0bd5-44ea-b1ac-808af6b765d6"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:34:15.167778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aef0b9bd-26f7-45b1-8d82-83ffc32ef441 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:15.173571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aef0b9bd-26f7-45b1-8d82-83ffc32ef441 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:15.174042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aef0b9bd-26f7-45b1-8d82-83ffc32ef441 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:15.174466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aef0b9bd-26f7-45b1-8d82-83ffc32ef441 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:15.175164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aef0b9bd-26f7-45b1-8d82-83ffc32ef441 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:15.175611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aef0b9bd-26f7-45b1-8d82-83ffc32ef441 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:15.176027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aef0b9bd-26f7-45b1-8d82-83ffc32ef441 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:15.456056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aef0b9bd-26f7-45b1-8d82-83ffc32ef441 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294426 Aug 06 12:34:15.456715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 218/448] 10.222.0.20 () {62 vars in 1364 bytes} [Sat Aug 6 12:34:15 2022] POST /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:34:15.575529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4fbb6d60-7f6c-422a-8f9b-d5110b08df93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:34:15.576115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4fbb6d60-7f6c-422a-8f9b-d5110b08df93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:15.582141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbb6d60-7f6c-422a-8f9b-d5110b08df93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:15.582616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbb6d60-7f6c-422a-8f9b-d5110b08df93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:15.583040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbb6d60-7f6c-422a-8f9b-d5110b08df93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:15.583719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbb6d60-7f6c-422a-8f9b-d5110b08df93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:15.584187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbb6d60-7f6c-422a-8f9b-d5110b08df93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:15.584647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbb6d60-7f6c-422a-8f9b-d5110b08df93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:15.625970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4fbb6d60-7f6c-422a-8f9b-d5110b08df93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117824) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 12:34:15.699432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4fbb6d60-7f6c-422a-8f9b-d5110b08df93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/action" status: 202 len: 0 microversion: 2.20 time: 0.127669 Aug 06 12:34:15.699942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 231/449] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Aug 6 12:34:15 2022] POST /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 12:34:15.708204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:15.708837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:15.715207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:15.715691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:15.716122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:15.716833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:15.717287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:15.717711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:15.858786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:15.868958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:15.870457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:15.871627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff4aaeb4-7b42-4e21-b2e3-5dba5b9fe35f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1751 microversion: 2.20 time: 0.167360 Aug 06 12:34:15.886672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 219/450] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:15 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:16.894213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:16.894811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:16.901575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:16.902052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:16.902478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:16.903495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:16.903939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:16.904378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:17.036811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:17.045068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:17.046549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:17.047688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5f6e56d8-d313-4551-a146-ab8082063358 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1753 microversion: 2.20 time: 0.157454 Aug 06 12:34:17.048232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 232/451] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:17.147871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a58957d9-ad7f-4d16-8df5-49333babba18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:17.148390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a58957d9-ad7f-4d16-8df5-49333babba18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:17.154729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a58957d9-ad7f-4d16-8df5-49333babba18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:17.155198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a58957d9-ad7f-4d16-8df5-49333babba18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:17.155625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a58957d9-ad7f-4d16-8df5-49333babba18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:17.156295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a58957d9-ad7f-4d16-8df5-49333babba18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:17.156762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a58957d9-ad7f-4d16-8df5-49333babba18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:17.157183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a58957d9-ad7f-4d16-8df5-49333babba18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:17.181730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a58957d9-ad7f-4d16-8df5-49333babba18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 12:34:17.255127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a58957d9-ad7f-4d16-8df5-49333babba18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 204 len: 0 microversion: 2.1 time: 0.110442 Aug 06 12:34:17.255714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 220/452] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:34:17 2022] DELETE /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 12:34:17.263898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c1e557b3-45d3-43c8-88af-7b5dba9a6a4f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:17.264673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c1e557b3-45d3-43c8-88af-7b5dba9a6a4f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:17.270627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1e557b3-45d3-43c8-88af-7b5dba9a6a4f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:17.271100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1e557b3-45d3-43c8-88af-7b5dba9a6a4f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:17.271529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1e557b3-45d3-43c8-88af-7b5dba9a6a4f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:17.272210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1e557b3-45d3-43c8-88af-7b5dba9a6a4f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:17.272696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1e557b3-45d3-43c8-88af-7b5dba9a6a4f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:17.273118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1e557b3-45d3-43c8-88af-7b5dba9a6a4f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:17.397681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c1e557b3-45d3-43c8-88af-7b5dba9a6a4f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:17.405823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c1e557b3-45d3-43c8-88af-7b5dba9a6a4f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1512 microversion: 2.1 time: 0.145838 Aug 06 12:34:17.406383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 233/453] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:17 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:18.071802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:18.072519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:18.078350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:18.078826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:18.079264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:18.079945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:18.080443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:18.081481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:18.211284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:18.219597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:18.221125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:18.222276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b8ca8ff6-6803-42d5-bc39-5f1ea8695e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1753 microversion: 2.20 time: 0.154704 Aug 06 12:34:18.222833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 221/454] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:18.428069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c0f013d3-4d81-4ba7-927a-eeca1a8d116a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:18.428706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c0f013d3-4d81-4ba7-927a-eeca1a8d116a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:18.434544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f013d3-4d81-4ba7-927a-eeca1a8d116a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:18.435025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f013d3-4d81-4ba7-927a-eeca1a8d116a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:18.435456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f013d3-4d81-4ba7-927a-eeca1a8d116a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:18.436141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f013d3-4d81-4ba7-927a-eeca1a8d116a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:18.436626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f013d3-4d81-4ba7-927a-eeca1a8d116a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:18.437043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f013d3-4d81-4ba7-927a-eeca1a8d116a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:18.568045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c0f013d3-4d81-4ba7-927a-eeca1a8d116a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:18.575498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c0f013d3-4d81-4ba7-927a-eeca1a8d116a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1512 microversion: 2.1 time: 0.151874 Aug 06 12:34:18.576044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 234/455] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:18 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:19.244876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:19.245428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:19.251774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:19.252256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:19.252733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:19.253403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:19.253853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:19.254274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:19.383593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:19.391863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:19.393938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:19.395086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d31a80e1-d03e-49ec-b729-342fcc045094 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.154189 Aug 06 12:34:19.395651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 222/456] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:19.596447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-39e2dd4b-f2d0-44a6-906e-934fed063318 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:19.597049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-39e2dd4b-f2d0-44a6-906e-934fed063318 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:19.598943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:34:19.604234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39e2dd4b-f2d0-44a6-906e-934fed063318 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:19.604731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39e2dd4b-f2d0-44a6-906e-934fed063318 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:19.605155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39e2dd4b-f2d0-44a6-906e-934fed063318 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:19.605831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39e2dd4b-f2d0-44a6-906e-934fed063318 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:19.606278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39e2dd4b-f2d0-44a6-906e-934fed063318 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:19.606689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39e2dd4b-f2d0-44a6-906e-934fed063318 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:19.735162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-39e2dd4b-f2d0-44a6-906e-934fed063318 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:19.742726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-39e2dd4b-f2d0-44a6-906e-934fed063318 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1512 microversion: 2.1 time: 0.150150 Aug 06 12:34:19.743281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 235/457] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:19 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:20.418729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:20.419416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:20.427186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:20.427850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:20.428579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:20.430128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:20.430586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:20.431007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:20.701157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-6aa94dc6-208e-4081-8fce-b2cfd95c0e3d req-92ace40d-c0b4-4033-aa72-ec8cdc75e8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149b38d1-c9ad-43f0-a48e-13048fb953e2", "name": "network-vif-deleted", "tag": "7395e2a4-14fe-497c-b6fb-576b75349030"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:34:20.714103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6aa94dc6-208e-4081-8fce-b2cfd95c0e3d req-92ace40d-c0b4-4033-aa72-ec8cdc75e8da service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:20.714563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6aa94dc6-208e-4081-8fce-b2cfd95c0e3d req-92ace40d-c0b4-4033-aa72-ec8cdc75e8da service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:20.714982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6aa94dc6-208e-4081-8fce-b2cfd95c0e3d req-92ace40d-c0b4-4033-aa72-ec8cdc75e8da service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:20.728611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-6aa94dc6-208e-4081-8fce-b2cfd95c0e3d req-92ace40d-c0b4-4033-aa72-ec8cdc75e8da service nova] Creating event network-vif-deleted:7395e2a4-14fe-497c-b6fb-576b75349030 for instance 149b38d1-c9ad-43f0-a48e-13048fb953e2 on hv-cinder-85199 Aug 06 12:34:20.734906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-6aa94dc6-208e-4081-8fce-b2cfd95c0e3d req-92ace40d-c0b4-4033-aa72-ec8cdc75e8da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037352 Aug 06 12:34:20.735586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 236/458] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:34:20.740185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:20.752169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:20.755002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:20.756331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1bbd8b5a-5938-4337-922a-d874f1c3ee8b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.341574 Aug 06 12:34:20.765359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2e56dd4d-93f2-48d3-847f-2a86322ac825 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:20.766135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2e56dd4d-93f2-48d3-847f-2a86322ac825 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:20.772904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e56dd4d-93f2-48d3-847f-2a86322ac825 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:20.773386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e56dd4d-93f2-48d3-847f-2a86322ac825 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:20.773822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e56dd4d-93f2-48d3-847f-2a86322ac825 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:20.774665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e56dd4d-93f2-48d3-847f-2a86322ac825 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:20.775033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e56dd4d-93f2-48d3-847f-2a86322ac825 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:20.776390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e56dd4d-93f2-48d3-847f-2a86322ac825 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:20.778115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 223/459] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:20.860744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e56dd4d-93f2-48d3-847f-2a86322ac825 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:20.870153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2e56dd4d-93f2-48d3-847f-2a86322ac825 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1302 microversion: 2.1 time: 0.109167 Aug 06 12:34:20.870944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 237/460] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:20 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1302 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:34:21.803313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:21.804050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:21.811879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:21.812768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:21.813520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:21.814764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:21.815407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:21.816210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:21.894461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:21.895805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:21.904023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:21.904538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:21.904964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:21.905658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:21.906102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:21.906515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:21.938481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:21.938956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:21.939378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:21.939820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:21.957177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:21.965645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:21.967130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:21.968340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7669937d-632b-4bf9-8e65-289699cbf59e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.169402 Aug 06 12:34:21.968912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 224/461] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:21 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:34:21.984511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:21.992906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f9c609fb-b0da-428f-90e6-18d4bfd6ac72 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.102300 Aug 06 12:34:21.993737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 238/462] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:21 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:22.992180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:22.992829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:22.995239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:34:23.000207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:23.000976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:23.001399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:23.002093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:23.002713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:23.003141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:23.014814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:23.016290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:23.027536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:23.028194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:23.028765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:23.029577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:23.032809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:23.033343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:23.074725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:23.075201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:23.075625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:23.076223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:23.123005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:23.131721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-30765433-e321-449c-9b91-150c06ef1cac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.120903 Aug 06 12:34:23.132912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 239/463] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:23 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:23.395976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:23.404556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:23.406039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:23.407177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-57fb9f2c-828e-4126-84ca-212ce8564f87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.419381 Aug 06 12:34:23.407823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 225/464] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:24.153593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:24.154222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:24.160578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:24.161065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:24.161498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:24.162189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:24.162642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:24.163065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:24.194209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:24.194725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:24.195171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:24.195615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:24.243082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:24.250693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d3a2977-65dd-4b6e-a6fa-26f65faea2d6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.100950 Aug 06 12:34:24.251194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 240/465] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:24 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:24.430294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:24.431013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:24.438472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:24.439195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:24.440078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:24.441000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:24.441981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:24.442569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:24.459273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:34:24.576320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:24.585478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:24.586982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:24.588150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1f68b699-04ce-44e1-8962-aa3723e9fd1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.161850 Aug 06 12:34:24.592567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 226/466] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:25.271045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:25.271631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:25.277499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:25.278179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:25.278776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:25.279468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:25.279910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:25.280348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:25.311764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:25.312230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:25.312690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:25.313119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:25.352160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:25.359492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a5040258-02c4-4d52-86e2-158cf34ce442 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.092352 Aug 06 12:34:25.360248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 241/467] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:25 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:25.618530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:25.619146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:25.625574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:25.626077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:25.626505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:25.627182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:25.627630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:25.628048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:25.763914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:25.772678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:25.774446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:25.775614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1dd08a86-bb52-45ee-b26e-37fe44fdd784 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.160951 Aug 06 12:34:25.776163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 227/468] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:26.381740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:26.382353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:26.388221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:26.388734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:26.389160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:26.389844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:26.390288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:26.390706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:26.423343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:26.423825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:26.424257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:26.425375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:26.469710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:26.478074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-da1a83f7-cf48-499e-8ea9-55771dd5e24d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.100486 Aug 06 12:34:26.478895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 242/469] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:26 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:26.798970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:26.799574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:26.806658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:26.807134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:26.807566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:26.808249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:26.808724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:26.809149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:26.945161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:26.953775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:26.955264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:26.956457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-103d2ad4-9423-453c-add1-c8c3ae26389b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.161296 Aug 06 12:34:26.957217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 228/470] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:27.499147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:27.499751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:27.506304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:27.506781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:27.507210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:27.507893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:27.508361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:27.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:27.524717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:34:27.543083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:27.543559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:27.543986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:27.544452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:27.585357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:27.593316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2e5b65e5-7e54-4520-b543-fd9fd9f396ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.098066 Aug 06 12:34:27.593886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 243/471] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:27 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:27.980640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:27.981301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:27.989210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:27.989769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:27.990478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:27.991412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:27.991866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:27.992502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:28.133265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:28.142901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:28.144945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:28.146102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-45af5b1f-56ae-4856-ada3-b6a387df99dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.170951 Aug 06 12:34:28.146655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 229/472] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:34:28.614006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:28.614678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:28.620828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:28.621315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:28.621743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:28.622448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:28.622896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:28.623316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:28.655374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:28.655846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:28.656288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:28.656733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:28.698731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:28.706527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-806c92ab-f502-4a6b-af6d-cf7eb23408e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.096496 Aug 06 12:34:28.707095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 244/473] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:28 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:29.169474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:29.170202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:29.177347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:29.177832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:29.178266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:29.178986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:29.179443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:29.179865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:29.318707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:29.327471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:29.329183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:29.330348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3ea77917-a454-44d7-8961-2cde6158ad5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.164867 Aug 06 12:34:29.330902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 230/474] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:29.726416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:29.727125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:29.733278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:29.733740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:29.734173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:29.734869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:29.735319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:29.735740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:29.774073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:29.774555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:29.774988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:29.775427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:29.817263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:29.825498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0e4c5565-772b-41a3-b7c7-07c45d5158e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.102858 Aug 06 12:34:29.826076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 245/475] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:29 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:30.354109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:30.354853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:30.362001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:30.362854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:30.363718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:30.364461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:30.364915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:30.365334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:30.499626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:30.509288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:30.510870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:30.512107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5ae5df0c-9b79-4489-ad1a-b18ce8330dab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.161886 Aug 06 12:34:30.512786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 231/476] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:30.845841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:30.846447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:30.852265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:30.852776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:30.853205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:30.853881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:30.854331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:30.854748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:30.886691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:30.887887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:30.888349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:30.888900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:30.933238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:30.942518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6dc15428-4c72-414f-9c23-d79e36ee8dc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.099436 Aug 06 12:34:30.942518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 246/477] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:30 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:31.535038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:31.535774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:31.543144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:31.543937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:31.544396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:31.545097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:31.545542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:31.545961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:31.684318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:31.693260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:31.694741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:31.695885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-59e48834-cf99-40a8-862a-df825dfd9617 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.164838 Aug 06 12:34:31.696658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 232/478] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:31.962947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:31.963667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:31.969745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:31.970494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:31.970995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:31.971758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:31.972341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:31.972835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:32.009974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:32.010456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:32.010883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:32.011322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:32.052911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:32.060763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-adc95f09-0928-408e-90f9-b85b877cf326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.101623 Aug 06 12:34:32.061529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 247/479] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:31 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:34:32.718951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:32.719559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:32.726504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:32.726970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:32.727398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:32.728072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:32.728544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:32.728960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:32.856180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:32.864641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:32.866121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:32.867290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f8f5c673-c6df-4e12-b33c-df1975350598 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.152164 Aug 06 12:34:32.867839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 233/480] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:33.082819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:33.083422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:33.089468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:33.089940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:33.090366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:33.091042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:33.091485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:33.091926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:33.124156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:33.124661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:33.125118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:33.125556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:33.165811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:33.173344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-06afc2ab-dee0-45b3-8469-866659060cb0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.095003 Aug 06 12:34:33.173901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 248/481] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:33 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:33.891081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:33.891677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:33.898037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:33.898509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:33.898938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:33.899612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:33.900056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:33.900522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:34.032348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:34.041049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:34.042522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:34.043660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b94f882f-9477-4c83-ae4b-31e901b37b40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.156637 Aug 06 12:34:34.044214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 234/482] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:34.193719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:34.194244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:34.200012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:34.200515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:34.200938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:34.201611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:34.202059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:34.202472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:34.232121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:34.232617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:34.233039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:34.233471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:34.273603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:34.280932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5dea59ca-c931-4293-a33d-54ae99435f44 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.091097 Aug 06 12:34:34.281477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 249/483] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:34 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:35.067488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:35.068088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:35.074463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:35.074937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:35.075364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:35.076047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:35.076526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:35.076949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:35.202690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:35.211517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:35.213055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:35.214207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b98b4341-6dda-431d-9be7-987e41cb8572 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.150608 Aug 06 12:34:35.214760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 235/484] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:35.302113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:35.302712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:35.311135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:35.311606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:35.312056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:35.312757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:35.313202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:35.313617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:35.343463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:35.343923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:35.344368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:35.344800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:35.387482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:35.395352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-86a0289d-dc86-4e75-ba87-82a4039007ec tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.097155 Aug 06 12:34:35.395908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 250/485] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:35 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:36.237156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:36.237690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:36.244332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:36.244821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:36.245248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:36.245937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:36.246386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:36.246806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:36.379783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:36.388101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:36.389630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:36.390777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1c1e75d1-6b97-4909-8f98-d6c26d854f91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.157701 Aug 06 12:34:36.391334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 236/486] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:36.414982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:36.415591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:36.421435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:36.421910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:36.422339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:36.423016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:36.423463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:36.423879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:36.454141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:36.454604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:36.455027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:36.455458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:36.495023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:36.502419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac3452dc-2e10-405a-aa57-d90510747ee5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.091260 Aug 06 12:34:36.503727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 251/487] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:36 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:37.414400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:37.414993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:37.421271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:37.421750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:37.422171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:37.422842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:37.423285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:37.423699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:37.524285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:37.524909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:37.530835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:37.531388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:37.531929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:37.532650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:37.533213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:37.533635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:37.550322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:37.558542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:37.560047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:37.561228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cffcf244-644c-430e-b83e-99d3733f4b58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.150766 Aug 06 12:34:37.561788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 237/488] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:37.563728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:37.564205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:37.564672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:37.565612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'fault' on Instance uuid 149b38d1-c9ad-43f0-a48e-13048fb953e2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:34:37.605078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:37.612168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6caceb90-fc70-4fca-aff5-09e830833ff8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 200 len: 1307 microversion: 2.1 time: 0.091724 Aug 06 12:34:37.612742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 252/489] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:37 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:34:38.593213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:38.593817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:38.600994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:38.601479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:38.601907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:38.602596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:38.603046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:38.603468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:38.632846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:38.633558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: 149b38d1-c9ad-43f0-a48e-13048fb953e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:38.639525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:38.640081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:38.640633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:38.641394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:38.641913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:38.642337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:38.657101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] HTTP exception thrown: Instance 149b38d1-c9ad-43f0-a48e-13048fb953e2 could not be found. Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Request method failure captured: Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 HTTP/1.1 Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l963ks7Y3fjt37ybAlnEYdBJkWrtwFTWydRERg2t_6bOTX4B7a_gup8czlaU-40oPKqUTj-e042VO0Q93KC9u6lgBhkQcftj6bBUmCzh4rhn9qoXOerhdvlr7uGqcmyNjXwy_RqcZUzRWmFC57t7kl3pwMgOy4uOB7hnUq62U8lhWs Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 94cc3ab0fa2d47008fc45f600ff1613a Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:34:38.658758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 94cc3ab0fa2d47008fc45f600ff1613a Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesSnapshotTestJSON-1038996424-project Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 3fc91d2e9cd24694a5aa62e9d579c8e0 Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesSnapshotTestJSON-1038996424-project Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance 149b38d1-c9ad-43f0-a48e-13048fb953e2 could not be found. Aug 06 12:34:38.660727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '149b38d1-c9ad-43f0-a48e-13048fb953e2'} Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149b38d1-c9ad-43f0-a48e-13048fb953e2 could not be found. Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:34:38.661534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149b38d1-c9ad-43f0-a48e-13048fb953e2 could not be found. Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149b38d1-c9ad-43f0-a48e-13048fb953e2 could not be found. Aug 06 12:34:38.662752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:34:38.663833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Returning 404 to user: Instance 149b38d1-c9ad-43f0-a48e-13048fb953e2 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:34:38.663833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-de74d99e-3ff1-4afe-b207-6d5e3df45c33 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2" status: 404 len: 111 microversion: 2.1 time: 0.031823 Aug 06 12:34:38.663833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 253/490] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:38 2022] GET /compute/v2.1/servers/149b38d1-c9ad-43f0-a48e-13048fb953e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 12:34:38.733282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:38.742724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:38.744326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:38.745361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7d12d1ac-b3a9-48b0-8b3c-f661aeea0a04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.164100 Aug 06 12:34:38.745919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 238/491] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:39.767892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:39.768515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:39.774962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:39.775435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:39.775859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:39.776556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:39.776999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:39.777411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:39.905533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:39.913787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:39.915269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:39.916529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-973ff31f-d23d-4b0d-ad58-20eef3229dd9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.152386 Aug 06 12:34:39.917063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 254/492] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:40.939111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:40.939708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:40.946103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:40.946576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:40.946998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:40.947675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:40.948117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:40.948555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:41.078808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:41.087530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:41.089055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:41.090197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1305a473-8d7c-4b11-93a7-f41fcfa8c8be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.155010 Aug 06 12:34:41.090747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 239/493] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:41.449739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-530a3c81-2d54-4b81-8079-1ae26b858075 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:41.450260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-530a3c81-2d54-4b81-8079-1ae26b858075 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:41.456143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-530a3c81-2d54-4b81-8079-1ae26b858075 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:41.456658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-530a3c81-2d54-4b81-8079-1ae26b858075 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:41.457090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-530a3c81-2d54-4b81-8079-1ae26b858075 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:41.457784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-530a3c81-2d54-4b81-8079-1ae26b858075 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:41.458238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-530a3c81-2d54-4b81-8079-1ae26b858075 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:41.458837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-530a3c81-2d54-4b81-8079-1ae26b858075 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:41.481329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-530a3c81-2d54-4b81-8079-1ae26b858075 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/ips" status: 200 len: 145 microversion: 2.1 time: 0.035540 Aug 06 12:34:41.481869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 255/494] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Aug 6 12:34:41 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:34:42.113915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:42.114519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:42.120892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:42.121371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:42.121803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:42.122484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:42.122936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:42.123356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:42.247369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:42.255688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:42.257216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:42.258361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b19c9caa-b40b-43a0-9bee-2ed6a43b8569 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.149007 Aug 06 12:34:42.258927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 240/495] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:43.281424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:43.281948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:43.287890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:43.288393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:43.288820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:43.289490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:43.289937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:43.290354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:43.418201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:43.427172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:43.428694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:43.429862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d9e3427a-2a4d-4a33-b0f8-823129abb645 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.152393 Aug 06 12:34:43.430399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 256/496] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:34:44.452699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:44.453304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:44.459749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:44.460173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:44.460635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:44.461322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:44.461773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:44.462194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:44.592872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:44.601887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:44.603376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:44.604553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9ef48a6b-92a3-456a-933f-75c5b7520914 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.155817 Aug 06 12:34:44.605103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 241/497] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:45.350384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cab4fb95-00b5-4e16-a0e2-3f7a16d68589 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9354b81c-bc27-4c09-8979-9050436ea9ff"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:34:45.352698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cab4fb95-00b5-4e16-a0e2-3f7a16d68589 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:45.359049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cab4fb95-00b5-4e16-a0e2-3f7a16d68589 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:45.359416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cab4fb95-00b5-4e16-a0e2-3f7a16d68589 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:45.359840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cab4fb95-00b5-4e16-a0e2-3f7a16d68589 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:45.360547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cab4fb95-00b5-4e16-a0e2-3f7a16d68589 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:45.361050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cab4fb95-00b5-4e16-a0e2-3f7a16d68589 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:45.361446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cab4fb95-00b5-4e16-a0e2-3f7a16d68589 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:45.433055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:34:45.629144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:45.629773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:45.637188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:45.638447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:45.638920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:45.640024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:45.640677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:45.641261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:45.658073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cab4fb95-00b5-4e16-a0e2-3f7a16d68589 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "POST /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311754 Aug 06 12:34:45.658888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 257/498] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 12:34:45 2022] POST /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:34:45.779751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:45.788491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:45.790030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:45.791175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19054bf6-7ceb-4713-af39-3fad7ae924c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.166621 Aug 06 12:34:45.791731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 242/499] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:34:46.815186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:46.816610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:46.823200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:46.823671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:46.824095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:46.824797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:46.825237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:46.825653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:46.951532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:46.959745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:46.961261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:46.962408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cdbe74e6-49e0-4a24-89f1-c21d5c4c5b1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.151918 Aug 06 12:34:46.962952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 258/500] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:47.985601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:47.986227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:47.992967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:47.993449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:47.993879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:47.994569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:47.995020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:47.995444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:47.998079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:34:48.122855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:48.131611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:48.133130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:48.134567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c2256beb-a783-4aa3-92bf-35b1b48d58e1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.152606 Aug 06 12:34:48.134828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 243/501] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:49.157066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:49.157588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:49.163883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:49.164379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:49.164830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:49.165504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:49.165941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:49.166351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:49.295832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:49.304735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:49.306236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:49.307383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a853ef57-d270-45a1-9912-a386bfb17aba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.154271 Aug 06 12:34:49.307941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 259/502] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:50.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:50.331708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:50.338198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:50.338666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:50.339091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:50.339769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:50.340213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:50.340653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:50.470520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:50.478666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:50.480179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:50.481348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f4907c60-a6e1-401f-af0f-a39ddf7e532b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.154830 Aug 06 12:34:50.481899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 244/503] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:50.559595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1630783770", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "networks": [{"uuid": "c8f9b58d-e4cf-46db-b86b-2d40bd023127"}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:34:50.568724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=80 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:34:50.628987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] validate_networks() for [('c8f9b58d-e4cf-46db-b86b-2d40bd023127', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:34:50.979392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:34:50.979914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:34:50.980502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:34:50.981012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:34:50.981516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:34:50.991363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:50.991840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:50.992496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:50.993378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:50.994000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:50.994576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:51.015911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Getting quotas for project 94cc3ab0fa2d47008fc45f600ff1613a. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:34:51.019802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Getting quotas for user 3fc91d2e9cd24694a5aa62e9d579c8e0 and project 94cc3ab0fa2d47008fc45f600ff1613a. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:34:51.030440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:34:51.032736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:34:51.076872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6822797f-8b6f-4a62-a8b6-ceb9793dc91a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520979 Aug 06 12:34:51.077507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 260/504] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 12:34:51.088452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9397de58-4b17-40b9-b1d4-303ffde813b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:51.089096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9397de58-4b17-40b9-b1d4-303ffde813b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:51.143772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9397de58-4b17-40b9-b1d4-303ffde813b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:51.150498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9397de58-4b17-40b9-b1d4-303ffde813b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1219 microversion: 2.1 time: 0.065965 Aug 06 12:34:51.151169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 245/505] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:51 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:51.506728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:51.507366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:51.513414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:51.513896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:51.514352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:51.515041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:51.515496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:51.515912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:51.585472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-19c5db00-2dc4-44c0-bb3e-b74d83e5ad4a req-c71bebe3-4d25-41e3-8c7c-5366248259fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc407ff3-fc1e-44bf-9c20-73203361a20f", "name": "network-vif-plugged", "status": "completed", "tag": "38e012d9-8547-43fd-8f63-fc6e18d35361"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:34:51.605140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-19c5db00-2dc4-44c0-bb3e-b74d83e5ad4a req-c71bebe3-4d25-41e3-8c7c-5366248259fd service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:51.607740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-19c5db00-2dc4-44c0-bb3e-b74d83e5ad4a req-c71bebe3-4d25-41e3-8c7c-5366248259fd service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:51.608212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-19c5db00-2dc4-44c0-bb3e-b74d83e5ad4a req-c71bebe3-4d25-41e3-8c7c-5366248259fd service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:51.620063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-19c5db00-2dc4-44c0-bb3e-b74d83e5ad4a req-c71bebe3-4d25-41e3-8c7c-5366248259fd service nova] Creating event network-vif-plugged:38e012d9-8547-43fd-8f63-fc6e18d35361 for instance dc407ff3-fc1e-44bf-9c20-73203361a20f on hv-cinder-85199 Aug 06 12:34:51.625409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-19c5db00-2dc4-44c0-bb3e-b74d83e5ad4a req-c71bebe3-4d25-41e3-8c7c-5366248259fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044129 Aug 06 12:34:51.626474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 246/506] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:34:51.683857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:51.702177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:51.703993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:51.705312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-128e80df-ac63-4825-8195-294450ca58f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.202511 Aug 06 12:34:51.706652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 261/507] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:52.171402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4b478c93-8758-4cde-8bc6-ddb3dde92a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:52.172118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4b478c93-8758-4cde-8bc6-ddb3dde92a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:52.178640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b478c93-8758-4cde-8bc6-ddb3dde92a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:52.179110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b478c93-8758-4cde-8bc6-ddb3dde92a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:52.179532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b478c93-8758-4cde-8bc6-ddb3dde92a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:52.180202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b478c93-8758-4cde-8bc6-ddb3dde92a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:52.180669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b478c93-8758-4cde-8bc6-ddb3dde92a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:52.181084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b478c93-8758-4cde-8bc6-ddb3dde92a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:52.246597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4b478c93-8758-4cde-8bc6-ddb3dde92a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:52.254927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4b478c93-8758-4cde-8bc6-ddb3dde92a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1271 microversion: 2.1 time: 0.087604 Aug 06 12:34:52.255414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 247/508] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:52 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:52.730461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:52.731048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:52.739970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:52.740485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:52.740919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:52.741613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:52.742077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:52.742482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:52.881775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:52.889989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:52.891477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:52.892654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b4a417ae-2693-4d14-a151-44f9761f581b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.167398 Aug 06 12:34:52.893203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 262/509] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:34:53.275465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e28cd533-7dee-48e0-bcd9-df7e767bbbc9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:53.276093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e28cd533-7dee-48e0-bcd9-df7e767bbbc9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:53.278498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=48 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:34:53.283598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e28cd533-7dee-48e0-bcd9-df7e767bbbc9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:53.284105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e28cd533-7dee-48e0-bcd9-df7e767bbbc9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:53.284562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e28cd533-7dee-48e0-bcd9-df7e767bbbc9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:53.285240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e28cd533-7dee-48e0-bcd9-df7e767bbbc9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:53.285684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e28cd533-7dee-48e0-bcd9-df7e767bbbc9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:53.286097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e28cd533-7dee-48e0-bcd9-df7e767bbbc9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:53.350577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e28cd533-7dee-48e0-bcd9-df7e767bbbc9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:53.357872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e28cd533-7dee-48e0-bcd9-df7e767bbbc9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1277 microversion: 2.1 time: 0.086254 Aug 06 12:34:53.358427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 248/510] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:53 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:53.915546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:53.916262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:53.923522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:53.924079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:53.924591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:53.925826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:53.926280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:53.926701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:54.066519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:54.075508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:54.077425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:54.078699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bfa727ca-6e83-4225-9ee8-b5167315ee71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.167147 Aug 06 12:34:54.079263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 263/511] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:54.390231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a738e43c-66e1-4263-a96c-31aad6bc4e66 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:54.390915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a738e43c-66e1-4263-a96c-31aad6bc4e66 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:54.398975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a738e43c-66e1-4263-a96c-31aad6bc4e66 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:54.399469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a738e43c-66e1-4263-a96c-31aad6bc4e66 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:54.399934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a738e43c-66e1-4263-a96c-31aad6bc4e66 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:54.400716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a738e43c-66e1-4263-a96c-31aad6bc4e66 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:54.401176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a738e43c-66e1-4263-a96c-31aad6bc4e66 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:54.401632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a738e43c-66e1-4263-a96c-31aad6bc4e66 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:54.560383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a738e43c-66e1-4263-a96c-31aad6bc4e66 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:54.567966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a738e43c-66e1-4263-a96c-31aad6bc4e66 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.192246 Aug 06 12:34:54.568571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 249/512] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:54 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:55.101762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:55.102701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:55.110422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:55.111126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:55.111562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:55.113052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:55.113512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:55.113934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:55.260091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:55.268924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:55.270426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:55.271731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7a91ac52-3441-4b54-b612-621838ce63a1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.174093 Aug 06 12:34:55.272295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 264/513] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:55.550424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-608516b3-5cd3-4405-9ccf-1eb05ff8f19a req-cc2126fc-4fb8-42cf-98e4-145ea1c0ea84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5982553-7c7c-4d67-bb7e-13ac69cfc674", "tag": "16a90f6e-485c-4787-91f0-a0bca7134d68"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:34:55.560249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-608516b3-5cd3-4405-9ccf-1eb05ff8f19a req-cc2126fc-4fb8-42cf-98e4-145ea1c0ea84 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:55.561215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-608516b3-5cd3-4405-9ccf-1eb05ff8f19a req-cc2126fc-4fb8-42cf-98e4-145ea1c0ea84 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:55.561215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-608516b3-5cd3-4405-9ccf-1eb05ff8f19a req-cc2126fc-4fb8-42cf-98e4-145ea1c0ea84 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:55.571679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-608516b3-5cd3-4405-9ccf-1eb05ff8f19a req-cc2126fc-4fb8-42cf-98e4-145ea1c0ea84 service nova] Creating event network-changed:16a90f6e-485c-4787-91f0-a0bca7134d68 for instance e5982553-7c7c-4d67-bb7e-13ac69cfc674 on hv-cinder-85199 Aug 06 12:34:55.576451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-608516b3-5cd3-4405-9ccf-1eb05ff8f19a req-cc2126fc-4fb8-42cf-98e4-145ea1c0ea84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030268 Aug 06 12:34:55.577047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 250/514] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:34:55.589537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1c4ad1e1-1b88-49eb-9ce7-8f545a812c20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:55.591007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1c4ad1e1-1b88-49eb-9ce7-8f545a812c20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:55.600674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c4ad1e1-1b88-49eb-9ce7-8f545a812c20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:55.601157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c4ad1e1-1b88-49eb-9ce7-8f545a812c20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:55.601582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c4ad1e1-1b88-49eb-9ce7-8f545a812c20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:55.602271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c4ad1e1-1b88-49eb-9ce7-8f545a812c20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:55.602714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c4ad1e1-1b88-49eb-9ce7-8f545a812c20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:55.603130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c4ad1e1-1b88-49eb-9ce7-8f545a812c20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:55.744643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1c4ad1e1-1b88-49eb-9ce7-8f545a812c20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:55.752071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1c4ad1e1-1b88-49eb-9ce7-8f545a812c20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.166837 Aug 06 12:34:55.752709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 265/515] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:55 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:56.294890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:56.295720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:56.302023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:56.302572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:56.303133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:56.303878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:56.304451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:56.304944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:56.457788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:56.466125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:56.467612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:56.468807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7ae7b9df-2f6c-4dc3-8f0e-d171364aaee3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1809 microversion: 2.20 time: 0.178294 Aug 06 12:34:56.469357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 251/516] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:56 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:56.771965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-92ccf771-0527-4748-8e08-a98ad3ac06fc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:56.772514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-92ccf771-0527-4748-8e08-a98ad3ac06fc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:56.778777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92ccf771-0527-4748-8e08-a98ad3ac06fc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:56.779251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92ccf771-0527-4748-8e08-a98ad3ac06fc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:56.779678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92ccf771-0527-4748-8e08-a98ad3ac06fc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:56.780383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92ccf771-0527-4748-8e08-a98ad3ac06fc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:56.780828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92ccf771-0527-4748-8e08-a98ad3ac06fc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:56.781238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92ccf771-0527-4748-8e08-a98ad3ac06fc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:56.907216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-92ccf771-0527-4748-8e08-a98ad3ac06fc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:56.914976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-92ccf771-0527-4748-8e08-a98ad3ac06fc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.146904 Aug 06 12:34:56.915534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 266/517] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:56 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:57.491754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:57.493264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:57.500154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:57.500662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:57.501095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:57.501790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:57.502244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:57.503249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:57.695232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:57.705331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:57.707022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:57.708184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-982af275-e7db-45af-b0f9-89d16939f299 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1796 microversion: 2.20 time: 0.221088 Aug 06 12:34:57.708775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 252/518] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:34:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1796 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:34:57.936479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5e21eb7f-cd01-4780-a102-fbcfa5ecef7e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:57.937006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5e21eb7f-cd01-4780-a102-fbcfa5ecef7e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:57.943540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e21eb7f-cd01-4780-a102-fbcfa5ecef7e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:57.944028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e21eb7f-cd01-4780-a102-fbcfa5ecef7e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:57.944506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e21eb7f-cd01-4780-a102-fbcfa5ecef7e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:57.945199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e21eb7f-cd01-4780-a102-fbcfa5ecef7e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:57.945652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e21eb7f-cd01-4780-a102-fbcfa5ecef7e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:57.946073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e21eb7f-cd01-4780-a102-fbcfa5ecef7e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:58.076883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5e21eb7f-cd01-4780-a102-fbcfa5ecef7e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:58.084659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5e21eb7f-cd01-4780-a102-fbcfa5ecef7e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.152081 Aug 06 12:34:58.085228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 267/519] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:57 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:58.456858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-019ab022-1880-4405-ba32-2dd2e1390b98 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:34:58.462769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-019ab022-1880-4405-ba32-2dd2e1390b98 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:58.463244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-019ab022-1880-4405-ba32-2dd2e1390b98 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:58.463671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-019ab022-1880-4405-ba32-2dd2e1390b98 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:58.521294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-019ab022-1880-4405-ba32-2dd2e1390b98 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Going to try to stop instance {{(pid=117825) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 12:34:58.560540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-019ab022-1880-4405-ba32-2dd2e1390b98 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "POST /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/action" status: 202 len: 0 microversion: 2.1 time: 0.107998 Aug 06 12:34:58.561125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 253/520] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 12:34:58 2022] POST /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:34:58.569632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e50ea782-6c53-41d7-ac0f-ce77fd85919b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:58.570239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e50ea782-6c53-41d7-ac0f-ce77fd85919b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:58.576026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e50ea782-6c53-41d7-ac0f-ce77fd85919b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:58.576547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e50ea782-6c53-41d7-ac0f-ce77fd85919b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:58.576979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e50ea782-6c53-41d7-ac0f-ce77fd85919b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:58.577660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e50ea782-6c53-41d7-ac0f-ce77fd85919b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:58.578112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e50ea782-6c53-41d7-ac0f-ce77fd85919b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:58.578533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e50ea782-6c53-41d7-ac0f-ce77fd85919b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:58.703412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e50ea782-6c53-41d7-ac0f-ce77fd85919b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:58.711913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e50ea782-6c53-41d7-ac0f-ce77fd85919b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.146618 Aug 06 12:34:58.712503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 268/521] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:58 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:59.106280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bdd8dfd2-668d-41e9-9f28-74bec701b2e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:59.106961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bdd8dfd2-668d-41e9-9f28-74bec701b2e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:59.113764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdd8dfd2-668d-41e9-9f28-74bec701b2e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:59.114231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdd8dfd2-668d-41e9-9f28-74bec701b2e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:59.114655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdd8dfd2-668d-41e9-9f28-74bec701b2e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:59.115332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdd8dfd2-668d-41e9-9f28-74bec701b2e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:59.115771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdd8dfd2-668d-41e9-9f28-74bec701b2e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:59.116183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdd8dfd2-668d-41e9-9f28-74bec701b2e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:59.245504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bdd8dfd2-668d-41e9-9f28-74bec701b2e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:59.253003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bdd8dfd2-668d-41e9-9f28-74bec701b2e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.150835 Aug 06 12:34:59.253496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 254/522] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:59 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:34:59.732733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d16b9b4e-e30f-4110-bc75-36a825d66fa5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:34:59.733326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d16b9b4e-e30f-4110-bc75-36a825d66fa5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:34:59.739942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d16b9b4e-e30f-4110-bc75-36a825d66fa5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:59.740457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d16b9b4e-e30f-4110-bc75-36a825d66fa5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:59.740894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d16b9b4e-e30f-4110-bc75-36a825d66fa5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:59.741575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d16b9b4e-e30f-4110-bc75-36a825d66fa5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:34:59.742041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d16b9b4e-e30f-4110-bc75-36a825d66fa5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:34:59.742450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d16b9b4e-e30f-4110-bc75-36a825d66fa5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:34:59.870681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d16b9b4e-e30f-4110-bc75-36a825d66fa5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:34:59.878968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d16b9b4e-e30f-4110-bc75-36a825d66fa5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.150048 Aug 06 12:34:59.879520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 269/523] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:34:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:00.274274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f7d3e5a9-c990-422b-b25d-148284b571ea tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:00.274811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f7d3e5a9-c990-422b-b25d-148284b571ea tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:00.281223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7d3e5a9-c990-422b-b25d-148284b571ea tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:00.281697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7d3e5a9-c990-422b-b25d-148284b571ea tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:00.282135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7d3e5a9-c990-422b-b25d-148284b571ea tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:00.282811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7d3e5a9-c990-422b-b25d-148284b571ea tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:00.283289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7d3e5a9-c990-422b-b25d-148284b571ea tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:00.283751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7d3e5a9-c990-422b-b25d-148284b571ea tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:00.412203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f7d3e5a9-c990-422b-b25d-148284b571ea tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:00.419531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f7d3e5a9-c990-422b-b25d-148284b571ea tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.149204 Aug 06 12:35:00.420098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 255/524] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:00 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:00.899982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d3337238-3641-47f9-9513-eb67a507cc55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:00.900533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d3337238-3641-47f9-9513-eb67a507cc55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:00.906869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3337238-3641-47f9-9513-eb67a507cc55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:00.907346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3337238-3641-47f9-9513-eb67a507cc55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:00.907780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3337238-3641-47f9-9513-eb67a507cc55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:00.908566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3337238-3641-47f9-9513-eb67a507cc55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:00.909544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3337238-3641-47f9-9513-eb67a507cc55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:00.909965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3337238-3641-47f9-9513-eb67a507cc55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:01.003937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:35:01.026057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:35:01.037899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d3337238-3641-47f9-9513-eb67a507cc55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:01.045640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d3337238-3641-47f9-9513-eb67a507cc55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.149557 Aug 06 12:35:01.046199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 270/525] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:00 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:01.441205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9d530eac-4496-41f3-98b0-9e820eb6b35e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:01.441824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9d530eac-4496-41f3-98b0-9e820eb6b35e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:01.443878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:35:01.449686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d530eac-4496-41f3-98b0-9e820eb6b35e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:01.450103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d530eac-4496-41f3-98b0-9e820eb6b35e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:01.450532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d530eac-4496-41f3-98b0-9e820eb6b35e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:01.451216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d530eac-4496-41f3-98b0-9e820eb6b35e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:01.451664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d530eac-4496-41f3-98b0-9e820eb6b35e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:01.452084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d530eac-4496-41f3-98b0-9e820eb6b35e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:01.619027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9d530eac-4496-41f3-98b0-9e820eb6b35e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:01.626417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9d530eac-4496-41f3-98b0-9e820eb6b35e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.189517 Aug 06 12:35:01.626983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 256/526] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:01 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:02.071408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-18630918-b939-421b-8bb8-c6407ca058b4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:02.072005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-18630918-b939-421b-8bb8-c6407ca058b4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:02.078302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-18630918-b939-421b-8bb8-c6407ca058b4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:02.078773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-18630918-b939-421b-8bb8-c6407ca058b4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:02.079202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-18630918-b939-421b-8bb8-c6407ca058b4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:02.079879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-18630918-b939-421b-8bb8-c6407ca058b4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:02.080343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-18630918-b939-421b-8bb8-c6407ca058b4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:02.080782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-18630918-b939-421b-8bb8-c6407ca058b4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:02.209815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-18630918-b939-421b-8bb8-c6407ca058b4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:02.217763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-18630918-b939-421b-8bb8-c6407ca058b4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.150143 Aug 06 12:35:02.218326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 271/527] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:02 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:02.647789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a66af673-bb8d-446b-9a28-c6fb31af278e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:02.648609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a66af673-bb8d-446b-9a28-c6fb31af278e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:02.655330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a66af673-bb8d-446b-9a28-c6fb31af278e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:02.656006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a66af673-bb8d-446b-9a28-c6fb31af278e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:02.656459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a66af673-bb8d-446b-9a28-c6fb31af278e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:02.657142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a66af673-bb8d-446b-9a28-c6fb31af278e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:02.657589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a66af673-bb8d-446b-9a28-c6fb31af278e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:02.658000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a66af673-bb8d-446b-9a28-c6fb31af278e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:02.787066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a66af673-bb8d-446b-9a28-c6fb31af278e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:02.794429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a66af673-bb8d-446b-9a28-c6fb31af278e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.150771 Aug 06 12:35:02.794987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 257/528] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:02 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:03.239916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-962ad640-54cf-41bd-bd19-28e5dc802267 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:03.240550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-962ad640-54cf-41bd-bd19-28e5dc802267 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:03.246928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-962ad640-54cf-41bd-bd19-28e5dc802267 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:03.247406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-962ad640-54cf-41bd-bd19-28e5dc802267 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:03.247838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-962ad640-54cf-41bd-bd19-28e5dc802267 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:03.248553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-962ad640-54cf-41bd-bd19-28e5dc802267 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:03.249001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-962ad640-54cf-41bd-bd19-28e5dc802267 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:03.249445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-962ad640-54cf-41bd-bd19-28e5dc802267 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:03.579427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-962ad640-54cf-41bd-bd19-28e5dc802267 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:03.587871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-962ad640-54cf-41bd-bd19-28e5dc802267 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.352653 Aug 06 12:35:03.588504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 272/529] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:03 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:03.816975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b7c75964-a310-42d5-88e4-d4d2181537c9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:03.817579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b7c75964-a310-42d5-88e4-d4d2181537c9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:03.823453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c75964-a310-42d5-88e4-d4d2181537c9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:03.823929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c75964-a310-42d5-88e4-d4d2181537c9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:03.824386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c75964-a310-42d5-88e4-d4d2181537c9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:03.825063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c75964-a310-42d5-88e4-d4d2181537c9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:03.825509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c75964-a310-42d5-88e4-d4d2181537c9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:03.825923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c75964-a310-42d5-88e4-d4d2181537c9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:03.953439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b7c75964-a310-42d5-88e4-d4d2181537c9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:03.961052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b7c75964-a310-42d5-88e4-d4d2181537c9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.149766 Aug 06 12:35:03.961610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 258/530] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:03 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:04.608447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c80891c7-501d-4686-9f01-acd9a036bc1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:04.609059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c80891c7-501d-4686-9f01-acd9a036bc1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:04.615728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c80891c7-501d-4686-9f01-acd9a036bc1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:04.616208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c80891c7-501d-4686-9f01-acd9a036bc1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:04.616671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c80891c7-501d-4686-9f01-acd9a036bc1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:04.617359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c80891c7-501d-4686-9f01-acd9a036bc1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:04.617810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c80891c7-501d-4686-9f01-acd9a036bc1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:04.618230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c80891c7-501d-4686-9f01-acd9a036bc1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:04.751311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c80891c7-501d-4686-9f01-acd9a036bc1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:04.753524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:35:04.761053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c80891c7-501d-4686-9f01-acd9a036bc1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.156562 Aug 06 12:35:04.761616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 273/531] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:04 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:04.981238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d2b6a09-531d-4236-bed6-9d135003c981 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:04.981786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3d2b6a09-531d-4236-bed6-9d135003c981 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:04.988638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d2b6a09-531d-4236-bed6-9d135003c981 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:04.989149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d2b6a09-531d-4236-bed6-9d135003c981 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:04.989576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d2b6a09-531d-4236-bed6-9d135003c981 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:04.990254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d2b6a09-531d-4236-bed6-9d135003c981 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:04.990700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d2b6a09-531d-4236-bed6-9d135003c981 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:04.991117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d2b6a09-531d-4236-bed6-9d135003c981 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:05.116796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3d2b6a09-531d-4236-bed6-9d135003c981 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:05.124418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3d2b6a09-531d-4236-bed6-9d135003c981 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.147024 Aug 06 12:35:05.124973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 259/532] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:04 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:05.782442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-29e82b8c-6fa7-4632-b9c6-7a25f4bdb66b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:05.783196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-29e82b8c-6fa7-4632-b9c6-7a25f4bdb66b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:05.792000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e82b8c-6fa7-4632-b9c6-7a25f4bdb66b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:05.792601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e82b8c-6fa7-4632-b9c6-7a25f4bdb66b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:05.793046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e82b8c-6fa7-4632-b9c6-7a25f4bdb66b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:05.793736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e82b8c-6fa7-4632-b9c6-7a25f4bdb66b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:05.794189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e82b8c-6fa7-4632-b9c6-7a25f4bdb66b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:05.794616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e82b8c-6fa7-4632-b9c6-7a25f4bdb66b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:05.909862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-79322328-e734-4251-9a24-784e335e001d req-abe49445-1023-460f-85e4-20850e96fd70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5982553-7c7c-4d67-bb7e-13ac69cfc674", "name": "network-vif-plugged", "status": "completed", "tag": "16a90f6e-485c-4787-91f0-a0bca7134d68"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:35:05.920233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-79322328-e734-4251-9a24-784e335e001d req-abe49445-1023-460f-85e4-20850e96fd70 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:05.920812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-79322328-e734-4251-9a24-784e335e001d req-abe49445-1023-460f-85e4-20850e96fd70 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:05.921503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-79322328-e734-4251-9a24-784e335e001d req-abe49445-1023-460f-85e4-20850e96fd70 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:05.936573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-79322328-e734-4251-9a24-784e335e001d req-abe49445-1023-460f-85e4-20850e96fd70 service nova] Creating event network-vif-plugged:16a90f6e-485c-4787-91f0-a0bca7134d68 for instance e5982553-7c7c-4d67-bb7e-13ac69cfc674 on hv-cinder-85199 Aug 06 12:35:05.943041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-79322328-e734-4251-9a24-784e335e001d req-abe49445-1023-460f-85e4-20850e96fd70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037173 Aug 06 12:35:05.944114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 260/533] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:35:06.005192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-29e82b8c-6fa7-4632-b9c6-7a25f4bdb66b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:06.020822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-29e82b8c-6fa7-4632-b9c6-7a25f4bdb66b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.235214 Aug 06 12:35:06.021468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 274/534] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:06.146599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16bd4119-fd89-4418-9381-91e6496a605a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:06.147297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16bd4119-fd89-4418-9381-91e6496a605a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:06.153648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16bd4119-fd89-4418-9381-91e6496a605a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:06.154727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16bd4119-fd89-4418-9381-91e6496a605a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:06.155159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16bd4119-fd89-4418-9381-91e6496a605a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:06.155882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16bd4119-fd89-4418-9381-91e6496a605a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:06.156353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16bd4119-fd89-4418-9381-91e6496a605a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:06.156773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16bd4119-fd89-4418-9381-91e6496a605a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:06.361254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16bd4119-fd89-4418-9381-91e6496a605a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:06.364294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:35:06.371392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16bd4119-fd89-4418-9381-91e6496a605a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.229714 Aug 06 12:35:06.371952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 261/535] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:06 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:35:07.042029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0d775e43-0db1-412e-ba2d-4ecffbfafb0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:07.042630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0d775e43-0db1-412e-ba2d-4ecffbfafb0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:07.049548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d775e43-0db1-412e-ba2d-4ecffbfafb0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:07.050015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d775e43-0db1-412e-ba2d-4ecffbfafb0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:07.050440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d775e43-0db1-412e-ba2d-4ecffbfafb0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:07.051113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d775e43-0db1-412e-ba2d-4ecffbfafb0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:07.051559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d775e43-0db1-412e-ba2d-4ecffbfafb0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:07.051972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d775e43-0db1-412e-ba2d-4ecffbfafb0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:07.176599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0d775e43-0db1-412e-ba2d-4ecffbfafb0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:07.184375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0d775e43-0db1-412e-ba2d-4ecffbfafb0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.146254 Aug 06 12:35:07.185135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 275/536] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:07 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:07.391933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a49cb61f-7d55-4bc1-9fe1-c1d7d88e523d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:07.392571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a49cb61f-7d55-4bc1-9fe1-c1d7d88e523d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:07.399860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a49cb61f-7d55-4bc1-9fe1-c1d7d88e523d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:07.400388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a49cb61f-7d55-4bc1-9fe1-c1d7d88e523d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:07.400820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a49cb61f-7d55-4bc1-9fe1-c1d7d88e523d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:07.401502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a49cb61f-7d55-4bc1-9fe1-c1d7d88e523d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:07.401953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a49cb61f-7d55-4bc1-9fe1-c1d7d88e523d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:07.402407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a49cb61f-7d55-4bc1-9fe1-c1d7d88e523d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:07.529803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a49cb61f-7d55-4bc1-9fe1-c1d7d88e523d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:07.537561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a49cb61f-7d55-4bc1-9fe1-c1d7d88e523d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.149820 Aug 06 12:35:07.538120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 262/537] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:07 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:08.205080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2fa2bc44-ba55-4acc-aea6-c777f029b4e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:08.206539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2fa2bc44-ba55-4acc-aea6-c777f029b4e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:08.212822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fa2bc44-ba55-4acc-aea6-c777f029b4e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:08.213295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fa2bc44-ba55-4acc-aea6-c777f029b4e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:08.213721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fa2bc44-ba55-4acc-aea6-c777f029b4e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:08.214393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fa2bc44-ba55-4acc-aea6-c777f029b4e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:08.214836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fa2bc44-ba55-4acc-aea6-c777f029b4e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:08.215250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fa2bc44-ba55-4acc-aea6-c777f029b4e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:08.346388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2fa2bc44-ba55-4acc-aea6-c777f029b4e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:08.354165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2fa2bc44-ba55-4acc-aea6-c777f029b4e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.152958 Aug 06 12:35:08.354717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 276/538] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:08.558689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-10ea826f-30ea-481d-9cc1-d41e5ad08544 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:08.559207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-10ea826f-30ea-481d-9cc1-d41e5ad08544 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:08.566215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10ea826f-30ea-481d-9cc1-d41e5ad08544 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:08.566691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10ea826f-30ea-481d-9cc1-d41e5ad08544 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:08.567123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10ea826f-30ea-481d-9cc1-d41e5ad08544 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:08.567805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10ea826f-30ea-481d-9cc1-d41e5ad08544 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:08.568253 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10ea826f-30ea-481d-9cc1-d41e5ad08544 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:08.568700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10ea826f-30ea-481d-9cc1-d41e5ad08544 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:08.694818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-10ea826f-30ea-481d-9cc1-d41e5ad08544 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:08.702040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-10ea826f-30ea-481d-9cc1-d41e5ad08544 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1319 microversion: 2.1 time: 0.147282 Aug 06 12:35:08.702601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 263/539] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:08 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:09.375198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5b0ccdfa-7461-477f-9925-f2f66f529d2b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:09.375827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5b0ccdfa-7461-477f-9925-f2f66f529d2b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:09.382891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0ccdfa-7461-477f-9925-f2f66f529d2b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:09.383366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0ccdfa-7461-477f-9925-f2f66f529d2b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:09.383789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0ccdfa-7461-477f-9925-f2f66f529d2b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:09.384501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0ccdfa-7461-477f-9925-f2f66f529d2b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:09.384944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0ccdfa-7461-477f-9925-f2f66f529d2b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:09.385360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0ccdfa-7461-477f-9925-f2f66f529d2b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:09.510463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b0ccdfa-7461-477f-9925-f2f66f529d2b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:09.518198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5b0ccdfa-7461-477f-9925-f2f66f529d2b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.146805 Aug 06 12:35:09.518745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 277/540] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:09.722943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5322972b-e635-4322-bc5c-552ef4713103 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:09.723496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5322972b-e635-4322-bc5c-552ef4713103 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:09.729725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5322972b-e635-4322-bc5c-552ef4713103 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:09.730196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5322972b-e635-4322-bc5c-552ef4713103 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:09.730618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5322972b-e635-4322-bc5c-552ef4713103 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:09.731287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5322972b-e635-4322-bc5c-552ef4713103 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:09.731729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5322972b-e635-4322-bc5c-552ef4713103 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:09.732141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5322972b-e635-4322-bc5c-552ef4713103 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:09.856827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5322972b-e635-4322-bc5c-552ef4713103 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:09.865035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5322972b-e635-4322-bc5c-552ef4713103 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1508 microversion: 2.1 time: 0.146492 Aug 06 12:35:09.865594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 264/541] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:09 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:09.884817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-12f2f536-9a34-4808-b5f9-bf0cc7a7ffc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66abc00e-688e-4559-8736-77410a760e11", "device": "/dev/sdb"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:35:09.887768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-12f2f536-9a34-4808-b5f9-bf0cc7a7ffc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:09.893592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12f2f536-9a34-4808-b5f9-bf0cc7a7ffc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:09.894069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12f2f536-9a34-4808-b5f9-bf0cc7a7ffc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:09.894501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12f2f536-9a34-4808-b5f9-bf0cc7a7ffc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:09.895177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12f2f536-9a34-4808-b5f9-bf0cc7a7ffc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:09.895625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12f2f536-9a34-4808-b5f9-bf0cc7a7ffc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:09.896041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12f2f536-9a34-4808-b5f9-bf0cc7a7ffc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:10.146485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-12f2f536-9a34-4808-b5f9-bf0cc7a7ffc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "POST /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265424 Aug 06 12:35:10.147104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 278/542] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 12:35:09 2022] POST /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:35:10.539738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ac395d4e-d221-4a64-a7f9-d7dc5c337d3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:10.540361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ac395d4e-d221-4a64-a7f9-d7dc5c337d3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:10.546238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac395d4e-d221-4a64-a7f9-d7dc5c337d3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:10.546779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac395d4e-d221-4a64-a7f9-d7dc5c337d3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:10.547139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac395d4e-d221-4a64-a7f9-d7dc5c337d3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:10.547822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac395d4e-d221-4a64-a7f9-d7dc5c337d3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:10.548260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac395d4e-d221-4a64-a7f9-d7dc5c337d3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:10.548701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac395d4e-d221-4a64-a7f9-d7dc5c337d3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:10.679246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ac395d4e-d221-4a64-a7f9-d7dc5c337d3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:10.687332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ac395d4e-d221-4a64-a7f9-d7dc5c337d3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.151416 Aug 06 12:35:10.687898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 265/543] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:11.709792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-22d53d70-584b-4e42-bd7b-ee3cf612f23f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:11.711101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-22d53d70-584b-4e42-bd7b-ee3cf612f23f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:11.717277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22d53d70-584b-4e42-bd7b-ee3cf612f23f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:11.717761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22d53d70-584b-4e42-bd7b-ee3cf612f23f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:11.718198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22d53d70-584b-4e42-bd7b-ee3cf612f23f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:11.718884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22d53d70-584b-4e42-bd7b-ee3cf612f23f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:11.719337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22d53d70-584b-4e42-bd7b-ee3cf612f23f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:11.719759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22d53d70-584b-4e42-bd7b-ee3cf612f23f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:11.851710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-22d53d70-584b-4e42-bd7b-ee3cf612f23f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:11.859629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-22d53d70-584b-4e42-bd7b-ee3cf612f23f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.155145 Aug 06 12:35:11.860195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 279/544] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:12.881608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c25c8b08-b5b0-4338-86e2-92a8162e497e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:12.882141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c25c8b08-b5b0-4338-86e2-92a8162e497e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:12.888640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c25c8b08-b5b0-4338-86e2-92a8162e497e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:12.889124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c25c8b08-b5b0-4338-86e2-92a8162e497e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:12.889566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c25c8b08-b5b0-4338-86e2-92a8162e497e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:12.890253 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c25c8b08-b5b0-4338-86e2-92a8162e497e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:12.890712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c25c8b08-b5b0-4338-86e2-92a8162e497e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:12.891139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c25c8b08-b5b0-4338-86e2-92a8162e497e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:13.016800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c25c8b08-b5b0-4338-86e2-92a8162e497e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:13.024808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c25c8b08-b5b0-4338-86e2-92a8162e497e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.147802 Aug 06 12:35:13.025379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 266/545] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:14.045293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-758b0006-38dd-4b8f-bb4f-62f1863e0972 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:14.045904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-758b0006-38dd-4b8f-bb4f-62f1863e0972 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:14.052825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-758b0006-38dd-4b8f-bb4f-62f1863e0972 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:14.053307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-758b0006-38dd-4b8f-bb4f-62f1863e0972 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:14.053745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-758b0006-38dd-4b8f-bb4f-62f1863e0972 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:14.054432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-758b0006-38dd-4b8f-bb4f-62f1863e0972 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:14.054884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-758b0006-38dd-4b8f-bb4f-62f1863e0972 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:14.055305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-758b0006-38dd-4b8f-bb4f-62f1863e0972 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:14.182816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-758b0006-38dd-4b8f-bb4f-62f1863e0972 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:14.190745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-758b0006-38dd-4b8f-bb4f-62f1863e0972 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.149338 Aug 06 12:35:14.191303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 280/546] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:15.211203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8662193a-e9b7-44bd-838e-5371084cfa99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:15.211808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8662193a-e9b7-44bd-838e-5371084cfa99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:15.218246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8662193a-e9b7-44bd-838e-5371084cfa99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:15.218745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8662193a-e9b7-44bd-838e-5371084cfa99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:15.219172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8662193a-e9b7-44bd-838e-5371084cfa99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:15.219850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8662193a-e9b7-44bd-838e-5371084cfa99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:15.220345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8662193a-e9b7-44bd-838e-5371084cfa99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:15.220769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8662193a-e9b7-44bd-838e-5371084cfa99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:15.349227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8662193a-e9b7-44bd-838e-5371084cfa99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:15.357030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8662193a-e9b7-44bd-838e-5371084cfa99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.149749 Aug 06 12:35:15.357595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 267/547] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:16.377616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f7f53610-90b8-43e2-92cc-1faa469287df tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:16.378245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f7f53610-90b8-43e2-92cc-1faa469287df tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:16.384249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7f53610-90b8-43e2-92cc-1faa469287df tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:16.384757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7f53610-90b8-43e2-92cc-1faa469287df tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:16.385186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7f53610-90b8-43e2-92cc-1faa469287df tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:16.385865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7f53610-90b8-43e2-92cc-1faa469287df tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:16.386314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7f53610-90b8-43e2-92cc-1faa469287df tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:16.386736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7f53610-90b8-43e2-92cc-1faa469287df tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:16.513621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f7f53610-90b8-43e2-92cc-1faa469287df tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:16.521384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f7f53610-90b8-43e2-92cc-1faa469287df tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1722 microversion: 2.1 time: 0.147570 Aug 06 12:35:16.521941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 281/548] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:16.716772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:35:16.716987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:35:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:35:17.131102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96ecd476-0678-4850-9257-68bf9a096c28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1b59212-9312-4893-97c3-6c27d1ef81aa"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:35:17.133428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-96ecd476-0678-4850-9257-68bf9a096c28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:17.139700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96ecd476-0678-4850-9257-68bf9a096c28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:17.140173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96ecd476-0678-4850-9257-68bf9a096c28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:17.140627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96ecd476-0678-4850-9257-68bf9a096c28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:17.141314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96ecd476-0678-4850-9257-68bf9a096c28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:17.141762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96ecd476-0678-4850-9257-68bf9a096c28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:17.142227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96ecd476-0678-4850-9257-68bf9a096c28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:17.542845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98818eb3-6913-44fb-aed5-c3569c1ff4ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:17.543458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-98818eb3-6913-44fb-aed5-c3569c1ff4ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:17.549866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98818eb3-6913-44fb-aed5-c3569c1ff4ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:17.550349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98818eb3-6913-44fb-aed5-c3569c1ff4ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:17.550782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98818eb3-6913-44fb-aed5-c3569c1ff4ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:17.551471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98818eb3-6913-44fb-aed5-c3569c1ff4ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:17.551925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98818eb3-6913-44fb-aed5-c3569c1ff4ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:17.552376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98818eb3-6913-44fb-aed5-c3569c1ff4ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:17.681062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98818eb3-6913-44fb-aed5-c3569c1ff4ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:17.688861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98818eb3-6913-44fb-aed5-c3569c1ff4ba tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1699 microversion: 2.1 time: 0.149897 Aug 06 12:35:17.689418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 282/549] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1699 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:35:17.709041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3d014ee6-72d1-4721-9111-ac65e7ba7061 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:35:17.714795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d014ee6-72d1-4721-9111-ac65e7ba7061 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:17.715270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d014ee6-72d1-4721-9111-ac65e7ba7061 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:17.715694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d014ee6-72d1-4721-9111-ac65e7ba7061 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:17.776736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3d014ee6-72d1-4721-9111-ac65e7ba7061 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Going to try to start instance {{(pid=117824) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 12:35:17.826352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3d014ee6-72d1-4721-9111-ac65e7ba7061 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "POST /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/action" status: 202 len: 0 microversion: 2.1 time: 0.120977 Aug 06 12:35:17.827616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 283/550] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 12:35:17 2022] POST /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 12:35:17.841877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-83d8cb58-e413-4b57-bcbb-7688f1abeccc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:17.842663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-83d8cb58-e413-4b57-bcbb-7688f1abeccc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:17.850323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83d8cb58-e413-4b57-bcbb-7688f1abeccc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:17.850918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83d8cb58-e413-4b57-bcbb-7688f1abeccc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:17.851504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83d8cb58-e413-4b57-bcbb-7688f1abeccc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:17.852067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83d8cb58-e413-4b57-bcbb-7688f1abeccc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:17.852538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83d8cb58-e413-4b57-bcbb-7688f1abeccc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:17.852946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83d8cb58-e413-4b57-bcbb-7688f1abeccc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:17.908645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-96ecd476-0678-4850-9257-68bf9a096c28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781773 Aug 06 12:35:17.909282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 268/551] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 12:35:17 2022] POST /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:35:17.989497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-83d8cb58-e413-4b57-bcbb-7688f1abeccc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:17.999471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-83d8cb58-e413-4b57-bcbb-7688f1abeccc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1708 microversion: 2.1 time: 0.167077 Aug 06 12:35:18.000055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 284/552] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1708 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:35:19.023703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-258fd320-f847-4387-a013-767d55f04201 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:19.024144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-258fd320-f847-4387-a013-767d55f04201 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:19.030612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-258fd320-f847-4387-a013-767d55f04201 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:19.031095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-258fd320-f847-4387-a013-767d55f04201 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:19.031532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-258fd320-f847-4387-a013-767d55f04201 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:19.032226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-258fd320-f847-4387-a013-767d55f04201 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:19.032704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-258fd320-f847-4387-a013-767d55f04201 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:19.033125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-258fd320-f847-4387-a013-767d55f04201 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:19.195873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-258fd320-f847-4387-a013-767d55f04201 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:19.203749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-258fd320-f847-4387-a013-767d55f04201 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1708 microversion: 2.1 time: 0.185808 Aug 06 12:35:19.204325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 269/553] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1708 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:20.228787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b77ba237-cc8a-4f46-a415-fc1f140272b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:20.229496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b77ba237-cc8a-4f46-a415-fc1f140272b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:20.235867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b77ba237-cc8a-4f46-a415-fc1f140272b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:20.236386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b77ba237-cc8a-4f46-a415-fc1f140272b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:20.236844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b77ba237-cc8a-4f46-a415-fc1f140272b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:20.238268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b77ba237-cc8a-4f46-a415-fc1f140272b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:20.238747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b77ba237-cc8a-4f46-a415-fc1f140272b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:20.239167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b77ba237-cc8a-4f46-a415-fc1f140272b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:20.370750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b77ba237-cc8a-4f46-a415-fc1f140272b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:20.378647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b77ba237-cc8a-4f46-a415-fc1f140272b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1712 microversion: 2.1 time: 0.153830 Aug 06 12:35:20.379195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 285/554] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1712 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:50.551531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=43 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:35:50.552386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:35:50.605053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27b9c0bb-8a3f-441a-930c-1f88cc27f306 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:50.605544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27b9c0bb-8a3f-441a-930c-1f88cc27f306 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:50.611541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b9c0bb-8a3f-441a-930c-1f88cc27f306 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:50.612806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b9c0bb-8a3f-441a-930c-1f88cc27f306 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:50.613233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b9c0bb-8a3f-441a-930c-1f88cc27f306 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:50.613911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b9c0bb-8a3f-441a-930c-1f88cc27f306 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:50.614356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b9c0bb-8a3f-441a-930c-1f88cc27f306 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:50.614802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b9c0bb-8a3f-441a-930c-1f88cc27f306 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:50.638023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27b9c0bb-8a3f-441a-930c-1f88cc27f306 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58/ips" status: 200 len: 150 microversion: 2.1 time: 0.092411 Aug 06 12:35:50.638568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 270/555] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Aug 6 12:35:50 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:35:50.650939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7d60bf4-e0ab-460f-a2f1-966d5f0333ef"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:35:50.653355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:50.655670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:35:50.656332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:35:50.662445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:50.662925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:50.663355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:50.664041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:50.664532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:50.664954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:50.746926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Invalid volume: volume a7d60bf4-e0ab-460f-a2f1-966d5f0333ef is already attached to instances: acfe37e0-b98f-49eb-aef9-6e6279dae867 Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: POST /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58/os-volume_attachments HTTP/1.1 Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 74 Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:35:50.748696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {"volumeAttachment": {"volumeId": "a7d60bf4-e0ab-460f-a2f1-966d5f0333ef"}} Aug 06 12:35:50.750111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Invalid volume: volume a7d60bf4-e0ab-460f-a2f1-966d5f0333ef is already attached to instances: acfe37e0-b98f-49eb-aef9-6e6279dae867 Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': '0c96e9f1-196d-4e86-a163-58a64e30ae58', 'body': {'volumeAttachment': {'volumeId': 'a7d60bf4-e0ab-460f-a2f1-966d5f0333ef'}}} Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a7d60bf4-e0ab-460f-a2f1-966d5f0333ef is already attached to instances: acfe37e0-b98f-49eb-aef9-6e6279dae867 Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:35:50.751012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a7d60bf4-e0ab-460f-a2f1-966d5f0333ef is already attached to instances: acfe37e0-b98f-49eb-aef9-6e6279dae867 Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:35:50.752394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:35:50.754486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:35:50.754486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:35:50.754486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:35:50.754486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a7d60bf4-e0ab-460f-a2f1-966d5f0333ef is already attached to instances: acfe37e0-b98f-49eb-aef9-6e6279dae867 Aug 06 12:35:50.754486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:35:50.754486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 400 to user: Invalid volume: volume a7d60bf4-e0ab-460f-a2f1-966d5f0333ef is already attached to instances: acfe37e0-b98f-49eb-aef9-6e6279dae867 {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:35:50.754486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-16e795eb-647b-43da-aa29-dcef3ac53dd9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103189 Aug 06 12:35:50.754486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 286/556] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 12:35:50 2022] POST /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:35:50.759489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0a893d30-93c1-4c92-bf3f-a2c9b79785e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:50.759975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0a893d30-93c1-4c92-bf3f-a2c9b79785e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:50.766091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a893d30-93c1-4c92-bf3f-a2c9b79785e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:50.766557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a893d30-93c1-4c92-bf3f-a2c9b79785e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:50.766980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a893d30-93c1-4c92-bf3f-a2c9b79785e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:50.767648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a893d30-93c1-4c92-bf3f-a2c9b79785e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:50.768094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a893d30-93c1-4c92-bf3f-a2c9b79785e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:50.768629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a893d30-93c1-4c92-bf3f-a2c9b79785e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:50.794602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0a893d30-93c1-4c92-bf3f-a2c9b79785e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 12:35:50.869868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0a893d30-93c1-4c92-bf3f-a2c9b79785e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 204 len: 0 microversion: 2.1 time: 0.113865 Aug 06 12:35:50.870464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 271/557] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:35:50 2022] DELETE /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 12:35:50.878441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7c458351-6f0e-4430-b50f-c9d51ce4215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:50.879035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7c458351-6f0e-4430-b50f-c9d51ce4215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:50.885479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c458351-6f0e-4430-b50f-c9d51ce4215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:50.885949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c458351-6f0e-4430-b50f-c9d51ce4215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:50.886373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c458351-6f0e-4430-b50f-c9d51ce4215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:50.887044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c458351-6f0e-4430-b50f-c9d51ce4215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:50.887490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c458351-6f0e-4430-b50f-c9d51ce4215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:50.887905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c458351-6f0e-4430-b50f-c9d51ce4215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:51.015007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7c458351-6f0e-4430-b50f-c9d51ce4215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:51.022354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7c458351-6f0e-4430-b50f-c9d51ce4215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.147717 Aug 06 12:35:51.022902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 287/558] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:50 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:52.043990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-362d966b-7356-4a59-a844-0d6947675b27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:52.044700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-362d966b-7356-4a59-a844-0d6947675b27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:52.051388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362d966b-7356-4a59-a844-0d6947675b27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:52.051858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362d966b-7356-4a59-a844-0d6947675b27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:52.052288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362d966b-7356-4a59-a844-0d6947675b27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:52.052996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362d966b-7356-4a59-a844-0d6947675b27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:52.053425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362d966b-7356-4a59-a844-0d6947675b27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:52.053842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362d966b-7356-4a59-a844-0d6947675b27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:52.180496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-362d966b-7356-4a59-a844-0d6947675b27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:52.187903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-362d966b-7356-4a59-a844-0d6947675b27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.148038 Aug 06 12:35:52.188494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 272/559] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:52 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:53.209286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9c824d94-f663-4076-b8d2-cf8eb1a21147 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:53.209819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9c824d94-f663-4076-b8d2-cf8eb1a21147 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:53.216279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c824d94-f663-4076-b8d2-cf8eb1a21147 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:53.216781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c824d94-f663-4076-b8d2-cf8eb1a21147 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:53.217208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c824d94-f663-4076-b8d2-cf8eb1a21147 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:53.217923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c824d94-f663-4076-b8d2-cf8eb1a21147 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:53.218408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c824d94-f663-4076-b8d2-cf8eb1a21147 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:53.218853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c824d94-f663-4076-b8d2-cf8eb1a21147 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:53.346163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9c824d94-f663-4076-b8d2-cf8eb1a21147 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:53.353613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9c824d94-f663-4076-b8d2-cf8eb1a21147 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.148796 Aug 06 12:35:53.354226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 288/560] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:53 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:54.374885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa3f2e76-d3e7-4918-8015-d6c5559e2a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:54.375508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa3f2e76-d3e7-4918-8015-d6c5559e2a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:54.381914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3f2e76-d3e7-4918-8015-d6c5559e2a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:54.382400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3f2e76-d3e7-4918-8015-d6c5559e2a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:54.382825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3f2e76-d3e7-4918-8015-d6c5559e2a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:54.383504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3f2e76-d3e7-4918-8015-d6c5559e2a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:54.383946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3f2e76-d3e7-4918-8015-d6c5559e2a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:54.384396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3f2e76-d3e7-4918-8015-d6c5559e2a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:54.512748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fa3f2e76-d3e7-4918-8015-d6c5559e2a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:54.520097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa3f2e76-d3e7-4918-8015-d6c5559e2a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.149023 Aug 06 12:35:54.521307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 273/561] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:54 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:55.542190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d06c0e74-f4a7-4903-a96a-70cf4146c03e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:55.542824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d06c0e74-f4a7-4903-a96a-70cf4146c03e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:55.549112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d06c0e74-f4a7-4903-a96a-70cf4146c03e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:55.549611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d06c0e74-f4a7-4903-a96a-70cf4146c03e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:55.550022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d06c0e74-f4a7-4903-a96a-70cf4146c03e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:55.550700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d06c0e74-f4a7-4903-a96a-70cf4146c03e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:55.551150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d06c0e74-f4a7-4903-a96a-70cf4146c03e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:55.552162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d06c0e74-f4a7-4903-a96a-70cf4146c03e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:55.680863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d06c0e74-f4a7-4903-a96a-70cf4146c03e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:55.688151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d06c0e74-f4a7-4903-a96a-70cf4146c03e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.149811 Aug 06 12:35:55.688743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 289/562] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:55 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:56.709512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-46aff65b-c622-47d4-9093-003d693c93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:56.710136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-46aff65b-c622-47d4-9093-003d693c93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:56.716629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46aff65b-c622-47d4-9093-003d693c93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:56.717101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46aff65b-c622-47d4-9093-003d693c93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:56.717531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46aff65b-c622-47d4-9093-003d693c93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:56.718207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46aff65b-c622-47d4-9093-003d693c93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:56.718653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46aff65b-c622-47d4-9093-003d693c93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:56.719093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46aff65b-c622-47d4-9093-003d693c93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:56.856258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-46aff65b-c622-47d4-9093-003d693c93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:56.863990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-46aff65b-c622-47d4-9093-003d693c93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.158803 Aug 06 12:35:56.864570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 274/563] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:56 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:57.885001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6618607d-bcab-4110-844a-f690624b483b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:57.885665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6618607d-bcab-4110-844a-f690624b483b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:57.891885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6618607d-bcab-4110-844a-f690624b483b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:57.892399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6618607d-bcab-4110-844a-f690624b483b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:57.892835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6618607d-bcab-4110-844a-f690624b483b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:57.893516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6618607d-bcab-4110-844a-f690624b483b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:57.893963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6618607d-bcab-4110-844a-f690624b483b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:57.894381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6618607d-bcab-4110-844a-f690624b483b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:58.019201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6618607d-bcab-4110-844a-f690624b483b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:58.027152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6618607d-bcab-4110-844a-f690624b483b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.145925 Aug 06 12:35:58.027747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 290/564] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:57 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:35:59.048815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7cecd433-6202-40f5-b005-43ab05f9e948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:35:59.049425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7cecd433-6202-40f5-b005-43ab05f9e948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:35:59.056435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cecd433-6202-40f5-b005-43ab05f9e948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:59.056916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cecd433-6202-40f5-b005-43ab05f9e948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:59.057355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cecd433-6202-40f5-b005-43ab05f9e948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:59.058037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cecd433-6202-40f5-b005-43ab05f9e948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:35:59.058488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cecd433-6202-40f5-b005-43ab05f9e948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:35:59.058910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cecd433-6202-40f5-b005-43ab05f9e948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:35:59.187812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7cecd433-6202-40f5-b005-43ab05f9e948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:35:59.195203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7cecd433-6202-40f5-b005-43ab05f9e948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.150282 Aug 06 12:35:59.195768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 275/565] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:35:59 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:00.216267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f7cf6301-fb07-4d02-82cb-d911b7050e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:00.216830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f7cf6301-fb07-4d02-82cb-d911b7050e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:00.223142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7cf6301-fb07-4d02-82cb-d911b7050e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:00.223620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7cf6301-fb07-4d02-82cb-d911b7050e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:00.224047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7cf6301-fb07-4d02-82cb-d911b7050e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:00.224750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7cf6301-fb07-4d02-82cb-d911b7050e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:00.225202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7cf6301-fb07-4d02-82cb-d911b7050e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:00.225619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7cf6301-fb07-4d02-82cb-d911b7050e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:00.355163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f7cf6301-fb07-4d02-82cb-d911b7050e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:00.362768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f7cf6301-fb07-4d02-82cb-d911b7050e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.150414 Aug 06 12:36:00.363323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 291/566] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:00 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:01.384658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ddb46af1-318b-46a3-afe0-fff41a9ffa3c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:01.385286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ddb46af1-318b-46a3-afe0-fff41a9ffa3c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:01.391683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddb46af1-318b-46a3-afe0-fff41a9ffa3c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:01.392150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddb46af1-318b-46a3-afe0-fff41a9ffa3c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:01.392616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddb46af1-318b-46a3-afe0-fff41a9ffa3c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:01.393287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddb46af1-318b-46a3-afe0-fff41a9ffa3c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:01.393732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddb46af1-318b-46a3-afe0-fff41a9ffa3c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:01.394148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddb46af1-318b-46a3-afe0-fff41a9ffa3c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:01.519440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ddb46af1-318b-46a3-afe0-fff41a9ffa3c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:01.527664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ddb46af1-318b-46a3-afe0-fff41a9ffa3c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.147216 Aug 06 12:36:01.528364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 276/567] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:01 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:02.549311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b912e6a1-2b38-41dc-a3aa-6bf70dc7b5aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:02.549943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b912e6a1-2b38-41dc-a3aa-6bf70dc7b5aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:02.556918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b912e6a1-2b38-41dc-a3aa-6bf70dc7b5aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:02.557397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b912e6a1-2b38-41dc-a3aa-6bf70dc7b5aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:02.557827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b912e6a1-2b38-41dc-a3aa-6bf70dc7b5aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:02.558506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b912e6a1-2b38-41dc-a3aa-6bf70dc7b5aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:02.558959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b912e6a1-2b38-41dc-a3aa-6bf70dc7b5aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:02.559381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b912e6a1-2b38-41dc-a3aa-6bf70dc7b5aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:02.687056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b912e6a1-2b38-41dc-a3aa-6bf70dc7b5aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:02.694953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b912e6a1-2b38-41dc-a3aa-6bf70dc7b5aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.149468 Aug 06 12:36:02.695504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 292/568] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:02 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:03.715973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dcd62962-0340-40c0-be9e-81f91c9f10b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:03.716513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dcd62962-0340-40c0-be9e-81f91c9f10b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:03.722405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcd62962-0340-40c0-be9e-81f91c9f10b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:03.722879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcd62962-0340-40c0-be9e-81f91c9f10b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:03.723308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcd62962-0340-40c0-be9e-81f91c9f10b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:03.724019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcd62962-0340-40c0-be9e-81f91c9f10b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:03.724523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcd62962-0340-40c0-be9e-81f91c9f10b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:03.724972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcd62962-0340-40c0-be9e-81f91c9f10b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:03.863813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dcd62962-0340-40c0-be9e-81f91c9f10b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:03.871961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dcd62962-0340-40c0-be9e-81f91c9f10b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.160022 Aug 06 12:36:03.872558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 277/569] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:03 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:04.893567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-52e9af85-4be1-47af-8586-83de5c1806c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:04.894200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-52e9af85-4be1-47af-8586-83de5c1806c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:04.901035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52e9af85-4be1-47af-8586-83de5c1806c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:04.901509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52e9af85-4be1-47af-8586-83de5c1806c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:04.901937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52e9af85-4be1-47af-8586-83de5c1806c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:04.902617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52e9af85-4be1-47af-8586-83de5c1806c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:04.903065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52e9af85-4be1-47af-8586-83de5c1806c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:04.903478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52e9af85-4be1-47af-8586-83de5c1806c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:05.034011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-52e9af85-4be1-47af-8586-83de5c1806c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:05.041375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-52e9af85-4be1-47af-8586-83de5c1806c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.151646 Aug 06 12:36:05.041928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 293/570] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:04 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:06.061811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-05e0b003-6d13-4f54-b4b4-eb7143e8795e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:06.062420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-05e0b003-6d13-4f54-b4b4-eb7143e8795e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:06.068767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0b003-6d13-4f54-b4b4-eb7143e8795e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:06.069241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0b003-6d13-4f54-b4b4-eb7143e8795e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:06.069671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0b003-6d13-4f54-b4b4-eb7143e8795e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:06.070349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0b003-6d13-4f54-b4b4-eb7143e8795e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:06.070799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0b003-6d13-4f54-b4b4-eb7143e8795e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:06.071220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0b003-6d13-4f54-b4b4-eb7143e8795e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:06.198961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05e0b003-6d13-4f54-b4b4-eb7143e8795e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:06.206449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-05e0b003-6d13-4f54-b4b4-eb7143e8795e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.148467 Aug 06 12:36:06.207012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 278/571] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:06 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:07.233311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3053a51a-28f3-4dff-b749-8d7a8b10bcea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:07.233920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3053a51a-28f3-4dff-b749-8d7a8b10bcea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:07.241266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3053a51a-28f3-4dff-b749-8d7a8b10bcea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:07.241741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3053a51a-28f3-4dff-b749-8d7a8b10bcea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:07.242169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3053a51a-28f3-4dff-b749-8d7a8b10bcea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:07.242856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3053a51a-28f3-4dff-b749-8d7a8b10bcea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:07.243306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3053a51a-28f3-4dff-b749-8d7a8b10bcea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:07.243725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3053a51a-28f3-4dff-b749-8d7a8b10bcea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:07.368449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3053a51a-28f3-4dff-b749-8d7a8b10bcea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:07.375760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3053a51a-28f3-4dff-b749-8d7a8b10bcea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.150674 Aug 06 12:36:07.376326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 294/572] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:07 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:08.397120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-51c882f5-5141-4747-a12a-c09743f6133b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:08.397722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-51c882f5-5141-4747-a12a-c09743f6133b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:08.403988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51c882f5-5141-4747-a12a-c09743f6133b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:08.404504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51c882f5-5141-4747-a12a-c09743f6133b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:08.404932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51c882f5-5141-4747-a12a-c09743f6133b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:08.405609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51c882f5-5141-4747-a12a-c09743f6133b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:08.406059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51c882f5-5141-4747-a12a-c09743f6133b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:08.406481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51c882f5-5141-4747-a12a-c09743f6133b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:08.545435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-51c882f5-5141-4747-a12a-c09743f6133b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:08.552772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-51c882f5-5141-4747-a12a-c09743f6133b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.159492 Aug 06 12:36:08.553984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 279/573] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:08 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:09.575005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6fd6d27-ebdb-468f-93b6-9723529c3f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:09.575610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c6fd6d27-ebdb-468f-93b6-9723529c3f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:09.581962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6fd6d27-ebdb-468f-93b6-9723529c3f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:09.582441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6fd6d27-ebdb-468f-93b6-9723529c3f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:09.582869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6fd6d27-ebdb-468f-93b6-9723529c3f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:09.583549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6fd6d27-ebdb-468f-93b6-9723529c3f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:09.583997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6fd6d27-ebdb-468f-93b6-9723529c3f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:09.584456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6fd6d27-ebdb-468f-93b6-9723529c3f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:09.707828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c6fd6d27-ebdb-468f-93b6-9723529c3f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:09.715126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c6fd6d27-ebdb-468f-93b6-9723529c3f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.144036 Aug 06 12:36:09.715687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 295/574] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:09 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:10.736060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-40aab731-50e4-43db-ae1d-469a233089fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:10.736961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-40aab731-50e4-43db-ae1d-469a233089fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:10.744116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40aab731-50e4-43db-ae1d-469a233089fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:10.744624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40aab731-50e4-43db-ae1d-469a233089fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:10.745052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40aab731-50e4-43db-ae1d-469a233089fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:10.745728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40aab731-50e4-43db-ae1d-469a233089fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:10.746180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40aab731-50e4-43db-ae1d-469a233089fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:10.746596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40aab731-50e4-43db-ae1d-469a233089fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:10.878270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-40aab731-50e4-43db-ae1d-469a233089fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:10.886151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-40aab731-50e4-43db-ae1d-469a233089fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.153891 Aug 06 12:36:10.886642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 280/575] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:10 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:11.906701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-24577227-00d6-4a32-9cff-90ef563b3859 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:11.907301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-24577227-00d6-4a32-9cff-90ef563b3859 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:11.914259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-24577227-00d6-4a32-9cff-90ef563b3859 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:11.914727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-24577227-00d6-4a32-9cff-90ef563b3859 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:11.915150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-24577227-00d6-4a32-9cff-90ef563b3859 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:11.915822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-24577227-00d6-4a32-9cff-90ef563b3859 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:11.916263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-24577227-00d6-4a32-9cff-90ef563b3859 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:11.916699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-24577227-00d6-4a32-9cff-90ef563b3859 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:12.046963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-24577227-00d6-4a32-9cff-90ef563b3859 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:12.054265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-24577227-00d6-4a32-9cff-90ef563b3859 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.151317 Aug 06 12:36:12.054829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 296/576] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:11 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:13.074939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1207c510-ae11-45ba-8069-61bd0fe61145 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:13.075573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1207c510-ae11-45ba-8069-61bd0fe61145 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:13.082255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1207c510-ae11-45ba-8069-61bd0fe61145 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:13.082755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1207c510-ae11-45ba-8069-61bd0fe61145 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:13.083182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1207c510-ae11-45ba-8069-61bd0fe61145 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:13.083943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1207c510-ae11-45ba-8069-61bd0fe61145 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:13.084419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1207c510-ae11-45ba-8069-61bd0fe61145 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:13.084838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1207c510-ae11-45ba-8069-61bd0fe61145 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:13.208822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1207c510-ae11-45ba-8069-61bd0fe61145 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:13.216796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1207c510-ae11-45ba-8069-61bd0fe61145 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.145657 Aug 06 12:36:13.217352 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 281/577] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:13 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:14.238323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de879d54-e32e-4b5f-9a05-1f2368cefdc6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:14.238845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-de879d54-e32e-4b5f-9a05-1f2368cefdc6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:14.245761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de879d54-e32e-4b5f-9a05-1f2368cefdc6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:14.246233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de879d54-e32e-4b5f-9a05-1f2368cefdc6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:14.246657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de879d54-e32e-4b5f-9a05-1f2368cefdc6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:14.247329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de879d54-e32e-4b5f-9a05-1f2368cefdc6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:14.247867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de879d54-e32e-4b5f-9a05-1f2368cefdc6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:14.248284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de879d54-e32e-4b5f-9a05-1f2368cefdc6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:14.375969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-de879d54-e32e-4b5f-9a05-1f2368cefdc6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:14.383301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-de879d54-e32e-4b5f-9a05-1f2368cefdc6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.149118 Aug 06 12:36:14.383846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 297/578] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:14 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:15.403314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-48c2a160-8ef6-4fb7-9dda-1e92cfc65ca4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:15.403920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-48c2a160-8ef6-4fb7-9dda-1e92cfc65ca4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:15.410422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48c2a160-8ef6-4fb7-9dda-1e92cfc65ca4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:15.410960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48c2a160-8ef6-4fb7-9dda-1e92cfc65ca4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:15.411395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48c2a160-8ef6-4fb7-9dda-1e92cfc65ca4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:15.412082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48c2a160-8ef6-4fb7-9dda-1e92cfc65ca4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:15.412557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48c2a160-8ef6-4fb7-9dda-1e92cfc65ca4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:15.412978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48c2a160-8ef6-4fb7-9dda-1e92cfc65ca4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:15.541118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-48c2a160-8ef6-4fb7-9dda-1e92cfc65ca4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:15.548504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-48c2a160-8ef6-4fb7-9dda-1e92cfc65ca4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.148954 Aug 06 12:36:15.549061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 282/579] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:15 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:16.570042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4e51d3af-7f47-4186-b262-1a84dcede03d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:16.570661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4e51d3af-7f47-4186-b262-1a84dcede03d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:16.576467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e51d3af-7f47-4186-b262-1a84dcede03d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:16.576936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e51d3af-7f47-4186-b262-1a84dcede03d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:16.577360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e51d3af-7f47-4186-b262-1a84dcede03d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:16.578032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e51d3af-7f47-4186-b262-1a84dcede03d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:16.578476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e51d3af-7f47-4186-b262-1a84dcede03d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:16.578888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e51d3af-7f47-4186-b262-1a84dcede03d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:16.707943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4e51d3af-7f47-4186-b262-1a84dcede03d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:16.715811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4e51d3af-7f47-4186-b262-1a84dcede03d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.149751 Aug 06 12:36:16.716378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 298/580] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:16 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:17.736683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a4f67451-651c-445b-b2d7-35e03ab7985c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:17.737212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a4f67451-651c-445b-b2d7-35e03ab7985c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:17.744014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4f67451-651c-445b-b2d7-35e03ab7985c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:17.744519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4f67451-651c-445b-b2d7-35e03ab7985c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:17.744952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4f67451-651c-445b-b2d7-35e03ab7985c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:17.745690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4f67451-651c-445b-b2d7-35e03ab7985c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:17.746136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4f67451-651c-445b-b2d7-35e03ab7985c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:17.746553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4f67451-651c-445b-b2d7-35e03ab7985c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:17.875948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a4f67451-651c-445b-b2d7-35e03ab7985c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:17.883390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a4f67451-651c-445b-b2d7-35e03ab7985c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.151040 Aug 06 12:36:17.883951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 283/581] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:17 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:18.099130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4185541a-1c5a-4f0e-a7ad-07aa74373fed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:18.100225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4185541a-1c5a-4f0e-a7ad-07aa74373fed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:18.106049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4185541a-1c5a-4f0e-a7ad-07aa74373fed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:18.106518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4185541a-1c5a-4f0e-a7ad-07aa74373fed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:18.106936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4185541a-1c5a-4f0e-a7ad-07aa74373fed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:18.107606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4185541a-1c5a-4f0e-a7ad-07aa74373fed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:18.108049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4185541a-1c5a-4f0e-a7ad-07aa74373fed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:18.108496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4185541a-1c5a-4f0e-a7ad-07aa74373fed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:18.140158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4185541a-1c5a-4f0e-a7ad-07aa74373fed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments/f6836193-0bd5-44ea-b1ac-808af6b765d6" status: 200 len: 194 microversion: 2.20 time: 0.145411 Aug 06 12:36:18.140933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 299/582] 10.222.0.20 () {60 vars in 1454 bytes} [Sat Aug 6 12:36:17 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments/f6836193-0bd5-44ea-b1ac-808af6b765d6 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:18.206113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-66cadbde-d3ad-4574-b9f9-8f2c5a06453f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:18.206711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-66cadbde-d3ad-4574-b9f9-8f2c5a06453f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:18.213416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66cadbde-d3ad-4574-b9f9-8f2c5a06453f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:18.213970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66cadbde-d3ad-4574-b9f9-8f2c5a06453f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:18.214413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66cadbde-d3ad-4574-b9f9-8f2c5a06453f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:18.215107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66cadbde-d3ad-4574-b9f9-8f2c5a06453f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:18.215562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66cadbde-d3ad-4574-b9f9-8f2c5a06453f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:18.215988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66cadbde-d3ad-4574-b9f9-8f2c5a06453f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:18.293923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-66cadbde-d3ad-4574-b9f9-8f2c5a06453f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lazy-loading 'services' on Instance uuid dc407ff3-fc1e-44bf-9c20-73203361a20f {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:36:18.297334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:18.379789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-66cadbde-d3ad-4574-b9f9-8f2c5a06453f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments/f6836193-0bd5-44ea-b1ac-808af6b765d6" status: 202 len: 0 microversion: 2.20 time: 0.177455 Aug 06 12:36:18.380422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 284/583] 10.222.0.20 () {60 vars in 1457 bytes} [Sat Aug 6 12:36:18 2022] DELETE /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments/f6836193-0bd5-44ea-b1ac-808af6b765d6 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 12:36:18.390299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-56a44fd1-849a-4be0-9b83-83b0e0a2fc0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:18.392769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-56a44fd1-849a-4be0-9b83-83b0e0a2fc0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:18.399421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a44fd1-849a-4be0-9b83-83b0e0a2fc0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:18.399899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a44fd1-849a-4be0-9b83-83b0e0a2fc0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:18.400350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a44fd1-849a-4be0-9b83-83b0e0a2fc0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:18.401040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a44fd1-849a-4be0-9b83-83b0e0a2fc0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:18.401485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a44fd1-849a-4be0-9b83-83b0e0a2fc0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:18.401904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a44fd1-849a-4be0-9b83-83b0e0a2fc0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:18.430696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-56a44fd1-849a-4be0-9b83-83b0e0a2fc0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044271 Aug 06 12:36:18.431247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 300/584] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:18.906099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9d6429ea-6e39-40ed-a803-adc9132ac52c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:18.906700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9d6429ea-6e39-40ed-a803-adc9132ac52c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:18.913288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d6429ea-6e39-40ed-a803-adc9132ac52c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:18.913768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d6429ea-6e39-40ed-a803-adc9132ac52c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:18.914198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d6429ea-6e39-40ed-a803-adc9132ac52c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:18.914906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d6429ea-6e39-40ed-a803-adc9132ac52c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:18.915358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d6429ea-6e39-40ed-a803-adc9132ac52c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:18.915780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d6429ea-6e39-40ed-a803-adc9132ac52c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:19.046579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9d6429ea-6e39-40ed-a803-adc9132ac52c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:19.054608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9d6429ea-6e39-40ed-a803-adc9132ac52c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.153915 Aug 06 12:36:19.055167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 285/585] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:18 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:19.443199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a68e19f5-694f-4afa-b260-f451fe83d88e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:19.445314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a68e19f5-694f-4afa-b260-f451fe83d88e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:19.451500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a68e19f5-694f-4afa-b260-f451fe83d88e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:19.451977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a68e19f5-694f-4afa-b260-f451fe83d88e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:19.452440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a68e19f5-694f-4afa-b260-f451fe83d88e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:19.453120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a68e19f5-694f-4afa-b260-f451fe83d88e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:19.453567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a68e19f5-694f-4afa-b260-f451fe83d88e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:19.453983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a68e19f5-694f-4afa-b260-f451fe83d88e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:19.483388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a68e19f5-694f-4afa-b260-f451fe83d88e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044148 Aug 06 12:36:19.483862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 301/586] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:20.075494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4967b8d0-f478-4652-b757-a9dcf778dec0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:20.076099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4967b8d0-f478-4652-b757-a9dcf778dec0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:20.082413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4967b8d0-f478-4652-b757-a9dcf778dec0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:20.082882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4967b8d0-f478-4652-b757-a9dcf778dec0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:20.083308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4967b8d0-f478-4652-b757-a9dcf778dec0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:20.084005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4967b8d0-f478-4652-b757-a9dcf778dec0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:20.084478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4967b8d0-f478-4652-b757-a9dcf778dec0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:20.084894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4967b8d0-f478-4652-b757-a9dcf778dec0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:20.221490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4967b8d0-f478-4652-b757-a9dcf778dec0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:20.229031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4967b8d0-f478-4652-b757-a9dcf778dec0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.157336 Aug 06 12:36:20.229590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 286/587] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:20 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:20.503929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3443da44-c38a-419d-85ee-af4af1e04a10 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:20.506086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3443da44-c38a-419d-85ee-af4af1e04a10 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:20.513780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3443da44-c38a-419d-85ee-af4af1e04a10 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:20.514249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3443da44-c38a-419d-85ee-af4af1e04a10 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:20.514681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3443da44-c38a-419d-85ee-af4af1e04a10 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:20.515362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3443da44-c38a-419d-85ee-af4af1e04a10 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:20.515807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3443da44-c38a-419d-85ee-af4af1e04a10 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:20.516226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3443da44-c38a-419d-85ee-af4af1e04a10 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:20.532603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:20.546161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3443da44-c38a-419d-85ee-af4af1e04a10 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054327 Aug 06 12:36:20.546716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 302/588] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:21.250677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8f520fb3-22e6-435a-b623-de8f3da466ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:21.251316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8f520fb3-22e6-435a-b623-de8f3da466ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:21.253829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:21.259474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f520fb3-22e6-435a-b623-de8f3da466ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:21.259954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f520fb3-22e6-435a-b623-de8f3da466ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:21.260405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f520fb3-22e6-435a-b623-de8f3da466ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:21.261094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f520fb3-22e6-435a-b623-de8f3da466ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:21.261540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f520fb3-22e6-435a-b623-de8f3da466ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:21.261966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f520fb3-22e6-435a-b623-de8f3da466ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:21.392872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8f520fb3-22e6-435a-b623-de8f3da466ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:21.401316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8f520fb3-22e6-435a-b623-de8f3da466ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.154465 Aug 06 12:36:21.412721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 287/589] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:21 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:21.457700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4e042d22-0e7e-44f5-a6e1-c6951efffb8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:36:21.460225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4e042d22-0e7e-44f5-a6e1-c6951efffb8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:21.462065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=35 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:21.467421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e042d22-0e7e-44f5-a6e1-c6951efffb8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:21.467894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e042d22-0e7e-44f5-a6e1-c6951efffb8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:21.468339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e042d22-0e7e-44f5-a6e1-c6951efffb8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:21.469019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e042d22-0e7e-44f5-a6e1-c6951efffb8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:21.469464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e042d22-0e7e-44f5-a6e1-c6951efffb8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:21.469878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e042d22-0e7e-44f5-a6e1-c6951efffb8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:21.492414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-4e042d22-0e7e-44f5-a6e1-c6951efffb8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'flavor' on Instance uuid 7a8a8915-eeca-4909-aab7-6fe8381ced6e {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:36:21.558566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5ccc8545-389b-44c9-9be9-ca4264a96a3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:21.561033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5ccc8545-389b-44c9-9be9-ca4264a96a3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:21.567382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ccc8545-389b-44c9-9be9-ca4264a96a3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:21.567896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ccc8545-389b-44c9-9be9-ca4264a96a3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:21.569313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ccc8545-389b-44c9-9be9-ca4264a96a3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:21.570130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ccc8545-389b-44c9-9be9-ca4264a96a3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:21.570578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ccc8545-389b-44c9-9be9-ca4264a96a3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:21.571006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ccc8545-389b-44c9-9be9-ca4264a96a3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:21.600765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5ccc8545-389b-44c9-9be9-ca4264a96a3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046087 Aug 06 12:36:21.601336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 288/590] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:21 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:21.614268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4e042d22-0e7e-44f5-a6e1-c6951efffb8c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/action" status: 200 len: 32 microversion: 2.1 time: 0.160478 Aug 06 12:36:21.614910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 303/591] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 12:36:21 2022] POST /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 12:36:21.624405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-145a9a4d-1eb7-4da7-aa5c-cd1b2e6dc473 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:21.625012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-145a9a4d-1eb7-4da7-aa5c-cd1b2e6dc473 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:21.631393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-145a9a4d-1eb7-4da7-aa5c-cd1b2e6dc473 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:21.631873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-145a9a4d-1eb7-4da7-aa5c-cd1b2e6dc473 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:21.632334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-145a9a4d-1eb7-4da7-aa5c-cd1b2e6dc473 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:21.633005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-145a9a4d-1eb7-4da7-aa5c-cd1b2e6dc473 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:21.633458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-145a9a4d-1eb7-4da7-aa5c-cd1b2e6dc473 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:21.633883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-145a9a4d-1eb7-4da7-aa5c-cd1b2e6dc473 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:21.820605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-145a9a4d-1eb7-4da7-aa5c-cd1b2e6dc473 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:21.828909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-145a9a4d-1eb7-4da7-aa5c-cd1b2e6dc473 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.208147 Aug 06 12:36:21.829742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 289/592] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:21 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:22.423603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de999482-dfee-41e8-95dc-ba8946c3b775 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:22.424318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-de999482-dfee-41e8-95dc-ba8946c3b775 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:22.431276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de999482-dfee-41e8-95dc-ba8946c3b775 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:22.431866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de999482-dfee-41e8-95dc-ba8946c3b775 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:22.432376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de999482-dfee-41e8-95dc-ba8946c3b775 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:22.433072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de999482-dfee-41e8-95dc-ba8946c3b775 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:22.433521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de999482-dfee-41e8-95dc-ba8946c3b775 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:22.434109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de999482-dfee-41e8-95dc-ba8946c3b775 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:22.566373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-de999482-dfee-41e8-95dc-ba8946c3b775 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:22.574094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-de999482-dfee-41e8-95dc-ba8946c3b775 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1682 microversion: 2.1 time: 0.154851 Aug 06 12:36:22.574659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 304/593] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:22 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:22.613910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ea21f60b-7a1c-4e5d-8a52-a72261ec3e49 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:22.616329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ea21f60b-7a1c-4e5d-8a52-a72261ec3e49 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:22.622770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea21f60b-7a1c-4e5d-8a52-a72261ec3e49 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:22.623313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea21f60b-7a1c-4e5d-8a52-a72261ec3e49 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:22.623825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea21f60b-7a1c-4e5d-8a52-a72261ec3e49 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:22.624589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea21f60b-7a1c-4e5d-8a52-a72261ec3e49 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:22.625117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea21f60b-7a1c-4e5d-8a52-a72261ec3e49 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:22.625599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea21f60b-7a1c-4e5d-8a52-a72261ec3e49 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:22.655034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ea21f60b-7a1c-4e5d-8a52-a72261ec3e49 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045871 Aug 06 12:36:22.655805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 290/594] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:22.851731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0b723a49-e46f-4671-ab5b-f39adb60a117 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:22.852876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0b723a49-e46f-4671-ab5b-f39adb60a117 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:22.859197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b723a49-e46f-4671-ab5b-f39adb60a117 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:22.859679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b723a49-e46f-4671-ab5b-f39adb60a117 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:22.860108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b723a49-e46f-4671-ab5b-f39adb60a117 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:22.860833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b723a49-e46f-4671-ab5b-f39adb60a117 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:22.861528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b723a49-e46f-4671-ab5b-f39adb60a117 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:22.861955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b723a49-e46f-4671-ab5b-f39adb60a117 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:23.008200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0b723a49-e46f-4671-ab5b-f39adb60a117 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:23.016276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0b723a49-e46f-4671-ab5b-f39adb60a117 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.169961 Aug 06 12:36:23.016877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 305/595] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:23.301223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-e5e3f29e-0f5b-4731-a6e7-9be510e78718 req-183bc213-77f9-4cb0-8d34-68cc4609a84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c96e9f1-196d-4e86-a163-58a64e30ae58", "name": "network-vif-deleted", "tag": "6390bd46-0ea5-482b-9163-12625693fc0b"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:36:23.313182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e5e3f29e-0f5b-4731-a6e7-9be510e78718 req-183bc213-77f9-4cb0-8d34-68cc4609a84d service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:23.313716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e5e3f29e-0f5b-4731-a6e7-9be510e78718 req-183bc213-77f9-4cb0-8d34-68cc4609a84d service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:23.314090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e5e3f29e-0f5b-4731-a6e7-9be510e78718 req-183bc213-77f9-4cb0-8d34-68cc4609a84d service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:23.327686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-e5e3f29e-0f5b-4731-a6e7-9be510e78718 req-183bc213-77f9-4cb0-8d34-68cc4609a84d service nova] Creating event network-vif-deleted:6390bd46-0ea5-482b-9163-12625693fc0b for instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 on hv-cinder-85199 Aug 06 12:36:23.333266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-e5e3f29e-0f5b-4731-a6e7-9be510e78718 req-183bc213-77f9-4cb0-8d34-68cc4609a84d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105118 Aug 06 12:36:23.334682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 291/596] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:23.595728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:23.596242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:23.602511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:23.602991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:23.603417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:23.604105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:23.604570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:23.604985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:23.639834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:23.640333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:23.640779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:23.641217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lazy-loading 'fault' on Instance uuid 0c96e9f1-196d-4e86-a163-58a64e30ae58 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:36:23.668158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96a44848-865f-470f-9470-848f29611819 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:23.671042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-96a44848-865f-470f-9470-848f29611819 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:23.678742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96a44848-865f-470f-9470-848f29611819 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:23.679504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96a44848-865f-470f-9470-848f29611819 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:23.680095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96a44848-865f-470f-9470-848f29611819 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:23.680970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96a44848-865f-470f-9470-848f29611819 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:23.681597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96a44848-865f-470f-9470-848f29611819 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:23.682178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96a44848-865f-470f-9470-848f29611819 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:23.697130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:23.708217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9df7d25b-ad2e-4417-a4ef-c26503672f9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 200 len: 1331 microversion: 2.1 time: 0.116304 Aug 06 12:36:23.711367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 306/597] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:23 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:23.714425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-96a44848-865f-470f-9470-848f29611819 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051033 Aug 06 12:36:23.719605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 292/598] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:24.037612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0738c516-b388-4c6f-b280-fa9bfcb15085 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:24.038519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0738c516-b388-4c6f-b280-fa9bfcb15085 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:24.045296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0738c516-b388-4c6f-b280-fa9bfcb15085 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:24.045902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0738c516-b388-4c6f-b280-fa9bfcb15085 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:24.046584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0738c516-b388-4c6f-b280-fa9bfcb15085 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:24.047357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0738c516-b388-4c6f-b280-fa9bfcb15085 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:24.048017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0738c516-b388-4c6f-b280-fa9bfcb15085 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:24.048663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0738c516-b388-4c6f-b280-fa9bfcb15085 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:24.189540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0738c516-b388-4c6f-b280-fa9bfcb15085 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:24.197651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0738c516-b388-4c6f-b280-fa9bfcb15085 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.164125 Aug 06 12:36:24.198208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 307/599] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:24.727695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ecf169e3-0535-4a98-aa84-c976fa7d7779 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:24.729397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:24.730003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ecf169e3-0535-4a98-aa84-c976fa7d7779 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:24.730150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:24.736750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecf169e3-0535-4a98-aa84-c976fa7d7779 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:24.736898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:24.737243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:24.737440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecf169e3-0535-4a98-aa84-c976fa7d7779 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:24.737672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:24.737998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecf169e3-0535-4a98-aa84-c976fa7d7779 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:24.738363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:24.738809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:24.738914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecf169e3-0535-4a98-aa84-c976fa7d7779 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:24.739231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:24.739423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecf169e3-0535-4a98-aa84-c976fa7d7779 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:24.739980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecf169e3-0535-4a98-aa84-c976fa7d7779 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:24.753871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 HTTP/1.1 Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:36:24.755503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 12:36:24.757149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '0c96e9f1-196d-4e86-a163-58a64e30ae58'} Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:36:24.758247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 12:36:24.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:36:24.761530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:36:24.761530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0b80cc89-b7ba-44bf-a88c-f5df2dd04f6e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 404 len: 111 microversion: 2.1 time: 0.031440 Aug 06 12:36:24.761530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 308/600] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:24 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 12:36:24.766233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-58b3f1e9-f753-48dc-b5ee-ee0b8161719c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '.version_select at 0x7f541a99aca0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:24.781277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ecf169e3-0535-4a98-aa84-c976fa7d7779 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058111 Aug 06 12:36:24.782058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 293/601] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:24.795002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-58b3f1e9-f753-48dc-b5ee-ee0b8161719c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219361234" status: 202 len: 0 microversion: 2.1 time: 0.032381 Aug 06 12:36:24.795572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 309/602] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Aug 6 12:36:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219361234 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:36:25.218666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad153d85-5958-4509-b51b-bc7614bde66e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:25.219379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad153d85-5958-4509-b51b-bc7614bde66e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:25.225443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad153d85-5958-4509-b51b-bc7614bde66e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:25.225863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad153d85-5958-4509-b51b-bc7614bde66e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:25.226296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad153d85-5958-4509-b51b-bc7614bde66e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:25.226986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad153d85-5958-4509-b51b-bc7614bde66e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:25.227438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad153d85-5958-4509-b51b-bc7614bde66e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:25.227861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad153d85-5958-4509-b51b-bc7614bde66e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:25.441958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad153d85-5958-4509-b51b-bc7614bde66e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:25.450412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad153d85-5958-4509-b51b-bc7614bde66e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.235571 Aug 06 12:36:25.450973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 294/603] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:25.540605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4d9fba7f-a851-495b-a4b3-576a2fa46a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:25.541189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4d9fba7f-a851-495b-a4b3-576a2fa46a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:25.548892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d9fba7f-a851-495b-a4b3-576a2fa46a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:25.549366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d9fba7f-a851-495b-a4b3-576a2fa46a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:25.549790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d9fba7f-a851-495b-a4b3-576a2fa46a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:25.550463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d9fba7f-a851-495b-a4b3-576a2fa46a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:25.550907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d9fba7f-a851-495b-a4b3-576a2fa46a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:25.551354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d9fba7f-a851-495b-a4b3-576a2fa46a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:25.669062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-4d9fba7f-a851-495b-a4b3-576a2fa46a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lazy-loading 'services' on Instance uuid acfe37e0-b98f-49eb-aef9-6e6279dae867 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:36:25.780134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4d9fba7f-a851-495b-a4b3-576a2fa46a51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments/a7d60bf4-e0ab-460f-a2f1-966d5f0333ef" status: 202 len: 0 microversion: 2.1 time: 0.243316 Aug 06 12:36:25.780778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 310/604] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:36:25 2022] DELETE /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments/a7d60bf4-e0ab-460f-a2f1-966d5f0333ef => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:36:25.789935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1dffde32-9710-4189-8670-3259fca748cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:25.792203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1dffde32-9710-4189-8670-3259fca748cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:25.794731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5fecb975-f5c7-4795-865e-054bb67931d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:25.797201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5fecb975-f5c7-4795-865e-054bb67931d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:25.799316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dffde32-9710-4189-8670-3259fca748cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:25.799828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dffde32-9710-4189-8670-3259fca748cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:25.800475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dffde32-9710-4189-8670-3259fca748cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:25.801145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dffde32-9710-4189-8670-3259fca748cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:25.801934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dffde32-9710-4189-8670-3259fca748cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:25.802055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dffde32-9710-4189-8670-3259fca748cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:25.804636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fecb975-f5c7-4795-865e-054bb67931d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:25.805119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fecb975-f5c7-4795-865e-054bb67931d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:25.805545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fecb975-f5c7-4795-865e-054bb67931d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:25.806237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fecb975-f5c7-4795-865e-054bb67931d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:25.806682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fecb975-f5c7-4795-865e-054bb67931d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:25.807101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fecb975-f5c7-4795-865e-054bb67931d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:25.835072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1dffde32-9710-4189-8670-3259fca748cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049803 Aug 06 12:36:25.835757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 295/605] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:25 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:25.837163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5fecb975-f5c7-4795-865e-054bb67931d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047071 Aug 06 12:36:25.837709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 311/606] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:26.470790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7d64dcec-12ba-4bd0-918e-12f788921860 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:26.471397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7d64dcec-12ba-4bd0-918e-12f788921860 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:26.477230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d64dcec-12ba-4bd0-918e-12f788921860 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:26.477704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d64dcec-12ba-4bd0-918e-12f788921860 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:26.478159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d64dcec-12ba-4bd0-918e-12f788921860 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:26.478833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d64dcec-12ba-4bd0-918e-12f788921860 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:26.479279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d64dcec-12ba-4bd0-918e-12f788921860 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:26.479698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d64dcec-12ba-4bd0-918e-12f788921860 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:26.604068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7d64dcec-12ba-4bd0-918e-12f788921860 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:26.612138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7d64dcec-12ba-4bd0-918e-12f788921860 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145255 Aug 06 12:36:26.612726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 296/607] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:26.847184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e8f8ad89-2adb-4fdf-98e5-a6bbe8c74ba4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:26.849245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-572b9da9-d22d-4da2-9f95-15c474ecb577 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:26.849627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e8f8ad89-2adb-4fdf-98e5-a6bbe8c74ba4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:26.851477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-572b9da9-d22d-4da2-9f95-15c474ecb577 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:26.855795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8f8ad89-2adb-4fdf-98e5-a6bbe8c74ba4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:26.856429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8f8ad89-2adb-4fdf-98e5-a6bbe8c74ba4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:26.856733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8f8ad89-2adb-4fdf-98e5-a6bbe8c74ba4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:26.857419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8f8ad89-2adb-4fdf-98e5-a6bbe8c74ba4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:26.857788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-572b9da9-d22d-4da2-9f95-15c474ecb577 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:26.857888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8f8ad89-2adb-4fdf-98e5-a6bbe8c74ba4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:26.858265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-572b9da9-d22d-4da2-9f95-15c474ecb577 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:26.858369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8f8ad89-2adb-4fdf-98e5-a6bbe8c74ba4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:26.858697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-572b9da9-d22d-4da2-9f95-15c474ecb577 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:26.859378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-572b9da9-d22d-4da2-9f95-15c474ecb577 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:26.859821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-572b9da9-d22d-4da2-9f95-15c474ecb577 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:26.860235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-572b9da9-d22d-4da2-9f95-15c474ecb577 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:26.888388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e8f8ad89-2adb-4fdf-98e5-a6bbe8c74ba4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Aug 06 12:36:26.889180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 312/608] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:26.890426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-572b9da9-d22d-4da2-9f95-15c474ecb577 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045103 Aug 06 12:36:26.890987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 297/609] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:27.633509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d7dbe61e-54ea-4078-8024-1f879792e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:27.634101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d7dbe61e-54ea-4078-8024-1f879792e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:27.639929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7dbe61e-54ea-4078-8024-1f879792e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:27.640436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7dbe61e-54ea-4078-8024-1f879792e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:27.640866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7dbe61e-54ea-4078-8024-1f879792e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:27.641534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7dbe61e-54ea-4078-8024-1f879792e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:27.641980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7dbe61e-54ea-4078-8024-1f879792e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:27.642392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7dbe61e-54ea-4078-8024-1f879792e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:27.773597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d7dbe61e-54ea-4078-8024-1f879792e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:27.781572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d7dbe61e-54ea-4078-8024-1f879792e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152453 Aug 06 12:36:27.782119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 313/610] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:27.900520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0600775b-cbcf-492e-bd79-b72384a8d1d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:27.902175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-221b45cf-372f-46fc-8a87-35d7a5789640 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:27.902556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0600775b-cbcf-492e-bd79-b72384a8d1d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:27.904337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-221b45cf-372f-46fc-8a87-35d7a5789640 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:27.908977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0600775b-cbcf-492e-bd79-b72384a8d1d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:27.909478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0600775b-cbcf-492e-bd79-b72384a8d1d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:27.909912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0600775b-cbcf-492e-bd79-b72384a8d1d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:27.910502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-221b45cf-372f-46fc-8a87-35d7a5789640 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:27.910620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0600775b-cbcf-492e-bd79-b72384a8d1d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:27.910976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-221b45cf-372f-46fc-8a87-35d7a5789640 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:27.911097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0600775b-cbcf-492e-bd79-b72384a8d1d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:27.911401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-221b45cf-372f-46fc-8a87-35d7a5789640 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:27.912002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0600775b-cbcf-492e-bd79-b72384a8d1d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:27.912601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-221b45cf-372f-46fc-8a87-35d7a5789640 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:27.913067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-221b45cf-372f-46fc-8a87-35d7a5789640 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:27.913479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-221b45cf-372f-46fc-8a87-35d7a5789640 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:27.941651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0600775b-cbcf-492e-bd79-b72384a8d1d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045073 Aug 06 12:36:27.942208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 298/611] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:27 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:27.945517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-221b45cf-372f-46fc-8a87-35d7a5789640 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047190 Aug 06 12:36:27.946064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 314/612] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:28.801611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5bd6547a-9295-404b-a7bb-3fa4abb8a502 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:28.802900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5bd6547a-9295-404b-a7bb-3fa4abb8a502 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:28.808776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd6547a-9295-404b-a7bb-3fa4abb8a502 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:28.809248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd6547a-9295-404b-a7bb-3fa4abb8a502 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:28.809703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd6547a-9295-404b-a7bb-3fa4abb8a502 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:28.810377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd6547a-9295-404b-a7bb-3fa4abb8a502 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:28.810824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd6547a-9295-404b-a7bb-3fa4abb8a502 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:28.811240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bd6547a-9295-404b-a7bb-3fa4abb8a502 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:28.938465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5bd6547a-9295-404b-a7bb-3fa4abb8a502 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:28.946268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5bd6547a-9295-404b-a7bb-3fa4abb8a502 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148457 Aug 06 12:36:28.946824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 299/613] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:28 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:28.954125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-be6a3469-7f3d-47d1-b28b-5e283bcff6df tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:28.956282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-be6a3469-7f3d-47d1-b28b-5e283bcff6df tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:28.957116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-619235e7-8256-469c-9d2f-ec5458a0d3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:28.959823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-619235e7-8256-469c-9d2f-ec5458a0d3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:28.963884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be6a3469-7f3d-47d1-b28b-5e283bcff6df tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:28.964389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be6a3469-7f3d-47d1-b28b-5e283bcff6df tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:28.964816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be6a3469-7f3d-47d1-b28b-5e283bcff6df tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:28.965497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be6a3469-7f3d-47d1-b28b-5e283bcff6df tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:28.965818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-619235e7-8256-469c-9d2f-ec5458a0d3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:28.966000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be6a3469-7f3d-47d1-b28b-5e283bcff6df tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:28.966300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-619235e7-8256-469c-9d2f-ec5458a0d3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:28.966417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be6a3469-7f3d-47d1-b28b-5e283bcff6df tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:28.966734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-619235e7-8256-469c-9d2f-ec5458a0d3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:28.967474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-619235e7-8256-469c-9d2f-ec5458a0d3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:28.967923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-619235e7-8256-469c-9d2f-ec5458a0d3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:28.968377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-619235e7-8256-469c-9d2f-ec5458a0d3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:28.995683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-be6a3469-7f3d-47d1-b28b-5e283bcff6df tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045743 Aug 06 12:36:28.996555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 315/614] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:28 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:29.000409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-619235e7-8256-469c-9d2f-ec5458a0d3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047082 Aug 06 12:36:29.000974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 300/615] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:29.967432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c53c115e-8649-4eb8-a5bc-9a584890add0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:29.968063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c53c115e-8649-4eb8-a5bc-9a584890add0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:29.974403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53c115e-8649-4eb8-a5bc-9a584890add0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:29.974880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53c115e-8649-4eb8-a5bc-9a584890add0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:29.975309 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53c115e-8649-4eb8-a5bc-9a584890add0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:29.975986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53c115e-8649-4eb8-a5bc-9a584890add0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:29.976462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53c115e-8649-4eb8-a5bc-9a584890add0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:29.976883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53c115e-8649-4eb8-a5bc-9a584890add0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:30.009049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6c60ceaa-65f1-48cd-aa01-6b63eceb240b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:30.011153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6c60ceaa-65f1-48cd-aa01-6b63eceb240b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:30.017655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c60ceaa-65f1-48cd-aa01-6b63eceb240b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:30.018130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c60ceaa-65f1-48cd-aa01-6b63eceb240b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:30.018560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c60ceaa-65f1-48cd-aa01-6b63eceb240b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:30.019247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c60ceaa-65f1-48cd-aa01-6b63eceb240b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:30.019698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c60ceaa-65f1-48cd-aa01-6b63eceb240b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:30.020117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c60ceaa-65f1-48cd-aa01-6b63eceb240b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:30.044745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:30.050174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6c60ceaa-65f1-48cd-aa01-6b63eceb240b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045572 Aug 06 12:36:30.050683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 301/616] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:30 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:30.056908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4a8aa8b0-1ad8-4d55-b8a6-96071995feab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:30.059004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4a8aa8b0-1ad8-4d55-b8a6-96071995feab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:30.065292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8aa8b0-1ad8-4d55-b8a6-96071995feab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:30.065773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8aa8b0-1ad8-4d55-b8a6-96071995feab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:30.066204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8aa8b0-1ad8-4d55-b8a6-96071995feab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:30.066889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8aa8b0-1ad8-4d55-b8a6-96071995feab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:30.067338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8aa8b0-1ad8-4d55-b8a6-96071995feab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:30.067804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8aa8b0-1ad8-4d55-b8a6-96071995feab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:30.096434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4a8aa8b0-1ad8-4d55-b8a6-96071995feab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044719 Aug 06 12:36:30.096986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 302/617] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:30.106279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c53c115e-8649-4eb8-a5bc-9a584890add0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:30.114313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c53c115e-8649-4eb8-a5bc-9a584890add0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150698 Aug 06 12:36:30.115560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 316/618] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:31.063375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c51bed8d-05da-446c-b8e8-36aa8e8f64e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:31.065518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c51bed8d-05da-446c-b8e8-36aa8e8f64e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:31.072582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51bed8d-05da-446c-b8e8-36aa8e8f64e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:31.073053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51bed8d-05da-446c-b8e8-36aa8e8f64e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:31.073480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51bed8d-05da-446c-b8e8-36aa8e8f64e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:31.074158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51bed8d-05da-446c-b8e8-36aa8e8f64e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:31.074605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51bed8d-05da-446c-b8e8-36aa8e8f64e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:31.075020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51bed8d-05da-446c-b8e8-36aa8e8f64e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:31.104212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c51bed8d-05da-446c-b8e8-36aa8e8f64e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Aug 06 12:36:31.104514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 303/619] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:31 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:31.109304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-acff6eee-875a-449c-a84e-0ad9efed4c64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:31.111706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-acff6eee-875a-449c-a84e-0ad9efed4c64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:31.118995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acff6eee-875a-449c-a84e-0ad9efed4c64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:31.119468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acff6eee-875a-449c-a84e-0ad9efed4c64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:31.119898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acff6eee-875a-449c-a84e-0ad9efed4c64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:31.120601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acff6eee-875a-449c-a84e-0ad9efed4c64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:31.121050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acff6eee-875a-449c-a84e-0ad9efed4c64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:31.121467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acff6eee-875a-449c-a84e-0ad9efed4c64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:31.135160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2f6a97aa-8490-4d80-a104-5cde9e22e4c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:31.135755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2f6a97aa-8490-4d80-a104-5cde9e22e4c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:31.141480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f6a97aa-8490-4d80-a104-5cde9e22e4c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:31.141955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f6a97aa-8490-4d80-a104-5cde9e22e4c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:31.142382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f6a97aa-8490-4d80-a104-5cde9e22e4c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:31.143058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f6a97aa-8490-4d80-a104-5cde9e22e4c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:31.143506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f6a97aa-8490-4d80-a104-5cde9e22e4c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:31.143925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f6a97aa-8490-4d80-a104-5cde9e22e4c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:31.146635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:31.151538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-acff6eee-875a-449c-a84e-0ad9efed4c64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046099 Aug 06 12:36:31.152096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 317/620] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:31.270947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2f6a97aa-8490-4d80-a104-5cde9e22e4c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:31.278883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2f6a97aa-8490-4d80-a104-5cde9e22e4c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147323 Aug 06 12:36:31.279438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 304/621] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:32.115512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fc59fd9b-a052-48a5-842c-757b5855f48b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:32.117615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fc59fd9b-a052-48a5-842c-757b5855f48b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:32.125562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc59fd9b-a052-48a5-842c-757b5855f48b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:32.126039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc59fd9b-a052-48a5-842c-757b5855f48b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:32.126500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc59fd9b-a052-48a5-842c-757b5855f48b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:32.127183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc59fd9b-a052-48a5-842c-757b5855f48b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:32.127629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc59fd9b-a052-48a5-842c-757b5855f48b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:32.128046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc59fd9b-a052-48a5-842c-757b5855f48b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:32.156557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fc59fd9b-a052-48a5-842c-757b5855f48b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Aug 06 12:36:32.157107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 318/622] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:32.164387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ca9923fa-f42b-4324-8b6a-6e55da37b6f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:32.166485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ca9923fa-f42b-4324-8b6a-6e55da37b6f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:32.172725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca9923fa-f42b-4324-8b6a-6e55da37b6f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:32.173203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca9923fa-f42b-4324-8b6a-6e55da37b6f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:32.173632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca9923fa-f42b-4324-8b6a-6e55da37b6f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:32.174305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca9923fa-f42b-4324-8b6a-6e55da37b6f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:32.174751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca9923fa-f42b-4324-8b6a-6e55da37b6f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:32.175183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca9923fa-f42b-4324-8b6a-6e55da37b6f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:32.202581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ca9923fa-f42b-4324-8b6a-6e55da37b6f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042796 Aug 06 12:36:32.203116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 305/623] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:32.299618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bddf735e-9aae-424f-badd-80c9aaabebef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:32.300219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bddf735e-9aae-424f-badd-80c9aaabebef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:32.306123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bddf735e-9aae-424f-badd-80c9aaabebef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:32.306596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bddf735e-9aae-424f-badd-80c9aaabebef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:32.307017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bddf735e-9aae-424f-badd-80c9aaabebef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:32.307688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bddf735e-9aae-424f-badd-80c9aaabebef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:32.308133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bddf735e-9aae-424f-badd-80c9aaabebef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:32.308575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bddf735e-9aae-424f-badd-80c9aaabebef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:32.436512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bddf735e-9aae-424f-badd-80c9aaabebef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:32.444836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bddf735e-9aae-424f-badd-80c9aaabebef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149023 Aug 06 12:36:32.445390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 319/624] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:33.168762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b66e7a2e-323c-45e5-8172-efdf949cbd40 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:33.170858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b66e7a2e-323c-45e5-8172-efdf949cbd40 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:33.177506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b66e7a2e-323c-45e5-8172-efdf949cbd40 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:33.177981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b66e7a2e-323c-45e5-8172-efdf949cbd40 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:33.178410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b66e7a2e-323c-45e5-8172-efdf949cbd40 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:33.179108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b66e7a2e-323c-45e5-8172-efdf949cbd40 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:33.179551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b66e7a2e-323c-45e5-8172-efdf949cbd40 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:33.180010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b66e7a2e-323c-45e5-8172-efdf949cbd40 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:33.207592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b66e7a2e-323c-45e5-8172-efdf949cbd40 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Aug 06 12:36:33.208166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 306/625] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:33.214870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d0e772a0-de0f-417b-953a-3c852530527f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:33.216982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d0e772a0-de0f-417b-953a-3c852530527f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:33.223306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0e772a0-de0f-417b-953a-3c852530527f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:33.224287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0e772a0-de0f-417b-953a-3c852530527f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:33.224741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0e772a0-de0f-417b-953a-3c852530527f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:33.225423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0e772a0-de0f-417b-953a-3c852530527f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:33.225870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0e772a0-de0f-417b-953a-3c852530527f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:33.226286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0e772a0-de0f-417b-953a-3c852530527f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:33.255726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d0e772a0-de0f-417b-953a-3c852530527f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044717 Aug 06 12:36:33.256274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 320/626] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:33.465489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-719a1e60-f555-4da3-af8f-2f65074ea061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:33.466092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-719a1e60-f555-4da3-af8f-2f65074ea061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:33.472003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-719a1e60-f555-4da3-af8f-2f65074ea061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:33.472525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-719a1e60-f555-4da3-af8f-2f65074ea061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:33.472950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-719a1e60-f555-4da3-af8f-2f65074ea061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:33.473623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-719a1e60-f555-4da3-af8f-2f65074ea061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:33.474653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-719a1e60-f555-4da3-af8f-2f65074ea061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:33.475069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-719a1e60-f555-4da3-af8f-2f65074ea061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:33.600132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-719a1e60-f555-4da3-af8f-2f65074ea061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:33.608074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-719a1e60-f555-4da3-af8f-2f65074ea061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146392 Aug 06 12:36:33.608653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 307/627] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:34.219227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8c07c7eb-2b16-4732-a679-efac55a42aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:34.221382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8c07c7eb-2b16-4732-a679-efac55a42aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:34.227696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c07c7eb-2b16-4732-a679-efac55a42aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:34.228166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c07c7eb-2b16-4732-a679-efac55a42aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:34.228620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c07c7eb-2b16-4732-a679-efac55a42aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:34.229301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c07c7eb-2b16-4732-a679-efac55a42aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:34.229741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c07c7eb-2b16-4732-a679-efac55a42aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:34.230153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c07c7eb-2b16-4732-a679-efac55a42aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:34.259107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8c07c7eb-2b16-4732-a679-efac55a42aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 Aug 06 12:36:34.259655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 321/628] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:34 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:34.268185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9447e139-366d-4389-82bb-f664f7188719 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:34.270398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9447e139-366d-4389-82bb-f664f7188719 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:34.276816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9447e139-366d-4389-82bb-f664f7188719 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:34.277303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9447e139-366d-4389-82bb-f664f7188719 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:34.277739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9447e139-366d-4389-82bb-f664f7188719 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:34.278426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9447e139-366d-4389-82bb-f664f7188719 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:34.278884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9447e139-366d-4389-82bb-f664f7188719 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:34.279307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9447e139-366d-4389-82bb-f664f7188719 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:34.307665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9447e139-366d-4389-82bb-f664f7188719 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043429 Aug 06 12:36:34.308222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 308/629] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:34.629589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f71ac47f-808a-4c74-acc8-b8d0aa0f205f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:34.630295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f71ac47f-808a-4c74-acc8-b8d0aa0f205f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:34.636326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f71ac47f-808a-4c74-acc8-b8d0aa0f205f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:34.636825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f71ac47f-808a-4c74-acc8-b8d0aa0f205f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:34.637256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f71ac47f-808a-4c74-acc8-b8d0aa0f205f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:34.637934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f71ac47f-808a-4c74-acc8-b8d0aa0f205f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:34.638409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f71ac47f-808a-4c74-acc8-b8d0aa0f205f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:34.638828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f71ac47f-808a-4c74-acc8-b8d0aa0f205f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:34.767209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f71ac47f-808a-4c74-acc8-b8d0aa0f205f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:34.775032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f71ac47f-808a-4c74-acc8-b8d0aa0f205f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149303 Aug 06 12:36:34.775578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 322/630] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:35.271768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-75ab4094-4ed7-4b57-a1ad-424852a7f180 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:35.273846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-75ab4094-4ed7-4b57-a1ad-424852a7f180 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:35.280228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75ab4094-4ed7-4b57-a1ad-424852a7f180 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:35.280751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75ab4094-4ed7-4b57-a1ad-424852a7f180 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:35.281349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75ab4094-4ed7-4b57-a1ad-424852a7f180 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:35.281861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75ab4094-4ed7-4b57-a1ad-424852a7f180 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:35.282306 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75ab4094-4ed7-4b57-a1ad-424852a7f180 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:35.282721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75ab4094-4ed7-4b57-a1ad-424852a7f180 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:35.312847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-75ab4094-4ed7-4b57-a1ad-424852a7f180 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045604 Aug 06 12:36:35.313413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 309/631] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:35 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:35.319209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-daa30e73-97a1-4f22-8a25-021790a8796d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:35.321408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-daa30e73-97a1-4f22-8a25-021790a8796d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:35.327776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-daa30e73-97a1-4f22-8a25-021790a8796d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:35.328256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-daa30e73-97a1-4f22-8a25-021790a8796d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:35.328729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-daa30e73-97a1-4f22-8a25-021790a8796d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:35.329415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-daa30e73-97a1-4f22-8a25-021790a8796d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:35.329868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-daa30e73-97a1-4f22-8a25-021790a8796d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:35.330288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-daa30e73-97a1-4f22-8a25-021790a8796d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:35.359900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-daa30e73-97a1-4f22-8a25-021790a8796d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044666 Aug 06 12:36:35.360495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 323/632] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:35.796204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d127d5db-1060-4dbd-ae6e-52be90277031 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:35.796838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d127d5db-1060-4dbd-ae6e-52be90277031 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:35.802675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d127d5db-1060-4dbd-ae6e-52be90277031 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:35.803151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d127d5db-1060-4dbd-ae6e-52be90277031 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:35.803579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d127d5db-1060-4dbd-ae6e-52be90277031 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:35.804258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d127d5db-1060-4dbd-ae6e-52be90277031 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:35.804738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d127d5db-1060-4dbd-ae6e-52be90277031 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:35.805157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d127d5db-1060-4dbd-ae6e-52be90277031 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:35.935913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d127d5db-1060-4dbd-ae6e-52be90277031 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:35.943938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d127d5db-1060-4dbd-ae6e-52be90277031 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151548 Aug 06 12:36:35.944539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 310/633] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:35 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:36.325093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-166c8721-f8b8-4819-9dee-d615319942f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:36.327192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-166c8721-f8b8-4819-9dee-d615319942f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:36.334384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-166c8721-f8b8-4819-9dee-d615319942f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:36.334854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-166c8721-f8b8-4819-9dee-d615319942f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:36.335286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-166c8721-f8b8-4819-9dee-d615319942f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:36.335972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-166c8721-f8b8-4819-9dee-d615319942f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:36.336439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-166c8721-f8b8-4819-9dee-d615319942f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:36.336845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-166c8721-f8b8-4819-9dee-d615319942f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:36.365255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-166c8721-f8b8-4819-9dee-d615319942f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044135 Aug 06 12:36:36.365812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 324/634] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:36 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:36.372321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8087d0c6-02ae-47da-925d-55c1c09fe26c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:36.374647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8087d0c6-02ae-47da-925d-55c1c09fe26c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:36.381474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8087d0c6-02ae-47da-925d-55c1c09fe26c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:36.381956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8087d0c6-02ae-47da-925d-55c1c09fe26c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:36.382394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8087d0c6-02ae-47da-925d-55c1c09fe26c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:36.383077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8087d0c6-02ae-47da-925d-55c1c09fe26c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:36.383524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8087d0c6-02ae-47da-925d-55c1c09fe26c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:36.383975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8087d0c6-02ae-47da-925d-55c1c09fe26c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:36.412450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8087d0c6-02ae-47da-925d-55c1c09fe26c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044020 Aug 06 12:36:36.412992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 311/635] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:36.969367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d03e0bc-e2a8-4f78-a3f8-3562a8d37138 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:36.969969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9d03e0bc-e2a8-4f78-a3f8-3562a8d37138 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:36.975891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d03e0bc-e2a8-4f78-a3f8-3562a8d37138 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:36.976401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d03e0bc-e2a8-4f78-a3f8-3562a8d37138 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:36.976840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d03e0bc-e2a8-4f78-a3f8-3562a8d37138 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:36.977525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d03e0bc-e2a8-4f78-a3f8-3562a8d37138 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:36.977984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d03e0bc-e2a8-4f78-a3f8-3562a8d37138 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:36.978406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d03e0bc-e2a8-4f78-a3f8-3562a8d37138 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:36.980213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2abe20a0-cbd0-46d8-b6c4-7c9898fc4096 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:36.980744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2abe20a0-cbd0-46d8-b6c4-7c9898fc4096 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:36.986862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2abe20a0-cbd0-46d8-b6c4-7c9898fc4096 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:36.987332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2abe20a0-cbd0-46d8-b6c4-7c9898fc4096 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:36.987764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2abe20a0-cbd0-46d8-b6c4-7c9898fc4096 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:36.988482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2abe20a0-cbd0-46d8-b6c4-7c9898fc4096 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:36.988932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2abe20a0-cbd0-46d8-b6c4-7c9898fc4096 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:36.989387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2abe20a0-cbd0-46d8-b6c4-7c9898fc4096 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:37.075050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-2abe20a0-cbd0-46d8-b6c4-7c9898fc4096 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lazy-loading 'services' on Instance uuid efe4447d-8246-4c34-8a89-98d7c5ac616c {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:36:37.132882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9d03e0bc-e2a8-4f78-a3f8-3562a8d37138 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:37.141476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d03e0bc-e2a8-4f78-a3f8-3562a8d37138 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.175935 Aug 06 12:36:37.142307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 325/636] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:37.148471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2abe20a0-cbd0-46d8-b6c4-7c9898fc4096 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments/9354b81c-bc27-4c09-8979-9050436ea9ff" status: 202 len: 0 microversion: 2.1 time: 0.172114 Aug 06 12:36:37.149079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 312/637] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:36:36 2022] DELETE /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments/9354b81c-bc27-4c09-8979-9050436ea9ff => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 12:36:37.377684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f5e1e441-b64f-4736-bae5-d283cc2d496c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:37.379765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f5e1e441-b64f-4736-bae5-d283cc2d496c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:37.386091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5e1e441-b64f-4736-bae5-d283cc2d496c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:37.386588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5e1e441-b64f-4736-bae5-d283cc2d496c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:37.387016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5e1e441-b64f-4736-bae5-d283cc2d496c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:37.387693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5e1e441-b64f-4736-bae5-d283cc2d496c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:37.388137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5e1e441-b64f-4736-bae5-d283cc2d496c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:37.388578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5e1e441-b64f-4736-bae5-d283cc2d496c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:37.418789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f5e1e441-b64f-4736-bae5-d283cc2d496c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Aug 06 12:36:37.419468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 326/638] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:37.426706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8839b7f1-e15c-41be-9958-0703a934a29d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:37.429107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8839b7f1-e15c-41be-9958-0703a934a29d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:37.435280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8839b7f1-e15c-41be-9958-0703a934a29d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:37.435757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8839b7f1-e15c-41be-9958-0703a934a29d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:37.436189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8839b7f1-e15c-41be-9958-0703a934a29d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:37.436895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8839b7f1-e15c-41be-9958-0703a934a29d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:37.437342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8839b7f1-e15c-41be-9958-0703a934a29d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:37.437761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8839b7f1-e15c-41be-9958-0703a934a29d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:37.467046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8839b7f1-e15c-41be-9958-0703a934a29d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045256 Aug 06 12:36:37.467586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 313/639] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:38.162806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-56bd51d3-8629-4fb2-983b-771f96482351 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:38.163400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-56bd51d3-8629-4fb2-983b-771f96482351 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:38.169293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56bd51d3-8629-4fb2-983b-771f96482351 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:38.169761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56bd51d3-8629-4fb2-983b-771f96482351 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:38.170184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56bd51d3-8629-4fb2-983b-771f96482351 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:38.170852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56bd51d3-8629-4fb2-983b-771f96482351 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:38.171295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56bd51d3-8629-4fb2-983b-771f96482351 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:38.171708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56bd51d3-8629-4fb2-983b-771f96482351 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:38.302169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-56bd51d3-8629-4fb2-983b-771f96482351 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:38.310077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-56bd51d3-8629-4fb2-983b-771f96482351 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151053 Aug 06 12:36:38.310633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 327/640] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:38.431604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa3b1ce4-eb0d-4a90-8581-0bc381c5f813 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:38.433748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa3b1ce4-eb0d-4a90-8581-0bc381c5f813 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:38.439999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ce4-eb0d-4a90-8581-0bc381c5f813 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:38.440508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ce4-eb0d-4a90-8581-0bc381c5f813 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:38.440943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ce4-eb0d-4a90-8581-0bc381c5f813 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:38.441611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ce4-eb0d-4a90-8581-0bc381c5f813 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:38.442053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ce4-eb0d-4a90-8581-0bc381c5f813 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:38.442469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ce4-eb0d-4a90-8581-0bc381c5f813 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:38.469812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa3b1ce4-eb0d-4a90-8581-0bc381c5f813 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042112 Aug 06 12:36:38.470358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 314/641] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:38.479500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1e3225aa-b841-48e0-8e48-202aa07005d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:38.481610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1e3225aa-b841-48e0-8e48-202aa07005d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:38.488079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e3225aa-b841-48e0-8e48-202aa07005d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:38.488590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e3225aa-b841-48e0-8e48-202aa07005d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:38.489019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e3225aa-b841-48e0-8e48-202aa07005d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:38.490315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e3225aa-b841-48e0-8e48-202aa07005d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:38.490760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e3225aa-b841-48e0-8e48-202aa07005d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:38.491177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e3225aa-b841-48e0-8e48-202aa07005d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:38.519121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1e3225aa-b841-48e0-8e48-202aa07005d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043484 Aug 06 12:36:38.519609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 328/642] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:39.330683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c1b3123b-b738-4c81-8d4a-a6ad08355854 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:39.331281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c1b3123b-b738-4c81-8d4a-a6ad08355854 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:39.342427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1b3123b-b738-4c81-8d4a-a6ad08355854 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:39.342953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1b3123b-b738-4c81-8d4a-a6ad08355854 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:39.343794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1b3123b-b738-4c81-8d4a-a6ad08355854 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:39.344583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1b3123b-b738-4c81-8d4a-a6ad08355854 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:39.345045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1b3123b-b738-4c81-8d4a-a6ad08355854 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:39.345471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1b3123b-b738-4c81-8d4a-a6ad08355854 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:39.480126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c1b3123b-b738-4c81-8d4a-a6ad08355854 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:39.482375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3a172005-7ed4-48a7-9e12-334d9f7e93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:39.484544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3a172005-7ed4-48a7-9e12-334d9f7e93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:39.488391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c1b3123b-b738-4c81-8d4a-a6ad08355854 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.161392 Aug 06 12:36:39.489481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 315/643] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:39.491731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a172005-7ed4-48a7-9e12-334d9f7e93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:39.492212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a172005-7ed4-48a7-9e12-334d9f7e93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:39.492680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a172005-7ed4-48a7-9e12-334d9f7e93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:39.493368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a172005-7ed4-48a7-9e12-334d9f7e93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:39.493820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a172005-7ed4-48a7-9e12-334d9f7e93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:39.494240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a172005-7ed4-48a7-9e12-334d9f7e93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:39.522888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3a172005-7ed4-48a7-9e12-334d9f7e93fd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044350 Aug 06 12:36:39.523364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 329/644] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:39 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:39.530836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f3453055-1b5f-492a-bd2f-d2fdd1aaf74c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:39.533007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f3453055-1b5f-492a-bd2f-d2fdd1aaf74c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:39.538744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3453055-1b5f-492a-bd2f-d2fdd1aaf74c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:39.539219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3453055-1b5f-492a-bd2f-d2fdd1aaf74c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:39.539650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3453055-1b5f-492a-bd2f-d2fdd1aaf74c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:39.540349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3453055-1b5f-492a-bd2f-d2fdd1aaf74c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:39.540803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3453055-1b5f-492a-bd2f-d2fdd1aaf74c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:39.541219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3453055-1b5f-492a-bd2f-d2fdd1aaf74c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:39.570386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f3453055-1b5f-492a-bd2f-d2fdd1aaf74c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043362 Aug 06 12:36:39.570933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 316/645] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:40.509794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-12a16ac4-b820-469f-a204-d583e3011880 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:40.510390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-12a16ac4-b820-469f-a204-d583e3011880 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:40.516653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a16ac4-b820-469f-a204-d583e3011880 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:40.517123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a16ac4-b820-469f-a204-d583e3011880 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:40.517547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a16ac4-b820-469f-a204-d583e3011880 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:40.518220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a16ac4-b820-469f-a204-d583e3011880 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:40.518664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a16ac4-b820-469f-a204-d583e3011880 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:40.519080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a16ac4-b820-469f-a204-d583e3011880 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:40.535074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-abcccce4-9595-4f6a-8bb4-7b19aeeb1454 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:40.537444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-abcccce4-9595-4f6a-8bb4-7b19aeeb1454 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:40.543705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abcccce4-9595-4f6a-8bb4-7b19aeeb1454 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:40.544184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abcccce4-9595-4f6a-8bb4-7b19aeeb1454 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:40.544649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abcccce4-9595-4f6a-8bb4-7b19aeeb1454 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:40.545336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abcccce4-9595-4f6a-8bb4-7b19aeeb1454 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:40.545788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abcccce4-9595-4f6a-8bb4-7b19aeeb1454 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:40.546207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abcccce4-9595-4f6a-8bb4-7b19aeeb1454 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:40.572160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:40.577486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-abcccce4-9595-4f6a-8bb4-7b19aeeb1454 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045983 Aug 06 12:36:40.577804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 317/646] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:40 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:40.582442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fb6bb225-628b-4e13-bdb9-d6691928073f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:40.584575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fb6bb225-628b-4e13-bdb9-d6691928073f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:40.591917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb6bb225-628b-4e13-bdb9-d6691928073f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:40.592415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb6bb225-628b-4e13-bdb9-d6691928073f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:40.592843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb6bb225-628b-4e13-bdb9-d6691928073f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:40.593526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb6bb225-628b-4e13-bdb9-d6691928073f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:40.593969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb6bb225-628b-4e13-bdb9-d6691928073f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:40.594382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb6bb225-628b-4e13-bdb9-d6691928073f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:40.624465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fb6bb225-628b-4e13-bdb9-d6691928073f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045609 Aug 06 12:36:40.625024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 318/647] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:40.648421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-12a16ac4-b820-469f-a204-d583e3011880 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:40.656293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-12a16ac4-b820-469f-a204-d583e3011880 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150288 Aug 06 12:36:40.656869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 330/648] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:41.589909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa099a80-1be7-4d72-9748-962739181abe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:41.592026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa099a80-1be7-4d72-9748-962739181abe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:41.598471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa099a80-1be7-4d72-9748-962739181abe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:41.598949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa099a80-1be7-4d72-9748-962739181abe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:41.599381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa099a80-1be7-4d72-9748-962739181abe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:41.600153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa099a80-1be7-4d72-9748-962739181abe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:41.600626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa099a80-1be7-4d72-9748-962739181abe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:41.601046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa099a80-1be7-4d72-9748-962739181abe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:41.628971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa099a80-1be7-4d72-9748-962739181abe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Aug 06 12:36:41.629966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 319/649] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:41 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:41.636710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4b49f1dc-1cb6-44a1-b985-215c7d55d87d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:41.638844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4b49f1dc-1cb6-44a1-b985-215c7d55d87d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:41.645023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b49f1dc-1cb6-44a1-b985-215c7d55d87d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:41.646167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b49f1dc-1cb6-44a1-b985-215c7d55d87d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:41.646597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b49f1dc-1cb6-44a1-b985-215c7d55d87d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:41.647266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b49f1dc-1cb6-44a1-b985-215c7d55d87d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:41.647708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b49f1dc-1cb6-44a1-b985-215c7d55d87d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:41.648124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b49f1dc-1cb6-44a1-b985-215c7d55d87d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:41.675252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4b49f1dc-1cb6-44a1-b985-215c7d55d87d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042514 Aug 06 12:36:41.675785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 331/650] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:41.677575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-20c90a32-50c8-4177-bd8b-1693a1669825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:41.678178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-20c90a32-50c8-4177-bd8b-1693a1669825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:41.684028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c90a32-50c8-4177-bd8b-1693a1669825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:41.684554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c90a32-50c8-4177-bd8b-1693a1669825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:41.684976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c90a32-50c8-4177-bd8b-1693a1669825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:41.685649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c90a32-50c8-4177-bd8b-1693a1669825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:41.686099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c90a32-50c8-4177-bd8b-1693a1669825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:41.686521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c90a32-50c8-4177-bd8b-1693a1669825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:41.815741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20c90a32-50c8-4177-bd8b-1693a1669825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:41.824431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-20c90a32-50c8-4177-bd8b-1693a1669825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150749 Aug 06 12:36:41.824997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 320/651] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:41 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:41.881448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c016a805-efc3-4493-bedd-c2e02f2d0e9f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:41.881862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c016a805-efc3-4493-bedd-c2e02f2d0e9f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:41.887534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c016a805-efc3-4493-bedd-c2e02f2d0e9f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:41.888003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c016a805-efc3-4493-bedd-c2e02f2d0e9f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:41.888469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c016a805-efc3-4493-bedd-c2e02f2d0e9f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:41.889143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c016a805-efc3-4493-bedd-c2e02f2d0e9f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:41.889587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c016a805-efc3-4493-bedd-c2e02f2d0e9f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:41.890000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c016a805-efc3-4493-bedd-c2e02f2d0e9f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:41.913415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c016a805-efc3-4493-bedd-c2e02f2d0e9f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 12:36:41.964174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:41.997378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c016a805-efc3-4493-bedd-c2e02f2d0e9f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 204 len: 0 microversion: 2.1 time: 0.120080 Aug 06 12:36:41.998067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 332/652] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:36:41 2022] DELETE /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 12:36:42.006997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bf3afb3b-e8ff-4ca2-b1da-0da42b98043f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:42.007600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bf3afb3b-e8ff-4ca2-b1da-0da42b98043f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:42.013605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf3afb3b-e8ff-4ca2-b1da-0da42b98043f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:42.014084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf3afb3b-e8ff-4ca2-b1da-0da42b98043f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:42.014512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf3afb3b-e8ff-4ca2-b1da-0da42b98043f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:42.015201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf3afb3b-e8ff-4ca2-b1da-0da42b98043f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:42.015646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf3afb3b-e8ff-4ca2-b1da-0da42b98043f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:42.016062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf3afb3b-e8ff-4ca2-b1da-0da42b98043f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:42.146856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bf3afb3b-e8ff-4ca2-b1da-0da42b98043f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:42.154955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bf3afb3b-e8ff-4ca2-b1da-0da42b98043f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1578 microversion: 2.1 time: 0.152427 Aug 06 12:36:42.155586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 321/653] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:42 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:42.641929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2342d01d-a188-4fc6-8dda-44ce4471e0b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:42.644164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2342d01d-a188-4fc6-8dda-44ce4471e0b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:42.650581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2342d01d-a188-4fc6-8dda-44ce4471e0b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:42.651060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2342d01d-a188-4fc6-8dda-44ce4471e0b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:42.651490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2342d01d-a188-4fc6-8dda-44ce4471e0b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:42.652169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2342d01d-a188-4fc6-8dda-44ce4471e0b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:42.652642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2342d01d-a188-4fc6-8dda-44ce4471e0b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:42.653062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2342d01d-a188-4fc6-8dda-44ce4471e0b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:42.683134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2342d01d-a188-4fc6-8dda-44ce4471e0b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045467 Aug 06 12:36:42.683745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 333/654] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:42 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:42.687092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-640456a8-2929-4bc4-90df-0a479e0004d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:42.689323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-640456a8-2929-4bc4-90df-0a479e0004d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:42.696482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-640456a8-2929-4bc4-90df-0a479e0004d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:42.696957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-640456a8-2929-4bc4-90df-0a479e0004d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:42.697393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-640456a8-2929-4bc4-90df-0a479e0004d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:42.698289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-640456a8-2929-4bc4-90df-0a479e0004d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:42.698738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-640456a8-2929-4bc4-90df-0a479e0004d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:42.699153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-640456a8-2929-4bc4-90df-0a479e0004d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:42.731491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-640456a8-2929-4bc4-90df-0a479e0004d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048301 Aug 06 12:36:42.732041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 322/655] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:42.845037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-75c124df-9f37-4dbe-a1fd-c5c49968484f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:42.845721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-75c124df-9f37-4dbe-a1fd-c5c49968484f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:42.852330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75c124df-9f37-4dbe-a1fd-c5c49968484f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:42.852845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75c124df-9f37-4dbe-a1fd-c5c49968484f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:42.853298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75c124df-9f37-4dbe-a1fd-c5c49968484f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:42.853998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75c124df-9f37-4dbe-a1fd-c5c49968484f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:42.854453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75c124df-9f37-4dbe-a1fd-c5c49968484f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:42.854874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75c124df-9f37-4dbe-a1fd-c5c49968484f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:42.982924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75c124df-9f37-4dbe-a1fd-c5c49968484f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:42.991161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-75c124df-9f37-4dbe-a1fd-c5c49968484f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149971 Aug 06 12:36:42.991721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 334/656] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:42 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:43.175649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4a2ecee2-f6bf-4f32-abd9-5a39234c1b30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:43.176288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4a2ecee2-f6bf-4f32-abd9-5a39234c1b30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:43.182827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a2ecee2-f6bf-4f32-abd9-5a39234c1b30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:43.183288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a2ecee2-f6bf-4f32-abd9-5a39234c1b30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:43.183714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a2ecee2-f6bf-4f32-abd9-5a39234c1b30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:43.184420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a2ecee2-f6bf-4f32-abd9-5a39234c1b30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:43.184868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a2ecee2-f6bf-4f32-abd9-5a39234c1b30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:43.185418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a2ecee2-f6bf-4f32-abd9-5a39234c1b30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:43.313271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4a2ecee2-f6bf-4f32-abd9-5a39234c1b30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:43.320773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4a2ecee2-f6bf-4f32-abd9-5a39234c1b30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1578 microversion: 2.1 time: 0.148855 Aug 06 12:36:43.321329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 323/657] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:43 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:43.695190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0de50ced-01e6-42af-b1f4-4817e5743386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:43.697337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0de50ced-01e6-42af-b1f4-4817e5743386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:43.703558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de50ced-01e6-42af-b1f4-4817e5743386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:43.704036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de50ced-01e6-42af-b1f4-4817e5743386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:43.704510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de50ced-01e6-42af-b1f4-4817e5743386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:43.705189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de50ced-01e6-42af-b1f4-4817e5743386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:43.705638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de50ced-01e6-42af-b1f4-4817e5743386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:43.706052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de50ced-01e6-42af-b1f4-4817e5743386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:43.734723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0de50ced-01e6-42af-b1f4-4817e5743386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Aug 06 12:36:43.735259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 335/658] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:43.743863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0b3d8392-0497-4f16-8b93-28bf87376c1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:43.745947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0b3d8392-0497-4f16-8b93-28bf87376c1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:43.752289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d8392-0497-4f16-8b93-28bf87376c1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:43.752808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d8392-0497-4f16-8b93-28bf87376c1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:43.753240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d8392-0497-4f16-8b93-28bf87376c1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:43.753919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d8392-0497-4f16-8b93-28bf87376c1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:43.754391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d8392-0497-4f16-8b93-28bf87376c1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:43.754812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d8392-0497-4f16-8b93-28bf87376c1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:43.782556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0b3d8392-0497-4f16-8b93-28bf87376c1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043451 Aug 06 12:36:43.783097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 324/659] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:44.018611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f5617b05-2bbe-424a-957f-b7d063e52287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:44.019213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f5617b05-2bbe-424a-957f-b7d063e52287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:44.025794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5617b05-2bbe-424a-957f-b7d063e52287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:44.026296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5617b05-2bbe-424a-957f-b7d063e52287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:44.026727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5617b05-2bbe-424a-957f-b7d063e52287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:44.027403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5617b05-2bbe-424a-957f-b7d063e52287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:44.027846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5617b05-2bbe-424a-957f-b7d063e52287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:44.028321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5617b05-2bbe-424a-957f-b7d063e52287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:44.153473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f5617b05-2bbe-424a-957f-b7d063e52287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:44.162158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f5617b05-2bbe-424a-957f-b7d063e52287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147370 Aug 06 12:36:44.162711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 336/660] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:44.341663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5df662f4-7737-4d00-be88-f2bb53f8bf7f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:44.342260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5df662f4-7737-4d00-be88-f2bb53f8bf7f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:44.348051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5df662f4-7737-4d00-be88-f2bb53f8bf7f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:44.349135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5df662f4-7737-4d00-be88-f2bb53f8bf7f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:44.349563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5df662f4-7737-4d00-be88-f2bb53f8bf7f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:44.350248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5df662f4-7737-4d00-be88-f2bb53f8bf7f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:44.350693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5df662f4-7737-4d00-be88-f2bb53f8bf7f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:44.351107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5df662f4-7737-4d00-be88-f2bb53f8bf7f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:44.599452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5df662f4-7737-4d00-be88-f2bb53f8bf7f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:44.607979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5df662f4-7737-4d00-be88-f2bb53f8bf7f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1578 microversion: 2.1 time: 0.270212 Aug 06 12:36:44.608570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 325/661] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:44 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1578 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:44.764468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-92a010e0-e963-49ca-9eb4-817bc0684122 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:44.771240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-92a010e0-e963-49ca-9eb4-817bc0684122 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:44.779381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a010e0-e963-49ca-9eb4-817bc0684122 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:44.779859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a010e0-e963-49ca-9eb4-817bc0684122 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:44.781061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a010e0-e963-49ca-9eb4-817bc0684122 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:44.781208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a010e0-e963-49ca-9eb4-817bc0684122 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:44.781806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a010e0-e963-49ca-9eb4-817bc0684122 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:44.782384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a010e0-e963-49ca-9eb4-817bc0684122 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:44.795161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-10e8e319-45b1-468b-b2b6-f36df086b73a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:44.798016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-10e8e319-45b1-468b-b2b6-f36df086b73a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:44.805005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10e8e319-45b1-468b-b2b6-f36df086b73a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:44.805563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10e8e319-45b1-468b-b2b6-f36df086b73a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:44.806057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10e8e319-45b1-468b-b2b6-f36df086b73a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:44.806818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10e8e319-45b1-468b-b2b6-f36df086b73a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:44.807336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10e8e319-45b1-468b-b2b6-f36df086b73a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:44.807914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10e8e319-45b1-468b-b2b6-f36df086b73a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:44.814445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-92a010e0-e963-49ca-9eb4-817bc0684122 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070984 Aug 06 12:36:44.815020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 337/662] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:44.842080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-10e8e319-45b1-468b-b2b6-f36df086b73a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050892 Aug 06 12:36:44.842633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 326/663] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:45.039284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-f581191f-eb5d-47fb-ad0a-a489ab44995f req-0e27c364-8aa9-43e3-be96-c29cf72b90ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cc50006-2952-4463-9098-a8a944a259e3", "name": "network-vif-deleted", "tag": "586919cc-a13c-423a-bbd6-47811a8e0a67"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:36:45.048615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-f581191f-eb5d-47fb-ad0a-a489ab44995f req-0e27c364-8aa9-43e3-be96-c29cf72b90ed service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:45.049099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-f581191f-eb5d-47fb-ad0a-a489ab44995f req-0e27c364-8aa9-43e3-be96-c29cf72b90ed service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:45.049615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-f581191f-eb5d-47fb-ad0a-a489ab44995f req-0e27c364-8aa9-43e3-be96-c29cf72b90ed service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:45.062729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-f581191f-eb5d-47fb-ad0a-a489ab44995f req-0e27c364-8aa9-43e3-be96-c29cf72b90ed service nova] Creating event network-vif-deleted:586919cc-a13c-423a-bbd6-47811a8e0a67 for instance 5cc50006-2952-4463-9098-a8a944a259e3 on hv-cinder-85199 Aug 06 12:36:45.069543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-f581191f-eb5d-47fb-ad0a-a489ab44995f req-0e27c364-8aa9-43e3-be96-c29cf72b90ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034239 Aug 06 12:36:45.070144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 338/664] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:45.183569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90ef707b-7fbb-47ee-af74-003df65729b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:45.184521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90ef707b-7fbb-47ee-af74-003df65729b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:45.191056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90ef707b-7fbb-47ee-af74-003df65729b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:45.191547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90ef707b-7fbb-47ee-af74-003df65729b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:45.192075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90ef707b-7fbb-47ee-af74-003df65729b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:45.192844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90ef707b-7fbb-47ee-af74-003df65729b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:45.193545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90ef707b-7fbb-47ee-af74-003df65729b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:45.194004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90ef707b-7fbb-47ee-af74-003df65729b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:45.339721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90ef707b-7fbb-47ee-af74-003df65729b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:45.347779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90ef707b-7fbb-47ee-af74-003df65729b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.168051 Aug 06 12:36:45.348415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 327/665] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:45.630649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b070ea29-8627-4341-9f39-11075187ee5f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:45.631260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b070ea29-8627-4341-9f39-11075187ee5f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:45.637332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b070ea29-8627-4341-9f39-11075187ee5f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:45.637810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b070ea29-8627-4341-9f39-11075187ee5f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:45.638241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b070ea29-8627-4341-9f39-11075187ee5f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:45.638929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b070ea29-8627-4341-9f39-11075187ee5f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:45.639380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b070ea29-8627-4341-9f39-11075187ee5f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:45.639799 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b070ea29-8627-4341-9f39-11075187ee5f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:45.705948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b070ea29-8627-4341-9f39-11075187ee5f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:45.714077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b070ea29-8627-4341-9f39-11075187ee5f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.088663 Aug 06 12:36:45.714724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 339/666] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:45 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:45.827194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aba851b4-87fc-4a63-843f-4ea9f10ef6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:45.829518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aba851b4-87fc-4a63-843f-4ea9f10ef6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:45.836212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aba851b4-87fc-4a63-843f-4ea9f10ef6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:45.836728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aba851b4-87fc-4a63-843f-4ea9f10ef6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:45.837160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aba851b4-87fc-4a63-843f-4ea9f10ef6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:45.837854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aba851b4-87fc-4a63-843f-4ea9f10ef6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:45.838435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aba851b4-87fc-4a63-843f-4ea9f10ef6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:45.838857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aba851b4-87fc-4a63-843f-4ea9f10ef6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:45.854939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-483349f4-a0e8-4076-9c0e-c30f64acdd8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:45.857781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-483349f4-a0e8-4076-9c0e-c30f64acdd8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:45.864891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483349f4-a0e8-4076-9c0e-c30f64acdd8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:45.865257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483349f4-a0e8-4076-9c0e-c30f64acdd8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:45.865684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483349f4-a0e8-4076-9c0e-c30f64acdd8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:45.866375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483349f4-a0e8-4076-9c0e-c30f64acdd8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:45.866813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483349f4-a0e8-4076-9c0e-c30f64acdd8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:45.867411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483349f4-a0e8-4076-9c0e-c30f64acdd8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:45.870275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aba851b4-87fc-4a63-843f-4ea9f10ef6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046996 Aug 06 12:36:45.870849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 328/667] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:45.896592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-483349f4-a0e8-4076-9c0e-c30f64acdd8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045408 Aug 06 12:36:45.897054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 340/668] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:46.370859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d5ad755d-2154-4125-b0d7-86dd011602e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:46.371456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d5ad755d-2154-4125-b0d7-86dd011602e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:46.377279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5ad755d-2154-4125-b0d7-86dd011602e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:46.377749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5ad755d-2154-4125-b0d7-86dd011602e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:46.378175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5ad755d-2154-4125-b0d7-86dd011602e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:46.378844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5ad755d-2154-4125-b0d7-86dd011602e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:46.379519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5ad755d-2154-4125-b0d7-86dd011602e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:46.379942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5ad755d-2154-4125-b0d7-86dd011602e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:46.503248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d5ad755d-2154-4125-b0d7-86dd011602e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:46.511043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d5ad755d-2154-4125-b0d7-86dd011602e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.143993 Aug 06 12:36:46.511603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 329/669] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:46.734116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-03906de6-f6e7-4c8f-8baa-b607e7bdc18c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:46.734713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-03906de6-f6e7-4c8f-8baa-b607e7bdc18c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:46.741261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03906de6-f6e7-4c8f-8baa-b607e7bdc18c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:46.741754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03906de6-f6e7-4c8f-8baa-b607e7bdc18c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:46.742473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03906de6-f6e7-4c8f-8baa-b607e7bdc18c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:46.743178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03906de6-f6e7-4c8f-8baa-b607e7bdc18c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:46.743814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03906de6-f6e7-4c8f-8baa-b607e7bdc18c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:46.744350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03906de6-f6e7-4c8f-8baa-b607e7bdc18c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:46.804146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-03906de6-f6e7-4c8f-8baa-b607e7bdc18c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:46.811448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-03906de6-f6e7-4c8f-8baa-b607e7bdc18c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081119 Aug 06 12:36:46.811998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 341/670] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:46 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:46.882781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4ff4f283-0a80-4b93-a69c-9b62d6ccd582 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:46.884945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4ff4f283-0a80-4b93-a69c-9b62d6ccd582 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:46.891205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ff4f283-0a80-4b93-a69c-9b62d6ccd582 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:46.891678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ff4f283-0a80-4b93-a69c-9b62d6ccd582 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:46.892109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ff4f283-0a80-4b93-a69c-9b62d6ccd582 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:46.892808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ff4f283-0a80-4b93-a69c-9b62d6ccd582 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:46.893254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ff4f283-0a80-4b93-a69c-9b62d6ccd582 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:46.893670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ff4f283-0a80-4b93-a69c-9b62d6ccd582 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:46.908527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c01cf97b-49c0-4f1b-b3ad-d7bc81596a79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:46.910545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c01cf97b-49c0-4f1b-b3ad-d7bc81596a79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:46.916322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c01cf97b-49c0-4f1b-b3ad-d7bc81596a79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:46.916803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c01cf97b-49c0-4f1b-b3ad-d7bc81596a79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:46.917231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c01cf97b-49c0-4f1b-b3ad-d7bc81596a79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:46.917924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c01cf97b-49c0-4f1b-b3ad-d7bc81596a79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:46.918371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c01cf97b-49c0-4f1b-b3ad-d7bc81596a79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:46.918790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c01cf97b-49c0-4f1b-b3ad-d7bc81596a79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:46.922579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4ff4f283-0a80-4b93-a69c-9b62d6ccd582 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Aug 06 12:36:46.923162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 330/671] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:46.947862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c01cf97b-49c0-4f1b-b3ad-d7bc81596a79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043350 Aug 06 12:36:46.948422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 342/672] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:47.532215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7c7a6fc9-a384-4691-9344-41442d5185b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:47.532848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7c7a6fc9-a384-4691-9344-41442d5185b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:47.538709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c7a6fc9-a384-4691-9344-41442d5185b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:47.539191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c7a6fc9-a384-4691-9344-41442d5185b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:47.539619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c7a6fc9-a384-4691-9344-41442d5185b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:47.540319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c7a6fc9-a384-4691-9344-41442d5185b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:47.540769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c7a6fc9-a384-4691-9344-41442d5185b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:47.541191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c7a6fc9-a384-4691-9344-41442d5185b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:47.668819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7c7a6fc9-a384-4691-9344-41442d5185b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:47.676641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7c7a6fc9-a384-4691-9344-41442d5185b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148257 Aug 06 12:36:47.677194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 331/673] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:47.831798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-632d44ff-6d16-4980-a140-465ce174f860 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:47.832454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-632d44ff-6d16-4980-a140-465ce174f860 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:47.838853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-632d44ff-6d16-4980-a140-465ce174f860 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:47.839323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-632d44ff-6d16-4980-a140-465ce174f860 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:47.839747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-632d44ff-6d16-4980-a140-465ce174f860 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:47.840456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-632d44ff-6d16-4980-a140-465ce174f860 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:47.840900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-632d44ff-6d16-4980-a140-465ce174f860 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:47.841313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-632d44ff-6d16-4980-a140-465ce174f860 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:47.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-632d44ff-6d16-4980-a140-465ce174f860 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:47.909008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-632d44ff-6d16-4980-a140-465ce174f860 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080961 Aug 06 12:36:47.909725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 343/674] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:47 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:47.934757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6e9bcf39-b71a-4502-8526-16d3ee04d929 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:47.937178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6e9bcf39-b71a-4502-8526-16d3ee04d929 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:47.944262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e9bcf39-b71a-4502-8526-16d3ee04d929 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:47.944877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e9bcf39-b71a-4502-8526-16d3ee04d929 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:47.945374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e9bcf39-b71a-4502-8526-16d3ee04d929 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:47.946148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e9bcf39-b71a-4502-8526-16d3ee04d929 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:47.946729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e9bcf39-b71a-4502-8526-16d3ee04d929 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:47.948181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e9bcf39-b71a-4502-8526-16d3ee04d929 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:47.960882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b318d821-fefb-4d47-a00f-dc93fcb51ff9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:47.963612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b318d821-fefb-4d47-a00f-dc93fcb51ff9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:47.971576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b318d821-fefb-4d47-a00f-dc93fcb51ff9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:47.972455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b318d821-fefb-4d47-a00f-dc93fcb51ff9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:47.973085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b318d821-fefb-4d47-a00f-dc93fcb51ff9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:47.973983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b318d821-fefb-4d47-a00f-dc93fcb51ff9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:47.974605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b318d821-fefb-4d47-a00f-dc93fcb51ff9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:47.975204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b318d821-fefb-4d47-a00f-dc93fcb51ff9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:47.982285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6e9bcf39-b71a-4502-8526-16d3ee04d929 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051559 Aug 06 12:36:47.982853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 332/675] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:48.006283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b318d821-fefb-4d47-a00f-dc93fcb51ff9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050098 Aug 06 12:36:48.006839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 344/676] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:48.697911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-52deee30-5457-4a02-9282-048e574d82cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:48.698516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-52deee30-5457-4a02-9282-048e574d82cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:48.704555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52deee30-5457-4a02-9282-048e574d82cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:48.705057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52deee30-5457-4a02-9282-048e574d82cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:48.705493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52deee30-5457-4a02-9282-048e574d82cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:48.706179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52deee30-5457-4a02-9282-048e574d82cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:48.706632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52deee30-5457-4a02-9282-048e574d82cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:48.707061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52deee30-5457-4a02-9282-048e574d82cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:48.833863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-52deee30-5457-4a02-9282-048e574d82cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:48.841738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-52deee30-5457-4a02-9282-048e574d82cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147671 Aug 06 12:36:48.842300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 333/677] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:48.987004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-499de165-bf2c-4fe0-8919-e9ce1ff52349 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:48.987535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-499de165-bf2c-4fe0-8919-e9ce1ff52349 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:48.994101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-499de165-bf2c-4fe0-8919-e9ce1ff52349 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:48.994587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-499de165-bf2c-4fe0-8919-e9ce1ff52349 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:48.995021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-499de165-bf2c-4fe0-8919-e9ce1ff52349 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:48.995715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-499de165-bf2c-4fe0-8919-e9ce1ff52349 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:48.996105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-832e0873-27de-4cde-9272-2e01cf33eeff tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:48.996584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-499de165-bf2c-4fe0-8919-e9ce1ff52349 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:48.996584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-499de165-bf2c-4fe0-8919-e9ce1ff52349 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:48.998285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-832e0873-27de-4cde-9272-2e01cf33eeff tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:49.005167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-832e0873-27de-4cde-9272-2e01cf33eeff tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:49.005652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-832e0873-27de-4cde-9272-2e01cf33eeff tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:49.006082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-832e0873-27de-4cde-9272-2e01cf33eeff tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:49.006780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-832e0873-27de-4cde-9272-2e01cf33eeff tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:49.007230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-832e0873-27de-4cde-9272-2e01cf33eeff tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:49.007648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-832e0873-27de-4cde-9272-2e01cf33eeff tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:49.024974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:49.038930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-832e0873-27de-4cde-9272-2e01cf33eeff tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047759 Aug 06 12:36:49.039493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 334/678] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:49.044029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2c30069d-06d3-471b-90bc-c780f398c114 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:49.046152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2c30069d-06d3-471b-90bc-c780f398c114 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:49.051797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c30069d-06d3-471b-90bc-c780f398c114 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:49.052264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c30069d-06d3-471b-90bc-c780f398c114 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:49.052727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c30069d-06d3-471b-90bc-c780f398c114 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:49.053398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c30069d-06d3-471b-90bc-c780f398c114 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:49.053966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c30069d-06d3-471b-90bc-c780f398c114 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:49.054384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c30069d-06d3-471b-90bc-c780f398c114 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:49.058795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-499de165-bf2c-4fe0-8919-e9ce1ff52349 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:49.066457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-499de165-bf2c-4fe0-8919-e9ce1ff52349 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083561 Aug 06 12:36:49.067528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 345/679] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:48 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:49.083620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2c30069d-06d3-471b-90bc-c780f398c114 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043102 Aug 06 12:36:49.084174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 335/680] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:49.863192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cc18e8f3-c408-4bf0-8e5d-52e27e23e236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:49.863822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cc18e8f3-c408-4bf0-8e5d-52e27e23e236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:49.869676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc18e8f3-c408-4bf0-8e5d-52e27e23e236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:49.870151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc18e8f3-c408-4bf0-8e5d-52e27e23e236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:49.870582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc18e8f3-c408-4bf0-8e5d-52e27e23e236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:49.871260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc18e8f3-c408-4bf0-8e5d-52e27e23e236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:49.871708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc18e8f3-c408-4bf0-8e5d-52e27e23e236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:49.872126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc18e8f3-c408-4bf0-8e5d-52e27e23e236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:50.003619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cc18e8f3-c408-4bf0-8e5d-52e27e23e236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:50.012162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cc18e8f3-c408-4bf0-8e5d-52e27e23e236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153050 Aug 06 12:36:50.012757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 346/681] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:50.051682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3dc6f3dc-6343-4069-821b-967015a43182 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:50.053914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3dc6f3dc-6343-4069-821b-967015a43182 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:50.060261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dc6f3dc-6343-4069-821b-967015a43182 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:50.060772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dc6f3dc-6343-4069-821b-967015a43182 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:50.061211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dc6f3dc-6343-4069-821b-967015a43182 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:50.061894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dc6f3dc-6343-4069-821b-967015a43182 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:50.062342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dc6f3dc-6343-4069-821b-967015a43182 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:50.062763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dc6f3dc-6343-4069-821b-967015a43182 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:50.087125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-466e2a9f-e8db-453c-a724-a341401dff85 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:50.087730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-466e2a9f-e8db-453c-a724-a341401dff85 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:50.092892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3dc6f3dc-6343-4069-821b-967015a43182 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045605 Aug 06 12:36:50.093453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 336/682] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:50 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:50.093561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-466e2a9f-e8db-453c-a724-a341401dff85 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:50.094047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-466e2a9f-e8db-453c-a724-a341401dff85 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:50.094545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-466e2a9f-e8db-453c-a724-a341401dff85 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:50.095176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-466e2a9f-e8db-453c-a724-a341401dff85 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:50.095628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-466e2a9f-e8db-453c-a724-a341401dff85 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:50.096051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-466e2a9f-e8db-453c-a724-a341401dff85 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:50.097955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16925a54-bf0c-4f74-9ad2-d29f626a0808 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:50.100054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16925a54-bf0c-4f74-9ad2-d29f626a0808 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:50.101798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:50.107071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16925a54-bf0c-4f74-9ad2-d29f626a0808 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:50.107552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16925a54-bf0c-4f74-9ad2-d29f626a0808 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:50.108007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16925a54-bf0c-4f74-9ad2-d29f626a0808 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:50.108766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16925a54-bf0c-4f74-9ad2-d29f626a0808 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:50.109217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16925a54-bf0c-4f74-9ad2-d29f626a0808 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:50.109635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16925a54-bf0c-4f74-9ad2-d29f626a0808 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:50.139717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16925a54-bf0c-4f74-9ad2-d29f626a0808 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045135 Aug 06 12:36:50.140192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 337/683] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:50.157257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-466e2a9f-e8db-453c-a724-a341401dff85 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:50.164634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-466e2a9f-e8db-453c-a724-a341401dff85 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081242 Aug 06 12:36:50.165187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 347/684] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:50 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:51.033018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-83ab2fd3-4cda-4d60-8b0e-627fc32772fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:51.033619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-83ab2fd3-4cda-4d60-8b0e-627fc32772fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:51.040144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83ab2fd3-4cda-4d60-8b0e-627fc32772fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:51.040650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83ab2fd3-4cda-4d60-8b0e-627fc32772fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:51.041085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83ab2fd3-4cda-4d60-8b0e-627fc32772fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:51.041759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83ab2fd3-4cda-4d60-8b0e-627fc32772fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:51.042204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83ab2fd3-4cda-4d60-8b0e-627fc32772fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:51.042623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83ab2fd3-4cda-4d60-8b0e-627fc32772fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:51.105225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-99eae9f5-9e2f-49c7-a138-ecd8d03d7187 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:51.107360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-99eae9f5-9e2f-49c7-a138-ecd8d03d7187 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:51.109851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:51.116145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99eae9f5-9e2f-49c7-a138-ecd8d03d7187 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:51.116732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99eae9f5-9e2f-49c7-a138-ecd8d03d7187 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:51.117256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99eae9f5-9e2f-49c7-a138-ecd8d03d7187 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:51.118038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99eae9f5-9e2f-49c7-a138-ecd8d03d7187 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:51.118498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99eae9f5-9e2f-49c7-a138-ecd8d03d7187 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:51.118917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99eae9f5-9e2f-49c7-a138-ecd8d03d7187 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:51.150515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-99eae9f5-9e2f-49c7-a138-ecd8d03d7187 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049109 Aug 06 12:36:51.151110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 348/685] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:51.155678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d0ddfa03-083e-4df0-bf19-9e3b869faf85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:51.157761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d0ddfa03-083e-4df0-bf19-9e3b869faf85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:51.163255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ddfa03-083e-4df0-bf19-9e3b869faf85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:51.163727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ddfa03-083e-4df0-bf19-9e3b869faf85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:51.164151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ddfa03-083e-4df0-bf19-9e3b869faf85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:51.164853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ddfa03-083e-4df0-bf19-9e3b869faf85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:51.165297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ddfa03-083e-4df0-bf19-9e3b869faf85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:51.165708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ddfa03-083e-4df0-bf19-9e3b869faf85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:51.178824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-83ab2fd3-4cda-4d60-8b0e-627fc32772fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:51.186918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-83ab2fd3-4cda-4d60-8b0e-627fc32772fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.157757 Aug 06 12:36:51.187484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 338/686] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:51.192348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7ea628b4-745a-47e1-954c-32be4aaa657a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:51.192951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7ea628b4-745a-47e1-954c-32be4aaa657a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:51.194679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d0ddfa03-083e-4df0-bf19-9e3b869faf85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042564 Aug 06 12:36:51.195345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 349/687] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:51.202469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea628b4-745a-47e1-954c-32be4aaa657a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:51.202947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea628b4-745a-47e1-954c-32be4aaa657a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:51.203381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea628b4-745a-47e1-954c-32be4aaa657a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:51.204065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea628b4-745a-47e1-954c-32be4aaa657a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:51.204543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea628b4-745a-47e1-954c-32be4aaa657a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:51.204967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea628b4-745a-47e1-954c-32be4aaa657a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:51.264181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7ea628b4-745a-47e1-954c-32be4aaa657a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:51.272050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7ea628b4-745a-47e1-954c-32be4aaa657a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083638 Aug 06 12:36:51.272645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 339/688] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:51 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:52.163249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-28c46820-b285-4e73-baa6-33e4637c1e53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:52.165312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-28c46820-b285-4e73-baa6-33e4637c1e53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:52.171792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28c46820-b285-4e73-baa6-33e4637c1e53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:52.172272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28c46820-b285-4e73-baa6-33e4637c1e53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:52.172797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28c46820-b285-4e73-baa6-33e4637c1e53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:52.173474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28c46820-b285-4e73-baa6-33e4637c1e53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:52.173916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28c46820-b285-4e73-baa6-33e4637c1e53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:52.174328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28c46820-b285-4e73-baa6-33e4637c1e53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:52.178448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:52.203295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-28c46820-b285-4e73-baa6-33e4637c1e53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044527 Aug 06 12:36:52.203837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 350/689] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:52 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:36:52.206796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6c2770e9-aeae-4d17-acc6-6a4be9ba0aa7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:52.208607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f9a96a60-fe9c-404d-9354-580fca131a6c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:52.209221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f9a96a60-fe9c-404d-9354-580fca131a6c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:52.209724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6c2770e9-aeae-4d17-acc6-6a4be9ba0aa7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:52.214837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9a96a60-fe9c-404d-9354-580fca131a6c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:52.215308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9a96a60-fe9c-404d-9354-580fca131a6c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:52.215732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9a96a60-fe9c-404d-9354-580fca131a6c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:52.215857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c2770e9-aeae-4d17-acc6-6a4be9ba0aa7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:52.216277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c2770e9-aeae-4d17-acc6-6a4be9ba0aa7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:52.216433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9a96a60-fe9c-404d-9354-580fca131a6c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:52.216733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c2770e9-aeae-4d17-acc6-6a4be9ba0aa7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:52.216877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9a96a60-fe9c-404d-9354-580fca131a6c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:52.217289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9a96a60-fe9c-404d-9354-580fca131a6c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:52.217457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c2770e9-aeae-4d17-acc6-6a4be9ba0aa7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:52.217910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c2770e9-aeae-4d17-acc6-6a4be9ba0aa7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:52.218565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c2770e9-aeae-4d17-acc6-6a4be9ba0aa7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:52.247881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6c2770e9-aeae-4d17-acc6-6a4be9ba0aa7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044906 Aug 06 12:36:52.248695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 340/690] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:52.293311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d4c52dc-e43f-46e8-a9ca-fbece2686a30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:52.293912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3d4c52dc-e43f-46e8-a9ca-fbece2686a30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:52.299917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4c52dc-e43f-46e8-a9ca-fbece2686a30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:52.300447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4c52dc-e43f-46e8-a9ca-fbece2686a30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:52.300866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4c52dc-e43f-46e8-a9ca-fbece2686a30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:52.301549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4c52dc-e43f-46e8-a9ca-fbece2686a30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:52.301999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4c52dc-e43f-46e8-a9ca-fbece2686a30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:52.302419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4c52dc-e43f-46e8-a9ca-fbece2686a30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:52.346189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f9a96a60-fe9c-404d-9354-580fca131a6c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:52.354776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f9a96a60-fe9c-404d-9354-580fca131a6c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1716 microversion: 2.1 time: 0.149982 Aug 06 12:36:52.355336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 351/691] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:52.366145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3d4c52dc-e43f-46e8-a9ca-fbece2686a30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:52.373898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3d4c52dc-e43f-46e8-a9ca-fbece2686a30 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084412 Aug 06 12:36:52.374467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 341/692] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:52 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:52.416963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:52.417395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:52.424237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:52.424752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:52.425183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:52.426361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:52.426810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:52.427228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:53.216276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-252545dc-9efb-4a59-8219-65a1abe77862 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:53.218440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-252545dc-9efb-4a59-8219-65a1abe77862 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:53.225526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-252545dc-9efb-4a59-8219-65a1abe77862 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:53.226005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-252545dc-9efb-4a59-8219-65a1abe77862 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:53.226435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-252545dc-9efb-4a59-8219-65a1abe77862 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:53.227117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-252545dc-9efb-4a59-8219-65a1abe77862 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:53.227565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-252545dc-9efb-4a59-8219-65a1abe77862 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:53.227981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-252545dc-9efb-4a59-8219-65a1abe77862 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:53.256113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-252545dc-9efb-4a59-8219-65a1abe77862 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Aug 06 12:36:53.256622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 342/693] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:53 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:53.261078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0e4f19ad-abe7-46a8-9277-b71d8679fe29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:53.263110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0e4f19ad-abe7-46a8-9277-b71d8679fe29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:53.268499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e4f19ad-abe7-46a8-9277-b71d8679fe29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:53.268974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e4f19ad-abe7-46a8-9277-b71d8679fe29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:53.269406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e4f19ad-abe7-46a8-9277-b71d8679fe29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:53.270579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e4f19ad-abe7-46a8-9277-b71d8679fe29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:53.271027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e4f19ad-abe7-46a8-9277-b71d8679fe29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:53.271445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e4f19ad-abe7-46a8-9277-b71d8679fe29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:53.299440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0e4f19ad-abe7-46a8-9277-b71d8679fe29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041857 Aug 06 12:36:53.299984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 343/694] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:53.393619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b3b22b6c-c80e-4ce7-b65f-00bb2d8ea320 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:53.394214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b3b22b6c-c80e-4ce7-b65f-00bb2d8ea320 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:53.400450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3b22b6c-c80e-4ce7-b65f-00bb2d8ea320 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:53.400928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3b22b6c-c80e-4ce7-b65f-00bb2d8ea320 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:53.401357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3b22b6c-c80e-4ce7-b65f-00bb2d8ea320 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:53.402030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3b22b6c-c80e-4ce7-b65f-00bb2d8ea320 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:53.402477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3b22b6c-c80e-4ce7-b65f-00bb2d8ea320 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:53.402894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3b22b6c-c80e-4ce7-b65f-00bb2d8ea320 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:53.464866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b3b22b6c-c80e-4ce7-b65f-00bb2d8ea320 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:53.472169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b3b22b6c-c80e-4ce7-b65f-00bb2d8ea320 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082033 Aug 06 12:36:53.472752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 344/695] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:53 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:54.267892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f43f6a72-4889-4fa6-8e15-0f93ef9c58e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:54.270016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f43f6a72-4889-4fa6-8e15-0f93ef9c58e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:54.276443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43f6a72-4889-4fa6-8e15-0f93ef9c58e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:54.276946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43f6a72-4889-4fa6-8e15-0f93ef9c58e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:54.277391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43f6a72-4889-4fa6-8e15-0f93ef9c58e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:54.278065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43f6a72-4889-4fa6-8e15-0f93ef9c58e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:54.278515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43f6a72-4889-4fa6-8e15-0f93ef9c58e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:54.278934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43f6a72-4889-4fa6-8e15-0f93ef9c58e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:54.308211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f43f6a72-4889-4fa6-8e15-0f93ef9c58e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 Aug 06 12:36:54.308791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 345/696] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:54 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:54.313259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e29fed7-a278-4d5b-85ba-2513a92fab47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:54.315265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e29fed7-a278-4d5b-85ba-2513a92fab47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:54.320874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e29fed7-a278-4d5b-85ba-2513a92fab47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:54.321348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e29fed7-a278-4d5b-85ba-2513a92fab47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:54.321778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e29fed7-a278-4d5b-85ba-2513a92fab47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:54.322454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e29fed7-a278-4d5b-85ba-2513a92fab47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:54.322904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e29fed7-a278-4d5b-85ba-2513a92fab47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:54.323324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e29fed7-a278-4d5b-85ba-2513a92fab47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:54.351133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e29fed7-a278-4d5b-85ba-2513a92fab47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041400 Aug 06 12:36:54.351670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 346/697] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:54.492639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9cbf5f7a-e0f5-41e6-b254-dcfec85c433a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:54.493236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9cbf5f7a-e0f5-41e6-b254-dcfec85c433a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:54.499075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cbf5f7a-e0f5-41e6-b254-dcfec85c433a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:54.499544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cbf5f7a-e0f5-41e6-b254-dcfec85c433a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:54.499972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cbf5f7a-e0f5-41e6-b254-dcfec85c433a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:54.500668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cbf5f7a-e0f5-41e6-b254-dcfec85c433a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:54.501123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cbf5f7a-e0f5-41e6-b254-dcfec85c433a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:54.501540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cbf5f7a-e0f5-41e6-b254-dcfec85c433a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:54.561447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9cbf5f7a-e0f5-41e6-b254-dcfec85c433a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:54.568730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9cbf5f7a-e0f5-41e6-b254-dcfec85c433a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.079900 Aug 06 12:36:54.569288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 347/698] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:54 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:36:55.321546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a3f23785-c7ab-4cff-ab60-ff6f719519ae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:55.323683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a3f23785-c7ab-4cff-ab60-ff6f719519ae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:55.330045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3f23785-c7ab-4cff-ab60-ff6f719519ae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:55.330527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3f23785-c7ab-4cff-ab60-ff6f719519ae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:55.330956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3f23785-c7ab-4cff-ab60-ff6f719519ae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:55.331636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3f23785-c7ab-4cff-ab60-ff6f719519ae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:55.332237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3f23785-c7ab-4cff-ab60-ff6f719519ae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:55.332932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3f23785-c7ab-4cff-ab60-ff6f719519ae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:55.365727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a3f23785-c7ab-4cff-ab60-ff6f719519ae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048498 Aug 06 12:36:55.366758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 348/699] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:55 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:55.371999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-edf8fafe-4c60-4ad7-8d1c-8e9466b5f7aa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:55.374125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-edf8fafe-4c60-4ad7-8d1c-8e9466b5f7aa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:55.380653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edf8fafe-4c60-4ad7-8d1c-8e9466b5f7aa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:55.381132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edf8fafe-4c60-4ad7-8d1c-8e9466b5f7aa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:55.381565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edf8fafe-4c60-4ad7-8d1c-8e9466b5f7aa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:55.382246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edf8fafe-4c60-4ad7-8d1c-8e9466b5f7aa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:55.382700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edf8fafe-4c60-4ad7-8d1c-8e9466b5f7aa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:55.383136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edf8fafe-4c60-4ad7-8d1c-8e9466b5f7aa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:55.412404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-edf8fafe-4c60-4ad7-8d1c-8e9466b5f7aa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044143 Aug 06 12:36:55.412945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 349/700] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:55.588034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-31005825-8701-4faa-854d-3b444bd9a925 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:55.588579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-31005825-8701-4faa-854d-3b444bd9a925 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:55.594399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31005825-8701-4faa-854d-3b444bd9a925 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:55.594873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31005825-8701-4faa-854d-3b444bd9a925 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:55.595301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31005825-8701-4faa-854d-3b444bd9a925 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:55.595985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31005825-8701-4faa-854d-3b444bd9a925 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:55.596461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31005825-8701-4faa-854d-3b444bd9a925 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:55.596889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31005825-8701-4faa-854d-3b444bd9a925 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:55.656142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-31005825-8701-4faa-854d-3b444bd9a925 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:55.663941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-31005825-8701-4faa-854d-3b444bd9a925 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.079742 Aug 06 12:36:55.664544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 350/701] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:55 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:56.378160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-98293abc-e5e3-4578-a4eb-a13e4f199893 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:56.380815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-98293abc-e5e3-4578-a4eb-a13e4f199893 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:56.387109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98293abc-e5e3-4578-a4eb-a13e4f199893 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:56.387582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98293abc-e5e3-4578-a4eb-a13e4f199893 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:56.388008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98293abc-e5e3-4578-a4eb-a13e4f199893 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:56.388710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98293abc-e5e3-4578-a4eb-a13e4f199893 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:56.389155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98293abc-e5e3-4578-a4eb-a13e4f199893 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:56.389567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98293abc-e5e3-4578-a4eb-a13e4f199893 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:56.393039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:36:56.418615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-98293abc-e5e3-4578-a4eb-a13e4f199893 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Aug 06 12:36:56.419189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 351/702] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:56.424050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6d75aadb-839f-4d33-a278-6e5f1ab6676f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:56.426154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6d75aadb-839f-4d33-a278-6e5f1ab6676f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:56.431863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d75aadb-839f-4d33-a278-6e5f1ab6676f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:56.432377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d75aadb-839f-4d33-a278-6e5f1ab6676f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:56.432810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d75aadb-839f-4d33-a278-6e5f1ab6676f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:56.433485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d75aadb-839f-4d33-a278-6e5f1ab6676f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:56.433934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d75aadb-839f-4d33-a278-6e5f1ab6676f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:56.434353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d75aadb-839f-4d33-a278-6e5f1ab6676f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:56.463147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6d75aadb-839f-4d33-a278-6e5f1ab6676f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042634 Aug 06 12:36:56.463700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 352/703] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:56 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:56.689230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-053e6d1a-d4f8-4263-8326-6c2017ba67b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:56.689834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-053e6d1a-d4f8-4263-8326-6c2017ba67b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:56.696106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-053e6d1a-d4f8-4263-8326-6c2017ba67b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:56.696622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-053e6d1a-d4f8-4263-8326-6c2017ba67b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:56.697053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-053e6d1a-d4f8-4263-8326-6c2017ba67b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:56.697730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-053e6d1a-d4f8-4263-8326-6c2017ba67b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:56.698180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-053e6d1a-d4f8-4263-8326-6c2017ba67b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:56.698599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-053e6d1a-d4f8-4263-8326-6c2017ba67b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:56.759091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-053e6d1a-d4f8-4263-8326-6c2017ba67b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:56.766474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-053e6d1a-d4f8-4263-8326-6c2017ba67b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080895 Aug 06 12:36:56.767036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 353/704] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:56 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:57.430773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5a973d8c-e3c6-40ca-b515-5ded79af3d0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:57.432930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5a973d8c-e3c6-40ca-b515-5ded79af3d0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:57.439406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a973d8c-e3c6-40ca-b515-5ded79af3d0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:57.439887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a973d8c-e3c6-40ca-b515-5ded79af3d0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:57.440338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a973d8c-e3c6-40ca-b515-5ded79af3d0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:57.441043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a973d8c-e3c6-40ca-b515-5ded79af3d0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:57.441989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a973d8c-e3c6-40ca-b515-5ded79af3d0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:57.442409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a973d8c-e3c6-40ca-b515-5ded79af3d0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:57.470890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5a973d8c-e3c6-40ca-b515-5ded79af3d0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044090 Aug 06 12:36:57.471432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 354/705] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:57 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:57.479750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-55729127-0daf-4c75-a997-4c2a0dc84d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:57.481892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-55729127-0daf-4c75-a997-4c2a0dc84d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:57.488645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55729127-0daf-4c75-a997-4c2a0dc84d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:57.489125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55729127-0daf-4c75-a997-4c2a0dc84d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:57.489555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55729127-0daf-4c75-a997-4c2a0dc84d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:57.490249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55729127-0daf-4c75-a997-4c2a0dc84d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:57.490701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55729127-0daf-4c75-a997-4c2a0dc84d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:57.491119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55729127-0daf-4c75-a997-4c2a0dc84d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:57.519773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-55729127-0daf-4c75-a997-4c2a0dc84d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047385 Aug 06 12:36:57.520339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 355/706] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:57.786072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-735037f0-957d-419f-8667-372d3f0db022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:57.786670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-735037f0-957d-419f-8667-372d3f0db022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:57.792593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-735037f0-957d-419f-8667-372d3f0db022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:57.793065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-735037f0-957d-419f-8667-372d3f0db022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:57.793492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-735037f0-957d-419f-8667-372d3f0db022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:57.794161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-735037f0-957d-419f-8667-372d3f0db022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:57.794602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-735037f0-957d-419f-8667-372d3f0db022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:57.795020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-735037f0-957d-419f-8667-372d3f0db022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:57.860044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-735037f0-957d-419f-8667-372d3f0db022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:57.868351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-735037f0-957d-419f-8667-372d3f0db022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.086060 Aug 06 12:36:57.868913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 356/707] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:57 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:58.483424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3f41e4d-d939-4438-b5a7-cace5849f916 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:58.485577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d3f41e4d-d939-4438-b5a7-cace5849f916 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:58.492889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f41e4d-d939-4438-b5a7-cace5849f916 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:58.493368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f41e4d-d939-4438-b5a7-cace5849f916 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:58.493801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f41e4d-d939-4438-b5a7-cace5849f916 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:58.494488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f41e4d-d939-4438-b5a7-cace5849f916 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:58.494958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f41e4d-d939-4438-b5a7-cace5849f916 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:58.495360 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f41e4d-d939-4438-b5a7-cace5849f916 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:58.523801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3f41e4d-d939-4438-b5a7-cace5849f916 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Aug 06 12:36:58.524375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 357/708] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:58.530762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7bc7bf2b-ad3e-40be-979c-7c5c56e15f78 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:58.533077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7bc7bf2b-ad3e-40be-979c-7c5c56e15f78 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:58.538531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bc7bf2b-ad3e-40be-979c-7c5c56e15f78 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:58.539005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bc7bf2b-ad3e-40be-979c-7c5c56e15f78 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:58.539437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bc7bf2b-ad3e-40be-979c-7c5c56e15f78 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:58.540138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bc7bf2b-ad3e-40be-979c-7c5c56e15f78 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:58.540613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bc7bf2b-ad3e-40be-979c-7c5c56e15f78 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:58.541037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bc7bf2b-ad3e-40be-979c-7c5c56e15f78 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:58.569250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7bc7bf2b-ad3e-40be-979c-7c5c56e15f78 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042073 Aug 06 12:36:58.569787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 358/709] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:36:58.887946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3f233e91-0e79-4266-aab7-aa46f9a607d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:58.888563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3f233e91-0e79-4266-aab7-aa46f9a607d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:58.894375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f233e91-0e79-4266-aab7-aa46f9a607d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:58.894846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f233e91-0e79-4266-aab7-aa46f9a607d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:58.895272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f233e91-0e79-4266-aab7-aa46f9a607d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:58.895941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f233e91-0e79-4266-aab7-aa46f9a607d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:58.896413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f233e91-0e79-4266-aab7-aa46f9a607d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:58.896830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f233e91-0e79-4266-aab7-aa46f9a607d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:58.955896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3f233e91-0e79-4266-aab7-aa46f9a607d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:36:58.963835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3f233e91-0e79-4266-aab7-aa46f9a607d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.079756 Aug 06 12:36:58.964416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 359/710] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:58 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:36:59.536683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61af427c-6a2e-44e4-b8f1-7bd800ed3d93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:59.538801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61af427c-6a2e-44e4-b8f1-7bd800ed3d93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:59.545114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61af427c-6a2e-44e4-b8f1-7bd800ed3d93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:59.545588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61af427c-6a2e-44e4-b8f1-7bd800ed3d93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:59.546016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61af427c-6a2e-44e4-b8f1-7bd800ed3d93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:59.546691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61af427c-6a2e-44e4-b8f1-7bd800ed3d93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:59.547136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61af427c-6a2e-44e4-b8f1-7bd800ed3d93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:59.547553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61af427c-6a2e-44e4-b8f1-7bd800ed3d93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:59.575975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61af427c-6a2e-44e4-b8f1-7bd800ed3d93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043956 Aug 06 12:36:59.576624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 360/711] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:36:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:36:59.581134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-00fd478b-0360-4681-8cb2-c8ca0cb001ce tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:59.583170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-00fd478b-0360-4681-8cb2-c8ca0cb001ce tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:59.588592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00fd478b-0360-4681-8cb2-c8ca0cb001ce tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:59.589066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00fd478b-0360-4681-8cb2-c8ca0cb001ce tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:59.589496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00fd478b-0360-4681-8cb2-c8ca0cb001ce tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:59.590169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00fd478b-0360-4681-8cb2-c8ca0cb001ce tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:59.590623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00fd478b-0360-4681-8cb2-c8ca0cb001ce tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:59.591042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00fd478b-0360-4681-8cb2-c8ca0cb001ce tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:59.619589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-00fd478b-0360-4681-8cb2-c8ca0cb001ce tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041968 Aug 06 12:36:59.620126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 361/712] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:36:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:36:59.984772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a2001977-951b-4953-9760-4ef579846096 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:36:59.985295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a2001977-951b-4953-9760-4ef579846096 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:36:59.991403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2001977-951b-4953-9760-4ef579846096 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:59.991882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2001977-951b-4953-9760-4ef579846096 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:59.992328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2001977-951b-4953-9760-4ef579846096 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:36:59.993028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2001977-951b-4953-9760-4ef579846096 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:36:59.993477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2001977-951b-4953-9760-4ef579846096 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:36:59.993898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2001977-951b-4953-9760-4ef579846096 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:00.053513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a2001977-951b-4953-9760-4ef579846096 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:00.060848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a2001977-951b-4953-9760-4ef579846096 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080008 Aug 06 12:37:00.061417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 362/713] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:36:59 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:00.587114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-91c9d2b2-d1d7-4f1b-8dcf-035d57e7fc5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:00.589329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-91c9d2b2-d1d7-4f1b-8dcf-035d57e7fc5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:00.595645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91c9d2b2-d1d7-4f1b-8dcf-035d57e7fc5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:00.596118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91c9d2b2-d1d7-4f1b-8dcf-035d57e7fc5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:00.596585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91c9d2b2-d1d7-4f1b-8dcf-035d57e7fc5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:00.597267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91c9d2b2-d1d7-4f1b-8dcf-035d57e7fc5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:00.597743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91c9d2b2-d1d7-4f1b-8dcf-035d57e7fc5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:00.598161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91c9d2b2-d1d7-4f1b-8dcf-035d57e7fc5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:00.626652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-91c9d2b2-d1d7-4f1b-8dcf-035d57e7fc5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 Aug 06 12:37:00.627195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 363/714] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:00 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:37:00.632126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-966f4cc1-301d-49c7-9281-9e1d8f8849dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:00.634180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-966f4cc1-301d-49c7-9281-9e1d8f8849dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:00.639575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966f4cc1-301d-49c7-9281-9e1d8f8849dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:00.640049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966f4cc1-301d-49c7-9281-9e1d8f8849dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:00.640521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966f4cc1-301d-49c7-9281-9e1d8f8849dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:00.641195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966f4cc1-301d-49c7-9281-9e1d8f8849dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:00.641641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966f4cc1-301d-49c7-9281-9e1d8f8849dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:00.642060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966f4cc1-301d-49c7-9281-9e1d8f8849dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:00.669411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-966f4cc1-301d-49c7-9281-9e1d8f8849dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041258 Aug 06 12:37:00.669958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 364/715] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:01.080966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f12365b6-bb63-4064-ab3b-c91fcd7e5265 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:01.081571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f12365b6-bb63-4064-ab3b-c91fcd7e5265 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:01.087507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12365b6-bb63-4064-ab3b-c91fcd7e5265 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:01.087984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12365b6-bb63-4064-ab3b-c91fcd7e5265 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:01.088437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12365b6-bb63-4064-ab3b-c91fcd7e5265 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:01.089128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12365b6-bb63-4064-ab3b-c91fcd7e5265 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:01.089577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12365b6-bb63-4064-ab3b-c91fcd7e5265 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:01.090002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12365b6-bb63-4064-ab3b-c91fcd7e5265 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:01.149323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f12365b6-bb63-4064-ab3b-c91fcd7e5265 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:01.156665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f12365b6-bb63-4064-ab3b-c91fcd7e5265 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.079523 Aug 06 12:37:01.157228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 365/716] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:01 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:01.639237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-635b570c-d384-401f-9fa5-16a2d74d1d8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:01.641398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-635b570c-d384-401f-9fa5-16a2d74d1d8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:01.648464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-635b570c-d384-401f-9fa5-16a2d74d1d8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:01.648881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-635b570c-d384-401f-9fa5-16a2d74d1d8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:01.649309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-635b570c-d384-401f-9fa5-16a2d74d1d8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:01.649989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-635b570c-d384-401f-9fa5-16a2d74d1d8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:01.650432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-635b570c-d384-401f-9fa5-16a2d74d1d8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:01.650850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-635b570c-d384-401f-9fa5-16a2d74d1d8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:01.678648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-635b570c-d384-401f-9fa5-16a2d74d1d8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Aug 06 12:37:01.679190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 366/717] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:01 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:37:01.683563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c04aa4e-da6a-40e3-afb0-f6ea0c87e8ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:01.685627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c04aa4e-da6a-40e3-afb0-f6ea0c87e8ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:01.691520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c04aa4e-da6a-40e3-afb0-f6ea0c87e8ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:01.691994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c04aa4e-da6a-40e3-afb0-f6ea0c87e8ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:01.692465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c04aa4e-da6a-40e3-afb0-f6ea0c87e8ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:01.693137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c04aa4e-da6a-40e3-afb0-f6ea0c87e8ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:01.693582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c04aa4e-da6a-40e3-afb0-f6ea0c87e8ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:01.694000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c04aa4e-da6a-40e3-afb0-f6ea0c87e8ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:01.717939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:01.723024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c04aa4e-da6a-40e3-afb0-f6ea0c87e8ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042901 Aug 06 12:37:01.723568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 367/718] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:02.178028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8a139a70-c38b-43ea-b219-f27dbbff6885 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:02.178640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8a139a70-c38b-43ea-b219-f27dbbff6885 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:02.184679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a139a70-c38b-43ea-b219-f27dbbff6885 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:02.185158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a139a70-c38b-43ea-b219-f27dbbff6885 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:02.185593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a139a70-c38b-43ea-b219-f27dbbff6885 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:02.186291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a139a70-c38b-43ea-b219-f27dbbff6885 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:02.186737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a139a70-c38b-43ea-b219-f27dbbff6885 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:02.187160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a139a70-c38b-43ea-b219-f27dbbff6885 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:02.248669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8a139a70-c38b-43ea-b219-f27dbbff6885 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:02.256828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8a139a70-c38b-43ea-b219-f27dbbff6885 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083170 Aug 06 12:37:02.257308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 368/719] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:02 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:02.421866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=9 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:02.446332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=14 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:02.689989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fb059741-7d28-4338-a773-a76112e852b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:02.692109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fb059741-7d28-4338-a773-a76112e852b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:02.698553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb059741-7d28-4338-a773-a76112e852b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:02.699036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb059741-7d28-4338-a773-a76112e852b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:02.699478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb059741-7d28-4338-a773-a76112e852b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:02.700162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb059741-7d28-4338-a773-a76112e852b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:02.700641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb059741-7d28-4338-a773-a76112e852b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:02.701062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb059741-7d28-4338-a773-a76112e852b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:02.730208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fb059741-7d28-4338-a773-a76112e852b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044169 Aug 06 12:37:02.730758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 369/720] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:02 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:37:02.735158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4f9b82c0-0c04-46c0-8049-e353bfa66965 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:02.737496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4f9b82c0-0c04-46c0-8049-e353bfa66965 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:02.743108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f9b82c0-0c04-46c0-8049-e353bfa66965 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:02.743632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f9b82c0-0c04-46c0-8049-e353bfa66965 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:02.744087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f9b82c0-0c04-46c0-8049-e353bfa66965 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:02.744883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f9b82c0-0c04-46c0-8049-e353bfa66965 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:02.745384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f9b82c0-0c04-46c0-8049-e353bfa66965 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:02.745815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f9b82c0-0c04-46c0-8049-e353bfa66965 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:02.773985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4f9b82c0-0c04-46c0-8049-e353bfa66965 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042270 Aug 06 12:37:02.774526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 370/721] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:02 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:03.277271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6009a444-544c-4e34-935a-88016ed064e5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:03.277803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6009a444-544c-4e34-935a-88016ed064e5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:03.283674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6009a444-544c-4e34-935a-88016ed064e5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:03.284148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6009a444-544c-4e34-935a-88016ed064e5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:03.284673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6009a444-544c-4e34-935a-88016ed064e5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:03.285357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6009a444-544c-4e34-935a-88016ed064e5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:03.285803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6009a444-544c-4e34-935a-88016ed064e5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:03.286224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6009a444-544c-4e34-935a-88016ed064e5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:03.345887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6009a444-544c-4e34-935a-88016ed064e5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:03.353271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6009a444-544c-4e34-935a-88016ed064e5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080128 Aug 06 12:37:03.353830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 371/722] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:03 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:03.745610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8965e8ac-2912-441f-b28d-0b1540949a5f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:03.747753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8965e8ac-2912-441f-b28d-0b1540949a5f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:03.754474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8965e8ac-2912-441f-b28d-0b1540949a5f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:03.754952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8965e8ac-2912-441f-b28d-0b1540949a5f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:03.755385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8965e8ac-2912-441f-b28d-0b1540949a5f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:03.756077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8965e8ac-2912-441f-b28d-0b1540949a5f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:03.756555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8965e8ac-2912-441f-b28d-0b1540949a5f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:03.756974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8965e8ac-2912-441f-b28d-0b1540949a5f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:03.785226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8965e8ac-2912-441f-b28d-0b1540949a5f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045922 Aug 06 12:37:03.785775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 372/723] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:03 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:37:03.790250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-182fbe44-e213-4a47-90dd-97b778cbcd72 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:03.792376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-182fbe44-e213-4a47-90dd-97b778cbcd72 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:03.797952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-182fbe44-e213-4a47-90dd-97b778cbcd72 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:03.798428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-182fbe44-e213-4a47-90dd-97b778cbcd72 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:03.798874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-182fbe44-e213-4a47-90dd-97b778cbcd72 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:03.799545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-182fbe44-e213-4a47-90dd-97b778cbcd72 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:03.799995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-182fbe44-e213-4a47-90dd-97b778cbcd72 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:03.800940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-182fbe44-e213-4a47-90dd-97b778cbcd72 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:03.830453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-182fbe44-e213-4a47-90dd-97b778cbcd72 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043638 Aug 06 12:37:03.831046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 373/724] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:04.373004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5c4a231-f127-468f-9f69-8a79cb6bf061 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:04.373608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5c4a231-f127-468f-9f69-8a79cb6bf061 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:04.380108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5c4a231-f127-468f-9f69-8a79cb6bf061 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:04.380618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5c4a231-f127-468f-9f69-8a79cb6bf061 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:04.381052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5c4a231-f127-468f-9f69-8a79cb6bf061 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:04.381734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5c4a231-f127-468f-9f69-8a79cb6bf061 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:04.382186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5c4a231-f127-468f-9f69-8a79cb6bf061 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:04.382606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5c4a231-f127-468f-9f69-8a79cb6bf061 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:04.442052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5c4a231-f127-468f-9f69-8a79cb6bf061 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:04.449396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5c4a231-f127-468f-9f69-8a79cb6bf061 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080215 Aug 06 12:37:04.449950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 374/725] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:04 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:04.797304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d1622172-8cfd-487b-ba0f-5161f0ebd873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:04.799414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d1622172-8cfd-487b-ba0f-5161f0ebd873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:04.805278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1622172-8cfd-487b-ba0f-5161f0ebd873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:04.805754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1622172-8cfd-487b-ba0f-5161f0ebd873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:04.806185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1622172-8cfd-487b-ba0f-5161f0ebd873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:04.806879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1622172-8cfd-487b-ba0f-5161f0ebd873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:04.807315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1622172-8cfd-487b-ba0f-5161f0ebd873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:04.807735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1622172-8cfd-487b-ba0f-5161f0ebd873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:04.836660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d1622172-8cfd-487b-ba0f-5161f0ebd873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043267 Aug 06 12:37:04.837207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 375/726] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:37:04.842764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61c07b93-cba9-48db-a529-2143d6cff27f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:04.844853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61c07b93-cba9-48db-a529-2143d6cff27f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:04.850408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c07b93-cba9-48db-a529-2143d6cff27f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:04.850878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c07b93-cba9-48db-a529-2143d6cff27f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:04.851308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c07b93-cba9-48db-a529-2143d6cff27f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:04.851986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c07b93-cba9-48db-a529-2143d6cff27f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:04.852462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c07b93-cba9-48db-a529-2143d6cff27f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:04.852883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c07b93-cba9-48db-a529-2143d6cff27f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:04.880771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61c07b93-cba9-48db-a529-2143d6cff27f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041504 Aug 06 12:37:04.881311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 376/727] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:37:05.469482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d9a057ea-c3cb-4b1d-9f6e-68d9e0ec1344 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:05.470082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d9a057ea-c3cb-4b1d-9f6e-68d9e0ec1344 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:05.476926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9a057ea-c3cb-4b1d-9f6e-68d9e0ec1344 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:05.477425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9a057ea-c3cb-4b1d-9f6e-68d9e0ec1344 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:05.477855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9a057ea-c3cb-4b1d-9f6e-68d9e0ec1344 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:05.478530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9a057ea-c3cb-4b1d-9f6e-68d9e0ec1344 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:05.478977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9a057ea-c3cb-4b1d-9f6e-68d9e0ec1344 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:05.479395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9a057ea-c3cb-4b1d-9f6e-68d9e0ec1344 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:05.540597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d9a057ea-c3cb-4b1d-9f6e-68d9e0ec1344 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:05.548157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d9a057ea-c3cb-4b1d-9f6e-68d9e0ec1344 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082485 Aug 06 12:37:05.548698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 377/728] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:05 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:05.849730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6120364a-14fb-46cd-a6c1-2ad68307d62f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:05.851742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6120364a-14fb-46cd-a6c1-2ad68307d62f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:05.857585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6120364a-14fb-46cd-a6c1-2ad68307d62f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:05.858059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6120364a-14fb-46cd-a6c1-2ad68307d62f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:05.858487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6120364a-14fb-46cd-a6c1-2ad68307d62f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:05.859158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6120364a-14fb-46cd-a6c1-2ad68307d62f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:05.859601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6120364a-14fb-46cd-a6c1-2ad68307d62f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:05.860046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6120364a-14fb-46cd-a6c1-2ad68307d62f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:05.887641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6120364a-14fb-46cd-a6c1-2ad68307d62f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042449 Aug 06 12:37:05.888174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 378/729] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:05 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:37:05.892513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-722a188b-dc5e-4d07-9125-1e4a4ae78adb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:05.895045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-722a188b-dc5e-4d07-9125-1e4a4ae78adb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:05.900589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-722a188b-dc5e-4d07-9125-1e4a4ae78adb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:05.901060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-722a188b-dc5e-4d07-9125-1e4a4ae78adb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:05.901482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-722a188b-dc5e-4d07-9125-1e4a4ae78adb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:05.902151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-722a188b-dc5e-4d07-9125-1e4a4ae78adb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:05.902600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-722a188b-dc5e-4d07-9125-1e4a4ae78adb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:05.903015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-722a188b-dc5e-4d07-9125-1e4a4ae78adb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:05.931189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-722a188b-dc5e-4d07-9125-1e4a4ae78adb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042008 Aug 06 12:37:05.931738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 379/730] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:06.569671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7fd00b2-9b4f-431b-b09a-49ad291ee059 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:06.570271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7fd00b2-9b4f-431b-b09a-49ad291ee059 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:06.576673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7fd00b2-9b4f-431b-b09a-49ad291ee059 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:06.577149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7fd00b2-9b4f-431b-b09a-49ad291ee059 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:06.577580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7fd00b2-9b4f-431b-b09a-49ad291ee059 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:06.578262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7fd00b2-9b4f-431b-b09a-49ad291ee059 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:06.578716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7fd00b2-9b4f-431b-b09a-49ad291ee059 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:06.579142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7fd00b2-9b4f-431b-b09a-49ad291ee059 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:06.885650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7fd00b2-9b4f-431b-b09a-49ad291ee059 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:06.894706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7fd00b2-9b4f-431b-b09a-49ad291ee059 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.329435 Aug 06 12:37:06.895488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 380/731] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:06 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:06.900741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d9fb01a8-c5c2-479f-814b-79cda4ffd10a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:06.903142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d9fb01a8-c5c2-479f-814b-79cda4ffd10a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:06.909026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9fb01a8-c5c2-479f-814b-79cda4ffd10a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:06.910130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9fb01a8-c5c2-479f-814b-79cda4ffd10a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:06.910597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9fb01a8-c5c2-479f-814b-79cda4ffd10a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:06.911258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9fb01a8-c5c2-479f-814b-79cda4ffd10a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:06.911713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9fb01a8-c5c2-479f-814b-79cda4ffd10a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:06.912135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d9fb01a8-c5c2-479f-814b-79cda4ffd10a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:06.941205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d9fb01a8-c5c2-479f-814b-79cda4ffd10a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Aug 06 12:37:06.941784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 381/732] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:06 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:06.946188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3808db3d-3e1b-4ff1-a38b-9191013264dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:06.948232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3808db3d-3e1b-4ff1-a38b-9191013264dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:06.953705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3808db3d-3e1b-4ff1-a38b-9191013264dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:06.954180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3808db3d-3e1b-4ff1-a38b-9191013264dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:06.954613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3808db3d-3e1b-4ff1-a38b-9191013264dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:06.955315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3808db3d-3e1b-4ff1-a38b-9191013264dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:06.955764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3808db3d-3e1b-4ff1-a38b-9191013264dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:06.956184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3808db3d-3e1b-4ff1-a38b-9191013264dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:06.983944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3808db3d-3e1b-4ff1-a38b-9191013264dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041181 Aug 06 12:37:06.984507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 382/733] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:06 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:07.915737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d014a9bd-dde8-4876-a493-835c4c84612a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:07.916411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d014a9bd-dde8-4876-a493-835c4c84612a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:07.922777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d014a9bd-dde8-4876-a493-835c4c84612a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:07.923252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d014a9bd-dde8-4876-a493-835c4c84612a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:07.923687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d014a9bd-dde8-4876-a493-835c4c84612a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:07.924395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d014a9bd-dde8-4876-a493-835c4c84612a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:07.924848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d014a9bd-dde8-4876-a493-835c4c84612a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:07.925861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d014a9bd-dde8-4876-a493-835c4c84612a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:07.984964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d014a9bd-dde8-4876-a493-835c4c84612a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:07.992611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d014a9bd-dde8-4876-a493-835c4c84612a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080715 Aug 06 12:37:07.993184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 383/734] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:07 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:07.998354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f983779a-439f-4048-8b8e-ddc59de8df13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:08.000483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f983779a-439f-4048-8b8e-ddc59de8df13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:08.006268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f983779a-439f-4048-8b8e-ddc59de8df13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:08.006746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f983779a-439f-4048-8b8e-ddc59de8df13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:08.007176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f983779a-439f-4048-8b8e-ddc59de8df13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:08.007858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f983779a-439f-4048-8b8e-ddc59de8df13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:08.008324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f983779a-439f-4048-8b8e-ddc59de8df13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:08.008752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f983779a-439f-4048-8b8e-ddc59de8df13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:08.025410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:08.038581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f983779a-439f-4048-8b8e-ddc59de8df13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Aug 06 12:37:08.039129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 384/735] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:07 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:08.043510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1726ab4d-4e91-42b2-b722-27a43b7a92d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:08.045580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1726ab4d-4e91-42b2-b722-27a43b7a92d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:08.050976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1726ab4d-4e91-42b2-b722-27a43b7a92d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:08.051450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1726ab4d-4e91-42b2-b722-27a43b7a92d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:08.051889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1726ab4d-4e91-42b2-b722-27a43b7a92d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:08.052595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1726ab4d-4e91-42b2-b722-27a43b7a92d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:08.053045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1726ab4d-4e91-42b2-b722-27a43b7a92d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:08.053466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1726ab4d-4e91-42b2-b722-27a43b7a92d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:08.080416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1726ab4d-4e91-42b2-b722-27a43b7a92d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040307 Aug 06 12:37:08.080955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 385/736] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:08 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:09.012821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-98467be1-3291-4afe-ad25-5553f4c40010 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:09.013420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-98467be1-3291-4afe-ad25-5553f4c40010 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:09.019848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98467be1-3291-4afe-ad25-5553f4c40010 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:09.020343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98467be1-3291-4afe-ad25-5553f4c40010 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:09.020764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98467be1-3291-4afe-ad25-5553f4c40010 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:09.021433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98467be1-3291-4afe-ad25-5553f4c40010 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:09.021878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98467be1-3291-4afe-ad25-5553f4c40010 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:09.022293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98467be1-3291-4afe-ad25-5553f4c40010 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:09.083176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-98467be1-3291-4afe-ad25-5553f4c40010 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:09.090610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-98467be1-3291-4afe-ad25-5553f4c40010 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081658 Aug 06 12:37:09.091161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 386/737] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:09 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:09.095567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9bfa03c6-2115-46d9-a863-ee2becba681c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:09.098219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9bfa03c6-2115-46d9-a863-ee2becba681c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:09.099842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:09.104986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bfa03c6-2115-46d9-a863-ee2becba681c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:09.105473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bfa03c6-2115-46d9-a863-ee2becba681c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:09.105885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bfa03c6-2115-46d9-a863-ee2becba681c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:09.106557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bfa03c6-2115-46d9-a863-ee2becba681c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:09.107001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bfa03c6-2115-46d9-a863-ee2becba681c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:09.107414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bfa03c6-2115-46d9-a863-ee2becba681c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:09.136627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9bfa03c6-2115-46d9-a863-ee2becba681c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044408 Aug 06 12:37:09.137412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 387/738] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:09 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:09.141917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-00421807-e444-4dc2-aaab-5ec9614d7073 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:09.144246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-00421807-e444-4dc2-aaab-5ec9614d7073 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:09.150530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00421807-e444-4dc2-aaab-5ec9614d7073 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:09.150996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00421807-e444-4dc2-aaab-5ec9614d7073 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:09.151431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00421807-e444-4dc2-aaab-5ec9614d7073 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:09.152121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00421807-e444-4dc2-aaab-5ec9614d7073 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:09.152606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00421807-e444-4dc2-aaab-5ec9614d7073 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:09.153025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00421807-e444-4dc2-aaab-5ec9614d7073 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:09.181090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-00421807-e444-4dc2-aaab-5ec9614d7073 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042851 Aug 06 12:37:09.181647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 388/739] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:10.111222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-019023ac-7357-4ed3-bab4-2109e88f55d0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:10.111854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-019023ac-7357-4ed3-bab4-2109e88f55d0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:10.118726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-019023ac-7357-4ed3-bab4-2109e88f55d0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:10.119194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-019023ac-7357-4ed3-bab4-2109e88f55d0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:10.119622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-019023ac-7357-4ed3-bab4-2109e88f55d0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:10.120315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-019023ac-7357-4ed3-bab4-2109e88f55d0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:10.120770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-019023ac-7357-4ed3-bab4-2109e88f55d0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:10.121185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-019023ac-7357-4ed3-bab4-2109e88f55d0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:10.180638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-019023ac-7357-4ed3-bab4-2109e88f55d0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:10.187910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-019023ac-7357-4ed3-bab4-2109e88f55d0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080760 Aug 06 12:37:10.188498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 389/740] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:10 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:10.192937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-162cfb0e-8b56-428b-85ab-ff882006ba78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:10.194995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-162cfb0e-8b56-428b-85ab-ff882006ba78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:10.200486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-162cfb0e-8b56-428b-85ab-ff882006ba78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:10.200959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-162cfb0e-8b56-428b-85ab-ff882006ba78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:10.201384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-162cfb0e-8b56-428b-85ab-ff882006ba78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:10.202056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-162cfb0e-8b56-428b-85ab-ff882006ba78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:10.202502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-162cfb0e-8b56-428b-85ab-ff882006ba78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:10.202919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-162cfb0e-8b56-428b-85ab-ff882006ba78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:10.232046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-162cfb0e-8b56-428b-85ab-ff882006ba78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042593 Aug 06 12:37:10.232613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 390/741] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:10 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:10.237143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-54547d08-4db8-43a1-9e1e-d48a1365cf33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:10.239167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-54547d08-4db8-43a1-9e1e-d48a1365cf33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:10.244419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54547d08-4db8-43a1-9e1e-d48a1365cf33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:10.244915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54547d08-4db8-43a1-9e1e-d48a1365cf33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:10.245340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54547d08-4db8-43a1-9e1e-d48a1365cf33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:10.246007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54547d08-4db8-43a1-9e1e-d48a1365cf33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:10.246468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54547d08-4db8-43a1-9e1e-d48a1365cf33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:10.246884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54547d08-4db8-43a1-9e1e-d48a1365cf33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:10.274420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-54547d08-4db8-43a1-9e1e-d48a1365cf33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040812 Aug 06 12:37:10.274977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 391/742] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:10 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:11.208697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-62d65280-b6dc-4bda-9370-0ce4d39e5678 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:11.209341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-62d65280-b6dc-4bda-9370-0ce4d39e5678 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:11.215653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d65280-b6dc-4bda-9370-0ce4d39e5678 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:11.216131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d65280-b6dc-4bda-9370-0ce4d39e5678 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:11.216602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d65280-b6dc-4bda-9370-0ce4d39e5678 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:11.217283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d65280-b6dc-4bda-9370-0ce4d39e5678 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:11.217732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d65280-b6dc-4bda-9370-0ce4d39e5678 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:11.218151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d65280-b6dc-4bda-9370-0ce4d39e5678 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:11.280621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-62d65280-b6dc-4bda-9370-0ce4d39e5678 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:11.288638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-62d65280-b6dc-4bda-9370-0ce4d39e5678 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084276 Aug 06 12:37:11.289198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 392/743] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:11 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:11.293660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b610696a-605e-42e3-9355-c29f3144cf28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:11.295742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b610696a-605e-42e3-9355-c29f3144cf28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:11.301203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b610696a-605e-42e3-9355-c29f3144cf28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:11.301681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b610696a-605e-42e3-9355-c29f3144cf28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:11.302113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b610696a-605e-42e3-9355-c29f3144cf28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:11.302792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b610696a-605e-42e3-9355-c29f3144cf28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:11.303241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b610696a-605e-42e3-9355-c29f3144cf28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:11.303659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b610696a-605e-42e3-9355-c29f3144cf28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:11.331592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b610696a-605e-42e3-9355-c29f3144cf28 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040951 Aug 06 12:37:11.332149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 393/744] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:11 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:11.336506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f3dc8122-ef22-4579-87ae-85f0ea7ec8ff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:11.338496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f3dc8122-ef22-4579-87ae-85f0ea7ec8ff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:11.343786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3dc8122-ef22-4579-87ae-85f0ea7ec8ff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:11.344261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3dc8122-ef22-4579-87ae-85f0ea7ec8ff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:11.344751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3dc8122-ef22-4579-87ae-85f0ea7ec8ff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:11.345425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3dc8122-ef22-4579-87ae-85f0ea7ec8ff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:11.345879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3dc8122-ef22-4579-87ae-85f0ea7ec8ff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:11.346299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3dc8122-ef22-4579-87ae-85f0ea7ec8ff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:11.375778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f3dc8122-ef22-4579-87ae-85f0ea7ec8ff tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042291 Aug 06 12:37:11.376781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 394/745] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:11 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:12.308216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ca8ffd7b-0f61-4934-a858-5f23a205e80e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:12.308884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ca8ffd7b-0f61-4934-a858-5f23a205e80e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:12.315187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca8ffd7b-0f61-4934-a858-5f23a205e80e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:12.315704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca8ffd7b-0f61-4934-a858-5f23a205e80e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:12.316129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca8ffd7b-0f61-4934-a858-5f23a205e80e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:12.316838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca8ffd7b-0f61-4934-a858-5f23a205e80e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:12.317283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca8ffd7b-0f61-4934-a858-5f23a205e80e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:12.317706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca8ffd7b-0f61-4934-a858-5f23a205e80e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:12.377504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ca8ffd7b-0f61-4934-a858-5f23a205e80e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:12.384945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ca8ffd7b-0f61-4934-a858-5f23a205e80e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080502 Aug 06 12:37:12.385493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 395/746] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:12 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:12.389876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-625e826c-f281-4042-ac90-ed1bc063fb5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:12.391944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-625e826c-f281-4042-ac90-ed1bc063fb5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:12.397427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-625e826c-f281-4042-ac90-ed1bc063fb5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:12.397898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-625e826c-f281-4042-ac90-ed1bc063fb5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:12.398325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-625e826c-f281-4042-ac90-ed1bc063fb5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:12.398996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-625e826c-f281-4042-ac90-ed1bc063fb5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:12.399439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-625e826c-f281-4042-ac90-ed1bc063fb5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:12.399851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-625e826c-f281-4042-ac90-ed1bc063fb5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:12.428492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-625e826c-f281-4042-ac90-ed1bc063fb5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041980 Aug 06 12:37:12.429034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 396/747] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:12 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:12.433365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e1ce1cb-1193-439d-8d79-019ede014fc5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:12.435398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e1ce1cb-1193-439d-8d79-019ede014fc5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:12.440803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e1ce1cb-1193-439d-8d79-019ede014fc5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:12.441277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e1ce1cb-1193-439d-8d79-019ede014fc5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:12.441705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e1ce1cb-1193-439d-8d79-019ede014fc5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:12.442377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e1ce1cb-1193-439d-8d79-019ede014fc5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:12.442822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e1ce1cb-1193-439d-8d79-019ede014fc5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:12.443236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e1ce1cb-1193-439d-8d79-019ede014fc5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:12.470591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e1ce1cb-1193-439d-8d79-019ede014fc5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040623 Aug 06 12:37:12.471128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 397/748] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:12 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:13.405625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-be5f5451-caf0-4386-b9b3-e7e91a2ed05a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:13.406320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-be5f5451-caf0-4386-b9b3-e7e91a2ed05a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:13.413033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5f5451-caf0-4386-b9b3-e7e91a2ed05a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:13.413513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5f5451-caf0-4386-b9b3-e7e91a2ed05a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:13.413940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5f5451-caf0-4386-b9b3-e7e91a2ed05a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:13.414663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5f5451-caf0-4386-b9b3-e7e91a2ed05a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:13.415112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5f5451-caf0-4386-b9b3-e7e91a2ed05a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:13.416525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5f5451-caf0-4386-b9b3-e7e91a2ed05a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:13.477141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-be5f5451-caf0-4386-b9b3-e7e91a2ed05a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:13.484527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-be5f5451-caf0-4386-b9b3-e7e91a2ed05a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083371 Aug 06 12:37:13.485073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 398/749] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:13 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:13.490222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5cffedb2-de9a-437e-8758-34bc5f3ac7ea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:13.492284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5cffedb2-de9a-437e-8758-34bc5f3ac7ea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:13.497695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cffedb2-de9a-437e-8758-34bc5f3ac7ea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:13.498167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cffedb2-de9a-437e-8758-34bc5f3ac7ea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:13.498594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cffedb2-de9a-437e-8758-34bc5f3ac7ea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:13.499266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cffedb2-de9a-437e-8758-34bc5f3ac7ea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:13.499712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cffedb2-de9a-437e-8758-34bc5f3ac7ea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:13.500126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cffedb2-de9a-437e-8758-34bc5f3ac7ea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:13.530039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5cffedb2-de9a-437e-8758-34bc5f3ac7ea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043726 Aug 06 12:37:13.530599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 399/750] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:13 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:13.540835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-748ee8e0-bf87-406b-a763-90aeb9d4d0d3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:13.542922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-748ee8e0-bf87-406b-a763-90aeb9d4d0d3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:13.548653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-748ee8e0-bf87-406b-a763-90aeb9d4d0d3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:13.549126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-748ee8e0-bf87-406b-a763-90aeb9d4d0d3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:13.549555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-748ee8e0-bf87-406b-a763-90aeb9d4d0d3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:13.550742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-748ee8e0-bf87-406b-a763-90aeb9d4d0d3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:13.551184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-748ee8e0-bf87-406b-a763-90aeb9d4d0d3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:13.551599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-748ee8e0-bf87-406b-a763-90aeb9d4d0d3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:13.580579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-748ee8e0-bf87-406b-a763-90aeb9d4d0d3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043513 Aug 06 12:37:13.581136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 400/751] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:13 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:14.506381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-94b521d7-a63f-47e8-9538-dad21e8821d6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:14.507044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-94b521d7-a63f-47e8-9538-dad21e8821d6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:14.513379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94b521d7-a63f-47e8-9538-dad21e8821d6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:14.513851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94b521d7-a63f-47e8-9538-dad21e8821d6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:14.514277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94b521d7-a63f-47e8-9538-dad21e8821d6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:14.514953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94b521d7-a63f-47e8-9538-dad21e8821d6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:14.515394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94b521d7-a63f-47e8-9538-dad21e8821d6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:14.515809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94b521d7-a63f-47e8-9538-dad21e8821d6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:14.520415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:14.575739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-94b521d7-a63f-47e8-9538-dad21e8821d6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:14.583569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-94b521d7-a63f-47e8-9538-dad21e8821d6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081624 Aug 06 12:37:14.584114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 401/752] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:14 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:14.588764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-340484c8-9c7d-436e-ad8c-7b91da44db39 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:14.590836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-340484c8-9c7d-436e-ad8c-7b91da44db39 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:14.596585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-340484c8-9c7d-436e-ad8c-7b91da44db39 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:14.597066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-340484c8-9c7d-436e-ad8c-7b91da44db39 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:14.597532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-340484c8-9c7d-436e-ad8c-7b91da44db39 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:14.598235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-340484c8-9c7d-436e-ad8c-7b91da44db39 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:14.598690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-340484c8-9c7d-436e-ad8c-7b91da44db39 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:14.599112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-340484c8-9c7d-436e-ad8c-7b91da44db39 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:14.627084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-340484c8-9c7d-436e-ad8c-7b91da44db39 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041913 Aug 06 12:37:14.627623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 402/753] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:14 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:14.632497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-817e3fa3-02a3-4078-b515-d3d2b7d8d91b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:14.634504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-817e3fa3-02a3-4078-b515-d3d2b7d8d91b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:14.639833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-817e3fa3-02a3-4078-b515-d3d2b7d8d91b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:14.640328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-817e3fa3-02a3-4078-b515-d3d2b7d8d91b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:14.640773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-817e3fa3-02a3-4078-b515-d3d2b7d8d91b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:14.641444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-817e3fa3-02a3-4078-b515-d3d2b7d8d91b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:14.641891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-817e3fa3-02a3-4078-b515-d3d2b7d8d91b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:14.642309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-817e3fa3-02a3-4078-b515-d3d2b7d8d91b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:14.670119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-817e3fa3-02a3-4078-b515-d3d2b7d8d91b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041009 Aug 06 12:37:14.670661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 403/754] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:15.603440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-498152ee-023d-44e1-b01d-7d1df5948d9d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:15.604075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-498152ee-023d-44e1-b01d-7d1df5948d9d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:15.610648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-498152ee-023d-44e1-b01d-7d1df5948d9d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:15.611123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-498152ee-023d-44e1-b01d-7d1df5948d9d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:15.611547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-498152ee-023d-44e1-b01d-7d1df5948d9d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:15.612220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-498152ee-023d-44e1-b01d-7d1df5948d9d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:15.612695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-498152ee-023d-44e1-b01d-7d1df5948d9d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:15.613113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-498152ee-023d-44e1-b01d-7d1df5948d9d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:15.676729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-498152ee-023d-44e1-b01d-7d1df5948d9d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:15.684119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-498152ee-023d-44e1-b01d-7d1df5948d9d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084491 Aug 06 12:37:15.684701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 404/755] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:15 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:15.689105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c74f4344-bc01-4b56-a899-25fc229a1e7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:15.691213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c74f4344-bc01-4b56-a899-25fc229a1e7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:15.696586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c74f4344-bc01-4b56-a899-25fc229a1e7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:15.697059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c74f4344-bc01-4b56-a899-25fc229a1e7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:15.697491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c74f4344-bc01-4b56-a899-25fc229a1e7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:15.698184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c74f4344-bc01-4b56-a899-25fc229a1e7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:15.698612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c74f4344-bc01-4b56-a899-25fc229a1e7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:15.699026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c74f4344-bc01-4b56-a899-25fc229a1e7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:15.727144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c74f4344-bc01-4b56-a899-25fc229a1e7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041491 Aug 06 12:37:15.727672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 405/756] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:15 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:15.731937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9ced1772-2a55-4ac8-b11d-c95b5617334a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:15.733955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9ced1772-2a55-4ac8-b11d-c95b5617334a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:15.739837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ced1772-2a55-4ac8-b11d-c95b5617334a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:15.740328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ced1772-2a55-4ac8-b11d-c95b5617334a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:15.740783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ced1772-2a55-4ac8-b11d-c95b5617334a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:15.741457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ced1772-2a55-4ac8-b11d-c95b5617334a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:15.741905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ced1772-2a55-4ac8-b11d-c95b5617334a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:15.742350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ced1772-2a55-4ac8-b11d-c95b5617334a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:15.771582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9ced1772-2a55-4ac8-b11d-c95b5617334a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042927 Aug 06 12:37:15.772128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 406/757] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:15 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:16.703538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f1d8334f-4b76-4fab-a079-3fbdacf42a26 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:16.704142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f1d8334f-4b76-4fab-a079-3fbdacf42a26 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:16.710503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d8334f-4b76-4fab-a079-3fbdacf42a26 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:16.710970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d8334f-4b76-4fab-a079-3fbdacf42a26 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:16.711395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d8334f-4b76-4fab-a079-3fbdacf42a26 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:16.712068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d8334f-4b76-4fab-a079-3fbdacf42a26 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:16.712542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d8334f-4b76-4fab-a079-3fbdacf42a26 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:16.712956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d8334f-4b76-4fab-a079-3fbdacf42a26 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:16.773786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1d8334f-4b76-4fab-a079-3fbdacf42a26 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:16.781226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f1d8334f-4b76-4fab-a079-3fbdacf42a26 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081535 Aug 06 12:37:16.781774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 407/758] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:16 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:16.786664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-139f9429-b65f-484e-b2ee-6f7bd58142b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:16.788748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-139f9429-b65f-484e-b2ee-6f7bd58142b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:16.794106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-139f9429-b65f-484e-b2ee-6f7bd58142b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:16.794576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-139f9429-b65f-484e-b2ee-6f7bd58142b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:16.795009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-139f9429-b65f-484e-b2ee-6f7bd58142b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:16.795685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-139f9429-b65f-484e-b2ee-6f7bd58142b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:16.796131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-139f9429-b65f-484e-b2ee-6f7bd58142b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:16.796571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-139f9429-b65f-484e-b2ee-6f7bd58142b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:16.824912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-139f9429-b65f-484e-b2ee-6f7bd58142b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Aug 06 12:37:16.825458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 408/759] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:16 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:16.829814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2fa23369-1ee9-471b-afca-97b2383193ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:16.831881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2fa23369-1ee9-471b-afca-97b2383193ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:16.837246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fa23369-1ee9-471b-afca-97b2383193ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:16.837717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fa23369-1ee9-471b-afca-97b2383193ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:16.838142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fa23369-1ee9-471b-afca-97b2383193ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:16.838814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fa23369-1ee9-471b-afca-97b2383193ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:16.839255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fa23369-1ee9-471b-afca-97b2383193ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:16.839669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fa23369-1ee9-471b-afca-97b2383193ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:16.868040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2fa23369-1ee9-471b-afca-97b2383193ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041630 Aug 06 12:37:16.868604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 409/760] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:17.801674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ea8ec66-37f1-4d19-8f6a-2c402c8ca834 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:17.802314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ea8ec66-37f1-4d19-8f6a-2c402c8ca834 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:17.808624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea8ec66-37f1-4d19-8f6a-2c402c8ca834 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:17.809102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea8ec66-37f1-4d19-8f6a-2c402c8ca834 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:17.809528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea8ec66-37f1-4d19-8f6a-2c402c8ca834 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:17.810208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea8ec66-37f1-4d19-8f6a-2c402c8ca834 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:17.810662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea8ec66-37f1-4d19-8f6a-2c402c8ca834 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:17.811087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea8ec66-37f1-4d19-8f6a-2c402c8ca834 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:17.872293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ea8ec66-37f1-4d19-8f6a-2c402c8ca834 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:17.879714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ea8ec66-37f1-4d19-8f6a-2c402c8ca834 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081885 Aug 06 12:37:17.880280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 410/761] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:17 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:17.884727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc527a5e-315a-4be2-bfd1-6e0346c3f7d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:17.886833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cc527a5e-315a-4be2-bfd1-6e0346c3f7d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:17.892374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc527a5e-315a-4be2-bfd1-6e0346c3f7d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:17.892863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc527a5e-315a-4be2-bfd1-6e0346c3f7d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:17.893786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc527a5e-315a-4be2-bfd1-6e0346c3f7d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:17.894470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc527a5e-315a-4be2-bfd1-6e0346c3f7d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:17.894922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc527a5e-315a-4be2-bfd1-6e0346c3f7d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:17.895344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc527a5e-315a-4be2-bfd1-6e0346c3f7d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:17.923759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc527a5e-315a-4be2-bfd1-6e0346c3f7d9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042492 Aug 06 12:37:17.924318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 411/762] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:17 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:17.928690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9d27580e-e5dc-454a-a15d-47963022fde3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:17.930697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9d27580e-e5dc-454a-a15d-47963022fde3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:17.936125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d27580e-e5dc-454a-a15d-47963022fde3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:17.936639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d27580e-e5dc-454a-a15d-47963022fde3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:17.937077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d27580e-e5dc-454a-a15d-47963022fde3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:17.937754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d27580e-e5dc-454a-a15d-47963022fde3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:17.938209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d27580e-e5dc-454a-a15d-47963022fde3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:17.938635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d27580e-e5dc-454a-a15d-47963022fde3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:17.966762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9d27580e-e5dc-454a-a15d-47963022fde3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041461 Aug 06 12:37:17.967305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 412/763] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:17 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:18.900028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-628fa20d-1c8f-4cd5-87b7-162010fa8ebc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:18.900768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-628fa20d-1c8f-4cd5-87b7-162010fa8ebc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:18.907032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-628fa20d-1c8f-4cd5-87b7-162010fa8ebc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:18.907505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-628fa20d-1c8f-4cd5-87b7-162010fa8ebc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:18.907937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-628fa20d-1c8f-4cd5-87b7-162010fa8ebc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:18.908652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-628fa20d-1c8f-4cd5-87b7-162010fa8ebc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:18.909630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-628fa20d-1c8f-4cd5-87b7-162010fa8ebc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:18.910051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-628fa20d-1c8f-4cd5-87b7-162010fa8ebc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:18.972533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-628fa20d-1c8f-4cd5-87b7-162010fa8ebc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:18.980066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-628fa20d-1c8f-4cd5-87b7-162010fa8ebc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083859 Aug 06 12:37:18.980659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 413/764] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:18 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:18.985136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c94fa48-98e1-457b-9640-608895398fe8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:18.988134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c94fa48-98e1-457b-9640-608895398fe8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:18.994404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c94fa48-98e1-457b-9640-608895398fe8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:18.994894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c94fa48-98e1-457b-9640-608895398fe8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:18.995329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c94fa48-98e1-457b-9640-608895398fe8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:18.996026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c94fa48-98e1-457b-9640-608895398fe8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:18.996556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c94fa48-98e1-457b-9640-608895398fe8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:18.996979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c94fa48-98e1-457b-9640-608895398fe8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:19.025742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c94fa48-98e1-457b-9640-608895398fe8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044046 Aug 06 12:37:19.026291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 414/765] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:18 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:19.030839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a71927a3-faa5-4a2f-895f-d7f9b624ce4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:19.032936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a71927a3-faa5-4a2f-895f-d7f9b624ce4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:19.038936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a71927a3-faa5-4a2f-895f-d7f9b624ce4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:19.039413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a71927a3-faa5-4a2f-895f-d7f9b624ce4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:19.039843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a71927a3-faa5-4a2f-895f-d7f9b624ce4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:19.040553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a71927a3-faa5-4a2f-895f-d7f9b624ce4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:19.041004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a71927a3-faa5-4a2f-895f-d7f9b624ce4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:19.041427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a71927a3-faa5-4a2f-895f-d7f9b624ce4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:19.072174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a71927a3-faa5-4a2f-895f-d7f9b624ce4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044760 Aug 06 12:37:19.074722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 415/766] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:20.001367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-92fc08be-ea85-4c0f-a073-7f5eb7465952 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:20.002056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-92fc08be-ea85-4c0f-a073-7f5eb7465952 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:20.008504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fc08be-ea85-4c0f-a073-7f5eb7465952 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:20.009056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fc08be-ea85-4c0f-a073-7f5eb7465952 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:20.009561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fc08be-ea85-4c0f-a073-7f5eb7465952 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:20.010333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fc08be-ea85-4c0f-a073-7f5eb7465952 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:20.010857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fc08be-ea85-4c0f-a073-7f5eb7465952 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:20.011349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fc08be-ea85-4c0f-a073-7f5eb7465952 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:20.082465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-92fc08be-ea85-4c0f-a073-7f5eb7465952 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:20.090096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-92fc08be-ea85-4c0f-a073-7f5eb7465952 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.092601 Aug 06 12:37:20.090667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 416/767] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:19 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:20.095355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-02f3dcd2-7294-404a-a569-a1386f93ad42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:20.098098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-02f3dcd2-7294-404a-a569-a1386f93ad42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:20.103994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f3dcd2-7294-404a-a569-a1386f93ad42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:20.104514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f3dcd2-7294-404a-a569-a1386f93ad42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:20.104950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f3dcd2-7294-404a-a569-a1386f93ad42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:20.105685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f3dcd2-7294-404a-a569-a1386f93ad42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:20.106162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f3dcd2-7294-404a-a569-a1386f93ad42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:20.106579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f3dcd2-7294-404a-a569-a1386f93ad42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:20.130950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:20.135892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-02f3dcd2-7294-404a-a569-a1386f93ad42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Aug 06 12:37:20.136480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 417/768] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:20 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:20.141276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-905cca83-5299-4929-b1c0-196e019fc1e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:20.143874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-905cca83-5299-4929-b1c0-196e019fc1e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:20.149544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-905cca83-5299-4929-b1c0-196e019fc1e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:20.150035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-905cca83-5299-4929-b1c0-196e019fc1e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:20.150475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-905cca83-5299-4929-b1c0-196e019fc1e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:20.151167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-905cca83-5299-4929-b1c0-196e019fc1e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:20.151621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-905cca83-5299-4929-b1c0-196e019fc1e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:20.152049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-905cca83-5299-4929-b1c0-196e019fc1e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:20.181153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-905cca83-5299-4929-b1c0-196e019fc1e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043654 Aug 06 12:37:20.181721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 418/769] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:21.111149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0c58da66-9cce-4cda-b87f-f351df76cdaf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:21.111781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0c58da66-9cce-4cda-b87f-f351df76cdaf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:21.118915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c58da66-9cce-4cda-b87f-f351df76cdaf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:21.119397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c58da66-9cce-4cda-b87f-f351df76cdaf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:21.119833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c58da66-9cce-4cda-b87f-f351df76cdaf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:21.120554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c58da66-9cce-4cda-b87f-f351df76cdaf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:21.121017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c58da66-9cce-4cda-b87f-f351df76cdaf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:21.121442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c58da66-9cce-4cda-b87f-f351df76cdaf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:21.181538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0c58da66-9cce-4cda-b87f-f351df76cdaf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:21.189068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0c58da66-9cce-4cda-b87f-f351df76cdaf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082028 Aug 06 12:37:21.189626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 419/770] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:21 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:21.194224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50108746-ef97-489a-96e7-cb38ed8e0554 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:21.196318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50108746-ef97-489a-96e7-cb38ed8e0554 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:21.201846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50108746-ef97-489a-96e7-cb38ed8e0554 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:21.202334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50108746-ef97-489a-96e7-cb38ed8e0554 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:21.202767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50108746-ef97-489a-96e7-cb38ed8e0554 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:21.203453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50108746-ef97-489a-96e7-cb38ed8e0554 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:21.203905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50108746-ef97-489a-96e7-cb38ed8e0554 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:21.204344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50108746-ef97-489a-96e7-cb38ed8e0554 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:21.233209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-50108746-ef97-489a-96e7-cb38ed8e0554 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042521 Aug 06 12:37:21.233756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 420/771] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:21 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:21.239121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8b8e4305-f716-4e6b-ab45-1e36d6c34a3b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:21.241191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8b8e4305-f716-4e6b-ab45-1e36d6c34a3b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:21.246652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b8e4305-f716-4e6b-ab45-1e36d6c34a3b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:21.247130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b8e4305-f716-4e6b-ab45-1e36d6c34a3b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:21.247562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b8e4305-f716-4e6b-ab45-1e36d6c34a3b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:21.248237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b8e4305-f716-4e6b-ab45-1e36d6c34a3b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:21.248717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b8e4305-f716-4e6b-ab45-1e36d6c34a3b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:21.249138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b8e4305-f716-4e6b-ab45-1e36d6c34a3b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:21.276152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8b8e4305-f716-4e6b-ab45-1e36d6c34a3b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041398 Aug 06 12:37:21.276654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 421/772] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:21 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:22.209061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9b818042-cf18-4ddd-890d-f9d7c0b22275 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:22.209690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9b818042-cf18-4ddd-890d-f9d7c0b22275 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:22.215917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b818042-cf18-4ddd-890d-f9d7c0b22275 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:22.216433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b818042-cf18-4ddd-890d-f9d7c0b22275 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:22.216870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b818042-cf18-4ddd-890d-f9d7c0b22275 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:22.217555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b818042-cf18-4ddd-890d-f9d7c0b22275 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:22.218009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b818042-cf18-4ddd-890d-f9d7c0b22275 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:22.218429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b818042-cf18-4ddd-890d-f9d7c0b22275 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:22.279346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9b818042-cf18-4ddd-890d-f9d7c0b22275 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:22.286956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9b818042-cf18-4ddd-890d-f9d7c0b22275 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082402 Aug 06 12:37:22.287513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 422/773] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:22 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:22.291898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8179e477-c322-4083-96a0-1b22bdb06b48 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:22.294016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8179e477-c322-4083-96a0-1b22bdb06b48 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:22.299422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8179e477-c322-4083-96a0-1b22bdb06b48 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:22.299895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8179e477-c322-4083-96a0-1b22bdb06b48 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:22.300841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8179e477-c322-4083-96a0-1b22bdb06b48 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:22.301514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8179e477-c322-4083-96a0-1b22bdb06b48 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:22.301962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8179e477-c322-4083-96a0-1b22bdb06b48 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:22.302377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8179e477-c322-4083-96a0-1b22bdb06b48 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:22.330906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8179e477-c322-4083-96a0-1b22bdb06b48 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042422 Aug 06 12:37:22.331475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 423/774] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:22 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:22.336088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fd0dc91f-25ab-4271-a109-0f099816acd1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:22.338142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fd0dc91f-25ab-4271-a109-0f099816acd1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:22.343434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd0dc91f-25ab-4271-a109-0f099816acd1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:22.343909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd0dc91f-25ab-4271-a109-0f099816acd1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:22.344380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd0dc91f-25ab-4271-a109-0f099816acd1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:22.345061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd0dc91f-25ab-4271-a109-0f099816acd1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:22.345512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd0dc91f-25ab-4271-a109-0f099816acd1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:22.345937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd0dc91f-25ab-4271-a109-0f099816acd1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:22.373667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fd0dc91f-25ab-4271-a109-0f099816acd1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041264 Aug 06 12:37:22.374200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 424/775] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:23.307077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d5af351c-a10c-4e63-b0ec-b32813971b71 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:23.307718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d5af351c-a10c-4e63-b0ec-b32813971b71 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:23.314051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5af351c-a10c-4e63-b0ec-b32813971b71 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:23.314529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5af351c-a10c-4e63-b0ec-b32813971b71 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:23.314960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5af351c-a10c-4e63-b0ec-b32813971b71 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:23.316136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5af351c-a10c-4e63-b0ec-b32813971b71 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:23.316610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5af351c-a10c-4e63-b0ec-b32813971b71 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:23.317034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5af351c-a10c-4e63-b0ec-b32813971b71 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:23.380247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d5af351c-a10c-4e63-b0ec-b32813971b71 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:23.388052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d5af351c-a10c-4e63-b0ec-b32813971b71 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084813 Aug 06 12:37:23.388641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 425/776] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:23 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:23.393180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-64ea94d1-04eb-4553-8844-5a35feeab7c9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:23.395866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-64ea94d1-04eb-4553-8844-5a35feeab7c9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:23.402677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64ea94d1-04eb-4553-8844-5a35feeab7c9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:23.403163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64ea94d1-04eb-4553-8844-5a35feeab7c9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:23.403597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64ea94d1-04eb-4553-8844-5a35feeab7c9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:23.404763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64ea94d1-04eb-4553-8844-5a35feeab7c9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:23.405600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64ea94d1-04eb-4553-8844-5a35feeab7c9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:23.406134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64ea94d1-04eb-4553-8844-5a35feeab7c9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:23.438397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-64ea94d1-04eb-4553-8844-5a35feeab7c9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048683 Aug 06 12:37:23.438951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 426/777] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:23.444099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d6bf277b-0791-41ad-ab55-6ea10258697d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:23.446179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d6bf277b-0791-41ad-ab55-6ea10258697d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:23.451608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6bf277b-0791-41ad-ab55-6ea10258697d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:23.452085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6bf277b-0791-41ad-ab55-6ea10258697d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:23.452551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6bf277b-0791-41ad-ab55-6ea10258697d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:23.453258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6bf277b-0791-41ad-ab55-6ea10258697d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:23.453707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6bf277b-0791-41ad-ab55-6ea10258697d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:23.454127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6bf277b-0791-41ad-ab55-6ea10258697d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:23.481608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d6bf277b-0791-41ad-ab55-6ea10258697d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041687 Aug 06 12:37:23.482153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 427/778] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:24.408861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-edbb0a18-f3ce-4f7a-bc15-27342be50fbe tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:24.410061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-edbb0a18-f3ce-4f7a-bc15-27342be50fbe tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:24.416494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edbb0a18-f3ce-4f7a-bc15-27342be50fbe tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:24.416975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edbb0a18-f3ce-4f7a-bc15-27342be50fbe tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:24.417412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edbb0a18-f3ce-4f7a-bc15-27342be50fbe tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:24.418095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edbb0a18-f3ce-4f7a-bc15-27342be50fbe tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:24.418548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edbb0a18-f3ce-4f7a-bc15-27342be50fbe tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:24.418971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edbb0a18-f3ce-4f7a-bc15-27342be50fbe tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:24.478537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-edbb0a18-f3ce-4f7a-bc15-27342be50fbe tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:24.486066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-edbb0a18-f3ce-4f7a-bc15-27342be50fbe tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081052 Aug 06 12:37:24.486629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 428/779] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:24 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:24.491487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-589b576e-f5f1-4080-95cd-1fa9d1cf8905 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:24.493582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-589b576e-f5f1-4080-95cd-1fa9d1cf8905 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:24.499271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-589b576e-f5f1-4080-95cd-1fa9d1cf8905 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:24.499742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-589b576e-f5f1-4080-95cd-1fa9d1cf8905 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:24.500168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-589b576e-f5f1-4080-95cd-1fa9d1cf8905 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:24.500866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-589b576e-f5f1-4080-95cd-1fa9d1cf8905 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:24.501311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-589b576e-f5f1-4080-95cd-1fa9d1cf8905 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:24.501726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-589b576e-f5f1-4080-95cd-1fa9d1cf8905 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:24.531004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-589b576e-f5f1-4080-95cd-1fa9d1cf8905 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Aug 06 12:37:24.531541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 429/780] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:24.535817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0b3e1207-1813-4ffe-b846-e4c170a5ecc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:24.537817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0b3e1207-1813-4ffe-b846-e4c170a5ecc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:24.543044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3e1207-1813-4ffe-b846-e4c170a5ecc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:24.543512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3e1207-1813-4ffe-b846-e4c170a5ecc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:24.543935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3e1207-1813-4ffe-b846-e4c170a5ecc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:24.544637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3e1207-1813-4ffe-b846-e4c170a5ecc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:24.545110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3e1207-1813-4ffe-b846-e4c170a5ecc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:24.545525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3e1207-1813-4ffe-b846-e4c170a5ecc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:24.573185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0b3e1207-1813-4ffe-b846-e4c170a5ecc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040704 Aug 06 12:37:24.573723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 430/781] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:25.506654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5536492a-b213-4dd1-a4fd-574a3e41ea38 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:25.507340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5536492a-b213-4dd1-a4fd-574a3e41ea38 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:25.513655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5536492a-b213-4dd1-a4fd-574a3e41ea38 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:25.514134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5536492a-b213-4dd1-a4fd-574a3e41ea38 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:25.514568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5536492a-b213-4dd1-a4fd-574a3e41ea38 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:25.515255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5536492a-b213-4dd1-a4fd-574a3e41ea38 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:25.515712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5536492a-b213-4dd1-a4fd-574a3e41ea38 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:25.516143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5536492a-b213-4dd1-a4fd-574a3e41ea38 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:25.581702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5536492a-b213-4dd1-a4fd-574a3e41ea38 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:25.589798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5536492a-b213-4dd1-a4fd-574a3e41ea38 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.087463 Aug 06 12:37:25.590356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 431/782] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:25 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:25.594901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-835958bc-ca6e-4bf2-8788-114ccf4f936d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:25.597005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-835958bc-ca6e-4bf2-8788-114ccf4f936d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:25.602419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835958bc-ca6e-4bf2-8788-114ccf4f936d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:25.602895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835958bc-ca6e-4bf2-8788-114ccf4f936d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:25.603323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835958bc-ca6e-4bf2-8788-114ccf4f936d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:25.604002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835958bc-ca6e-4bf2-8788-114ccf4f936d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:25.604480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835958bc-ca6e-4bf2-8788-114ccf4f936d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:25.604901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835958bc-ca6e-4bf2-8788-114ccf4f936d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:25.633564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-835958bc-ca6e-4bf2-8788-114ccf4f936d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042199 Aug 06 12:37:25.634102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 432/783] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:25 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:25.638537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3bdee5fb-6ad7-42c5-b085-cc37dae9df4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:25.640548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3bdee5fb-6ad7-42c5-b085-cc37dae9df4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:25.645878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdee5fb-6ad7-42c5-b085-cc37dae9df4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:25.646353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdee5fb-6ad7-42c5-b085-cc37dae9df4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:25.646783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdee5fb-6ad7-42c5-b085-cc37dae9df4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:25.647448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdee5fb-6ad7-42c5-b085-cc37dae9df4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:25.647895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdee5fb-6ad7-42c5-b085-cc37dae9df4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:25.648328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdee5fb-6ad7-42c5-b085-cc37dae9df4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:25.675211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3bdee5fb-6ad7-42c5-b085-cc37dae9df4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040116 Aug 06 12:37:25.676229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 433/784] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:26.609378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d21dcb32-0bc2-4234-b624-7c414a2b9486 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:26.610050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d21dcb32-0bc2-4234-b624-7c414a2b9486 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:26.616569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d21dcb32-0bc2-4234-b624-7c414a2b9486 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:26.617040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d21dcb32-0bc2-4234-b624-7c414a2b9486 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:26.617466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d21dcb32-0bc2-4234-b624-7c414a2b9486 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:26.618138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d21dcb32-0bc2-4234-b624-7c414a2b9486 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:26.618585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d21dcb32-0bc2-4234-b624-7c414a2b9486 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:26.619013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d21dcb32-0bc2-4234-b624-7c414a2b9486 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:26.636111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:26.680165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d21dcb32-0bc2-4234-b624-7c414a2b9486 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:26.687680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d21dcb32-0bc2-4234-b624-7c414a2b9486 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082148 Aug 06 12:37:26.688240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 434/785] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:26 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:26.692836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-408fa830-9196-4834-85ef-eccd770f4418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:26.694921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-408fa830-9196-4834-85ef-eccd770f4418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:26.700474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-408fa830-9196-4834-85ef-eccd770f4418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:26.700958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-408fa830-9196-4834-85ef-eccd770f4418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:26.701396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-408fa830-9196-4834-85ef-eccd770f4418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:26.702078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-408fa830-9196-4834-85ef-eccd770f4418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:26.702529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-408fa830-9196-4834-85ef-eccd770f4418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:26.702949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-408fa830-9196-4834-85ef-eccd770f4418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:26.731419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-408fa830-9196-4834-85ef-eccd770f4418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042138 Aug 06 12:37:26.731960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 435/786] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:26.736814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0fe80d3b-c1dc-4cab-9f4e-a5fc185a6845 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:26.738881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0fe80d3b-c1dc-4cab-9f4e-a5fc185a6845 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:26.744249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fe80d3b-c1dc-4cab-9f4e-a5fc185a6845 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:26.744761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fe80d3b-c1dc-4cab-9f4e-a5fc185a6845 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:26.745193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fe80d3b-c1dc-4cab-9f4e-a5fc185a6845 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:26.745870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fe80d3b-c1dc-4cab-9f4e-a5fc185a6845 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:26.746323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fe80d3b-c1dc-4cab-9f4e-a5fc185a6845 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:26.746746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fe80d3b-c1dc-4cab-9f4e-a5fc185a6845 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:26.774904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0fe80d3b-c1dc-4cab-9f4e-a5fc185a6845 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041837 Aug 06 12:37:26.775475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 436/787] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:27.707428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-97ab0f79-3d03-41f0-ba25-b1557802b2f7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:27.708093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-97ab0f79-3d03-41f0-ba25-b1557802b2f7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:27.710338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:27.715626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97ab0f79-3d03-41f0-ba25-b1557802b2f7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:27.716097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97ab0f79-3d03-41f0-ba25-b1557802b2f7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:27.716551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97ab0f79-3d03-41f0-ba25-b1557802b2f7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:27.717239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97ab0f79-3d03-41f0-ba25-b1557802b2f7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:27.717690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97ab0f79-3d03-41f0-ba25-b1557802b2f7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:27.718109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97ab0f79-3d03-41f0-ba25-b1557802b2f7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:27.780774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-97ab0f79-3d03-41f0-ba25-b1557802b2f7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:27.788772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-97ab0f79-3d03-41f0-ba25-b1557802b2f7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085138 Aug 06 12:37:27.789335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 437/788] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:27 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:27.793899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-11ad669a-5d2a-4c04-8122-1127fdc9abfa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:27.795963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-11ad669a-5d2a-4c04-8122-1127fdc9abfa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:27.802092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ad669a-5d2a-4c04-8122-1127fdc9abfa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:27.802565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ad669a-5d2a-4c04-8122-1127fdc9abfa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:27.802992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ad669a-5d2a-4c04-8122-1127fdc9abfa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:27.803671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ad669a-5d2a-4c04-8122-1127fdc9abfa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:27.804117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ad669a-5d2a-4c04-8122-1127fdc9abfa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:27.804562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ad669a-5d2a-4c04-8122-1127fdc9abfa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:27.833018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-11ad669a-5d2a-4c04-8122-1127fdc9abfa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042664 Aug 06 12:37:27.833556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 438/789] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:27 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:27.838005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b7795900-77c9-483f-84e4-ea74ea62645b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:27.840006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b7795900-77c9-483f-84e4-ea74ea62645b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:27.845342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7795900-77c9-483f-84e4-ea74ea62645b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:27.845817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7795900-77c9-483f-84e4-ea74ea62645b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:27.846248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7795900-77c9-483f-84e4-ea74ea62645b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:27.846918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7795900-77c9-483f-84e4-ea74ea62645b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:27.847367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7795900-77c9-483f-84e4-ea74ea62645b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:27.848288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7795900-77c9-483f-84e4-ea74ea62645b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:27.876434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b7795900-77c9-483f-84e4-ea74ea62645b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041829 Aug 06 12:37:27.876975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 439/790] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:28.809350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-73c9a6d1-415d-45ef-89b1-2167cf1c7f59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:28.809981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-73c9a6d1-415d-45ef-89b1-2167cf1c7f59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:28.817059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c9a6d1-415d-45ef-89b1-2167cf1c7f59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:28.817538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c9a6d1-415d-45ef-89b1-2167cf1c7f59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:28.817970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c9a6d1-415d-45ef-89b1-2167cf1c7f59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:28.818651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c9a6d1-415d-45ef-89b1-2167cf1c7f59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:28.819100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c9a6d1-415d-45ef-89b1-2167cf1c7f59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:28.819521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c9a6d1-415d-45ef-89b1-2167cf1c7f59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:28.878737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-73c9a6d1-415d-45ef-89b1-2167cf1c7f59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:28.886958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-73c9a6d1-415d-45ef-89b1-2167cf1c7f59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081403 Aug 06 12:37:28.887520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 440/791] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:28 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:28.891972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19ed1b6c-a83e-438e-8f0c-7d342e476634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:28.894127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19ed1b6c-a83e-438e-8f0c-7d342e476634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:28.899632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ed1b6c-a83e-438e-8f0c-7d342e476634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:28.900112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ed1b6c-a83e-438e-8f0c-7d342e476634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:28.900581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ed1b6c-a83e-438e-8f0c-7d342e476634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:28.901261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ed1b6c-a83e-438e-8f0c-7d342e476634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:28.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ed1b6c-a83e-438e-8f0c-7d342e476634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:28.902129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ed1b6c-a83e-438e-8f0c-7d342e476634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:28.930036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19ed1b6c-a83e-438e-8f0c-7d342e476634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041491 Aug 06 12:37:28.930511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 441/792] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:28 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:28.934799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9a7931fe-c856-4f0b-bdf7-b2bb75997f4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:28.936839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9a7931fe-c856-4f0b-bdf7-b2bb75997f4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:28.942779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a7931fe-c856-4f0b-bdf7-b2bb75997f4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:28.943251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a7931fe-c856-4f0b-bdf7-b2bb75997f4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:28.943681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a7931fe-c856-4f0b-bdf7-b2bb75997f4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:28.944382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a7931fe-c856-4f0b-bdf7-b2bb75997f4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:28.944832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a7931fe-c856-4f0b-bdf7-b2bb75997f4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:28.945249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a7931fe-c856-4f0b-bdf7-b2bb75997f4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:28.973471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9a7931fe-c856-4f0b-bdf7-b2bb75997f4f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041313 Aug 06 12:37:28.974057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 442/793] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:29.907568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5a268aac-9aca-4863-9167-4711ff0e49e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:29.908222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5a268aac-9aca-4863-9167-4711ff0e49e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:29.914516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a268aac-9aca-4863-9167-4711ff0e49e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:29.914988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a268aac-9aca-4863-9167-4711ff0e49e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:29.915418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a268aac-9aca-4863-9167-4711ff0e49e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:29.916096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a268aac-9aca-4863-9167-4711ff0e49e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:29.916570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a268aac-9aca-4863-9167-4711ff0e49e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:29.916991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a268aac-9aca-4863-9167-4711ff0e49e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:29.977155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5a268aac-9aca-4863-9167-4711ff0e49e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:29.984680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5a268aac-9aca-4863-9167-4711ff0e49e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080956 Aug 06 12:37:29.985496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 443/794] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:29 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:29.990045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8d1c257d-5d05-43d4-8fc5-c71e1f890745 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:29.992129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8d1c257d-5d05-43d4-8fc5-c71e1f890745 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:29.997985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d1c257d-5d05-43d4-8fc5-c71e1f890745 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:29.998456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d1c257d-5d05-43d4-8fc5-c71e1f890745 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:29.998890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d1c257d-5d05-43d4-8fc5-c71e1f890745 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:29.999576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d1c257d-5d05-43d4-8fc5-c71e1f890745 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:30.000025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d1c257d-5d05-43d4-8fc5-c71e1f890745 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:30.000478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d1c257d-5d05-43d4-8fc5-c71e1f890745 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:30.029436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8d1c257d-5d05-43d4-8fc5-c71e1f890745 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Aug 06 12:37:30.029980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 444/795] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:29 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:30.034544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c324b9de-4212-4e01-97fc-ec79f8b0dc75 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:30.036641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c324b9de-4212-4e01-97fc-ec79f8b0dc75 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:30.042032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c324b9de-4212-4e01-97fc-ec79f8b0dc75 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:30.042509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c324b9de-4212-4e01-97fc-ec79f8b0dc75 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:30.042942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c324b9de-4212-4e01-97fc-ec79f8b0dc75 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:30.043620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c324b9de-4212-4e01-97fc-ec79f8b0dc75 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:30.044072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c324b9de-4212-4e01-97fc-ec79f8b0dc75 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:30.044525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c324b9de-4212-4e01-97fc-ec79f8b0dc75 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:30.072207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c324b9de-4212-4e01-97fc-ec79f8b0dc75 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041270 Aug 06 12:37:30.072769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 445/796] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:31.004269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90d812a5-f098-4f8d-815e-69cf132e2f37 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:31.004899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90d812a5-f098-4f8d-815e-69cf132e2f37 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:31.011278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90d812a5-f098-4f8d-815e-69cf132e2f37 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:31.011754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90d812a5-f098-4f8d-815e-69cf132e2f37 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:31.012198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90d812a5-f098-4f8d-815e-69cf132e2f37 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:31.012916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90d812a5-f098-4f8d-815e-69cf132e2f37 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:31.013367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90d812a5-f098-4f8d-815e-69cf132e2f37 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:31.013787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90d812a5-f098-4f8d-815e-69cf132e2f37 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:31.073754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90d812a5-f098-4f8d-815e-69cf132e2f37 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:31.081236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90d812a5-f098-4f8d-815e-69cf132e2f37 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080910 Aug 06 12:37:31.082302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 446/797] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:30 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:31.086802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5bb96872-a331-40b7-912d-36267bf16355 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:31.089098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5bb96872-a331-40b7-912d-36267bf16355 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:31.094900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bb96872-a331-40b7-912d-36267bf16355 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:31.095382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bb96872-a331-40b7-912d-36267bf16355 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:31.095816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bb96872-a331-40b7-912d-36267bf16355 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:31.096544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bb96872-a331-40b7-912d-36267bf16355 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:31.097004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bb96872-a331-40b7-912d-36267bf16355 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:31.098110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bb96872-a331-40b7-912d-36267bf16355 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:31.127327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5bb96872-a331-40b7-912d-36267bf16355 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Aug 06 12:37:31.127873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 447/798] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:31 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:31.132276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d438c97f-166f-4aeb-b919-fbbf23fd1ded tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:31.134328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d438c97f-166f-4aeb-b919-fbbf23fd1ded tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:31.139672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d438c97f-166f-4aeb-b919-fbbf23fd1ded tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:31.140150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d438c97f-166f-4aeb-b919-fbbf23fd1ded tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:31.140624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d438c97f-166f-4aeb-b919-fbbf23fd1ded tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:31.141309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d438c97f-166f-4aeb-b919-fbbf23fd1ded tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:31.141763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d438c97f-166f-4aeb-b919-fbbf23fd1ded tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:31.142186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d438c97f-166f-4aeb-b919-fbbf23fd1ded tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:31.170979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d438c97f-166f-4aeb-b919-fbbf23fd1ded tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042114 Aug 06 12:37:31.171512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 448/799] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:32.102515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-011837da-3c87-458f-a276-237901b238b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:32.103384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-011837da-3c87-458f-a276-237901b238b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:32.110621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011837da-3c87-458f-a276-237901b238b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:32.111101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011837da-3c87-458f-a276-237901b238b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:32.111530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011837da-3c87-458f-a276-237901b238b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:32.112205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011837da-3c87-458f-a276-237901b238b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:32.112685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011837da-3c87-458f-a276-237901b238b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:32.113174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-011837da-3c87-458f-a276-237901b238b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:32.177720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-011837da-3c87-458f-a276-237901b238b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:32.185152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-011837da-3c87-458f-a276-237901b238b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.087303 Aug 06 12:37:32.185707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 449/800] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:32 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:32.190242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-28018d09-5b48-4885-b42a-4ef963a1fef8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:32.192833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-28018d09-5b48-4885-b42a-4ef963a1fef8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:32.198235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28018d09-5b48-4885-b42a-4ef963a1fef8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:32.198713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28018d09-5b48-4885-b42a-4ef963a1fef8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:32.199143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28018d09-5b48-4885-b42a-4ef963a1fef8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:32.199817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28018d09-5b48-4885-b42a-4ef963a1fef8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:32.200265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28018d09-5b48-4885-b42a-4ef963a1fef8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:32.200710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28018d09-5b48-4885-b42a-4ef963a1fef8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:32.229209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-28018d09-5b48-4885-b42a-4ef963a1fef8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042276 Aug 06 12:37:32.229760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 450/801] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:32.234306 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-69381197-092a-4103-ab91-9101d7e5ebbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:32.236623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-69381197-092a-4103-ab91-9101d7e5ebbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:32.242083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69381197-092a-4103-ab91-9101d7e5ebbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:32.242544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69381197-092a-4103-ab91-9101d7e5ebbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:32.242971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69381197-092a-4103-ab91-9101d7e5ebbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:32.243644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69381197-092a-4103-ab91-9101d7e5ebbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:32.244090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69381197-092a-4103-ab91-9101d7e5ebbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:32.244535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69381197-092a-4103-ab91-9101d7e5ebbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:32.247974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:32.273696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-69381197-092a-4103-ab91-9101d7e5ebbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042907 Aug 06 12:37:32.274169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 451/802] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:33.205745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-de87b739-7394-48a2-b520-be4db276bd87 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:33.206419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-de87b739-7394-48a2-b520-be4db276bd87 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:33.212519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de87b739-7394-48a2-b520-be4db276bd87 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:33.212991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de87b739-7394-48a2-b520-be4db276bd87 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:33.213418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de87b739-7394-48a2-b520-be4db276bd87 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:33.214091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de87b739-7394-48a2-b520-be4db276bd87 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:33.214536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de87b739-7394-48a2-b520-be4db276bd87 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:33.214949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de87b739-7394-48a2-b520-be4db276bd87 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:33.275181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-de87b739-7394-48a2-b520-be4db276bd87 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:33.282606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-de87b739-7394-48a2-b520-be4db276bd87 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080669 Aug 06 12:37:33.283154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 452/803] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:33 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:33.287663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-45a20164-9380-4394-8c65-232c1b84c056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:33.290249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-45a20164-9380-4394-8c65-232c1b84c056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:33.295911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45a20164-9380-4394-8c65-232c1b84c056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:33.296419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45a20164-9380-4394-8c65-232c1b84c056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:33.296847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45a20164-9380-4394-8c65-232c1b84c056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:33.297522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45a20164-9380-4394-8c65-232c1b84c056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:33.297964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45a20164-9380-4394-8c65-232c1b84c056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:33.298385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45a20164-9380-4394-8c65-232c1b84c056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:33.327531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-45a20164-9380-4394-8c65-232c1b84c056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043412 Aug 06 12:37:33.328066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 453/804] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:33.332958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-213e9ca6-eed1-4b18-9b10-fd051c58302b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:33.336799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-213e9ca6-eed1-4b18-9b10-fd051c58302b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:33.342330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-213e9ca6-eed1-4b18-9b10-fd051c58302b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:33.342803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-213e9ca6-eed1-4b18-9b10-fd051c58302b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:33.343229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-213e9ca6-eed1-4b18-9b10-fd051c58302b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:33.343904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-213e9ca6-eed1-4b18-9b10-fd051c58302b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:33.344370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-213e9ca6-eed1-4b18-9b10-fd051c58302b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:33.344788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-213e9ca6-eed1-4b18-9b10-fd051c58302b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:33.373176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-213e9ca6-eed1-4b18-9b10-fd051c58302b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044138 Aug 06 12:37:33.373708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 454/805] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:34.303515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f5a246dc-af4b-4416-a013-8297b8918a2b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:34.304124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f5a246dc-af4b-4416-a013-8297b8918a2b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:34.310704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5a246dc-af4b-4416-a013-8297b8918a2b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:34.311180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5a246dc-af4b-4416-a013-8297b8918a2b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:34.311611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5a246dc-af4b-4416-a013-8297b8918a2b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:34.312295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5a246dc-af4b-4416-a013-8297b8918a2b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:34.312775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5a246dc-af4b-4416-a013-8297b8918a2b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:34.313195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5a246dc-af4b-4416-a013-8297b8918a2b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:34.377209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f5a246dc-af4b-4416-a013-8297b8918a2b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:34.387111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f5a246dc-af4b-4416-a013-8297b8918a2b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.087989 Aug 06 12:37:34.387673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 455/806] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:34 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:34.392174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1999aa4f-358b-4c18-9f2a-a853f824f5a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:34.394293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1999aa4f-358b-4c18-9f2a-a853f824f5a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:34.399884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1999aa4f-358b-4c18-9f2a-a853f824f5a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:34.400401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1999aa4f-358b-4c18-9f2a-a853f824f5a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:34.400830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1999aa4f-358b-4c18-9f2a-a853f824f5a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:34.401512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1999aa4f-358b-4c18-9f2a-a853f824f5a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:34.401964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1999aa4f-358b-4c18-9f2a-a853f824f5a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:34.402383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1999aa4f-358b-4c18-9f2a-a853f824f5a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:34.430963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1999aa4f-358b-4c18-9f2a-a853f824f5a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 Aug 06 12:37:34.431510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 456/807] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:34 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:34.435892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27e4838b-097d-4dbb-ac2e-af594ec34946 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:34.437983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27e4838b-097d-4dbb-ac2e-af594ec34946 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:34.443449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27e4838b-097d-4dbb-ac2e-af594ec34946 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:34.443923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27e4838b-097d-4dbb-ac2e-af594ec34946 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:34.444409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27e4838b-097d-4dbb-ac2e-af594ec34946 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:34.445070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27e4838b-097d-4dbb-ac2e-af594ec34946 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:34.445521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27e4838b-097d-4dbb-ac2e-af594ec34946 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:34.445944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27e4838b-097d-4dbb-ac2e-af594ec34946 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:34.475624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27e4838b-097d-4dbb-ac2e-af594ec34946 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043141 Aug 06 12:37:34.476165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 457/808] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:35.407061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b478d991-0dd0-48c8-9e7a-7677e4007676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:35.407682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b478d991-0dd0-48c8-9e7a-7677e4007676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:35.414797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b478d991-0dd0-48c8-9e7a-7677e4007676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:35.415272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b478d991-0dd0-48c8-9e7a-7677e4007676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:35.415704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b478d991-0dd0-48c8-9e7a-7677e4007676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:35.416411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b478d991-0dd0-48c8-9e7a-7677e4007676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:35.416864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b478d991-0dd0-48c8-9e7a-7677e4007676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:35.417284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b478d991-0dd0-48c8-9e7a-7677e4007676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:35.628287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b478d991-0dd0-48c8-9e7a-7677e4007676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:35.636354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b478d991-0dd0-48c8-9e7a-7677e4007676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.233130 Aug 06 12:37:35.636909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 458/809] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:35 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:35.641377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1a492b1b-35c0-43a0-840b-088346229ab4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:35.643436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1a492b1b-35c0-43a0-840b-088346229ab4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:35.648850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a492b1b-35c0-43a0-840b-088346229ab4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:35.649332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a492b1b-35c0-43a0-840b-088346229ab4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:35.649765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a492b1b-35c0-43a0-840b-088346229ab4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:35.650445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a492b1b-35c0-43a0-840b-088346229ab4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:35.650897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a492b1b-35c0-43a0-840b-088346229ab4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:35.651315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a492b1b-35c0-43a0-840b-088346229ab4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:35.679437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1a492b1b-35c0-43a0-840b-088346229ab4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041572 Aug 06 12:37:35.679966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 459/810] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:35 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:35.684275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5c37ae80-c73b-44d9-92b5-d2138cc40ed4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:35.686290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5c37ae80-c73b-44d9-92b5-d2138cc40ed4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:35.692232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c37ae80-c73b-44d9-92b5-d2138cc40ed4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:35.692742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c37ae80-c73b-44d9-92b5-d2138cc40ed4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:35.693178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c37ae80-c73b-44d9-92b5-d2138cc40ed4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:35.693852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c37ae80-c73b-44d9-92b5-d2138cc40ed4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:35.694305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c37ae80-c73b-44d9-92b5-d2138cc40ed4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:35.694730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c37ae80-c73b-44d9-92b5-d2138cc40ed4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:35.722535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5c37ae80-c73b-44d9-92b5-d2138cc40ed4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041082 Aug 06 12:37:35.723074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 460/811] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:36.656837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7188603c-41a5-4e6a-9b8a-e3ee6018204c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:36.657437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7188603c-41a5-4e6a-9b8a-e3ee6018204c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:36.664285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7188603c-41a5-4e6a-9b8a-e3ee6018204c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:36.664785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7188603c-41a5-4e6a-9b8a-e3ee6018204c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:36.665215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7188603c-41a5-4e6a-9b8a-e3ee6018204c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:36.665894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7188603c-41a5-4e6a-9b8a-e3ee6018204c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:36.666342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7188603c-41a5-4e6a-9b8a-e3ee6018204c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:36.666756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7188603c-41a5-4e6a-9b8a-e3ee6018204c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:36.728987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7188603c-41a5-4e6a-9b8a-e3ee6018204c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:36.736685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7188603c-41a5-4e6a-9b8a-e3ee6018204c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083665 Aug 06 12:37:36.737222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 461/812] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:36 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:36.742325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0247c824-f5f3-40aa-b270-9d9920ab8e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:36.744393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0247c824-f5f3-40aa-b270-9d9920ab8e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:36.749911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0247c824-f5f3-40aa-b270-9d9920ab8e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:36.750383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0247c824-f5f3-40aa-b270-9d9920ab8e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:36.750807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0247c824-f5f3-40aa-b270-9d9920ab8e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:36.751481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0247c824-f5f3-40aa-b270-9d9920ab8e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:36.751924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0247c824-f5f3-40aa-b270-9d9920ab8e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:36.752357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0247c824-f5f3-40aa-b270-9d9920ab8e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:36.781197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0247c824-f5f3-40aa-b270-9d9920ab8e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042328 Aug 06 12:37:36.781747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 462/813] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:36 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:36.786831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3275676d-8a30-470a-981e-22b74afb7306 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:36.788900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3275676d-8a30-470a-981e-22b74afb7306 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:36.794292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3275676d-8a30-470a-981e-22b74afb7306 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:36.794763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3275676d-8a30-470a-981e-22b74afb7306 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:36.795192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3275676d-8a30-470a-981e-22b74afb7306 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:36.795871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3275676d-8a30-470a-981e-22b74afb7306 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:36.796331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3275676d-8a30-470a-981e-22b74afb7306 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:36.796750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3275676d-8a30-470a-981e-22b74afb7306 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:36.829597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3275676d-8a30-470a-981e-22b74afb7306 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046763 Aug 06 12:37:36.830143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 463/814] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:37.757705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-35755472-2ced-4af9-b065-a17749e0bbc7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:37.758383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-35755472-2ced-4af9-b065-a17749e0bbc7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:37.764689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35755472-2ced-4af9-b065-a17749e0bbc7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:37.765167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35755472-2ced-4af9-b065-a17749e0bbc7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:37.765599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35755472-2ced-4af9-b065-a17749e0bbc7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:37.766280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35755472-2ced-4af9-b065-a17749e0bbc7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:37.766729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35755472-2ced-4af9-b065-a17749e0bbc7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:37.767149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35755472-2ced-4af9-b065-a17749e0bbc7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:37.828816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-35755472-2ced-4af9-b065-a17749e0bbc7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:37.836707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-35755472-2ced-4af9-b065-a17749e0bbc7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082822 Aug 06 12:37:37.837241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 464/815] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:37 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:37.841629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-85f40167-5b4e-42bf-b5d8-4e3a02b15b64 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:37.843680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-85f40167-5b4e-42bf-b5d8-4e3a02b15b64 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:37.849828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85f40167-5b4e-42bf-b5d8-4e3a02b15b64 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:37.850301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85f40167-5b4e-42bf-b5d8-4e3a02b15b64 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:37.850727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85f40167-5b4e-42bf-b5d8-4e3a02b15b64 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:37.851396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85f40167-5b4e-42bf-b5d8-4e3a02b15b64 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:37.851838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85f40167-5b4e-42bf-b5d8-4e3a02b15b64 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:37.852249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85f40167-5b4e-42bf-b5d8-4e3a02b15b64 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:37.879801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-85f40167-5b4e-42bf-b5d8-4e3a02b15b64 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041601 Aug 06 12:37:37.880380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 465/816] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:37.884675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dd27e578-f745-4554-8835-51e796ec54b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:37.886661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dd27e578-f745-4554-8835-51e796ec54b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:37.891889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd27e578-f745-4554-8835-51e796ec54b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:37.892390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd27e578-f745-4554-8835-51e796ec54b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:37.892816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd27e578-f745-4554-8835-51e796ec54b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:37.893479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd27e578-f745-4554-8835-51e796ec54b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:37.894428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd27e578-f745-4554-8835-51e796ec54b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:37.894842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd27e578-f745-4554-8835-51e796ec54b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:37.921992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dd27e578-f745-4554-8835-51e796ec54b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040671 Aug 06 12:37:37.922515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 466/817] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:38.857681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b8eee7e-651f-429b-af45-a78894803b79 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:38.858395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7b8eee7e-651f-429b-af45-a78894803b79 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:38.865596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b8eee7e-651f-429b-af45-a78894803b79 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:38.866101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b8eee7e-651f-429b-af45-a78894803b79 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:38.866531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b8eee7e-651f-429b-af45-a78894803b79 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:38.867211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b8eee7e-651f-429b-af45-a78894803b79 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:38.867661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b8eee7e-651f-429b-af45-a78894803b79 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:38.868083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b8eee7e-651f-429b-af45-a78894803b79 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:38.927910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7b8eee7e-651f-429b-af45-a78894803b79 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:38.931279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:38.935819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b8eee7e-651f-429b-af45-a78894803b79 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081960 Aug 06 12:37:38.936380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 467/818] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:38 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:38.940791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b60762c-f6b4-41a9-a506-f642427ec377 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:38.942864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7b60762c-f6b4-41a9-a506-f642427ec377 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:38.949026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b60762c-f6b4-41a9-a506-f642427ec377 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:38.949540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b60762c-f6b4-41a9-a506-f642427ec377 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:38.950002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b60762c-f6b4-41a9-a506-f642427ec377 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:38.950745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b60762c-f6b4-41a9-a506-f642427ec377 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:38.951194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b60762c-f6b4-41a9-a506-f642427ec377 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:38.951614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b60762c-f6b4-41a9-a506-f642427ec377 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:38.979612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b60762c-f6b4-41a9-a506-f642427ec377 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042269 Aug 06 12:37:38.980148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 468/819] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:38.984538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fe81517d-8f0b-455c-b22e-5d3f952f7c8d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:38.986807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fe81517d-8f0b-455c-b22e-5d3f952f7c8d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:38.992960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe81517d-8f0b-455c-b22e-5d3f952f7c8d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:38.993443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe81517d-8f0b-455c-b22e-5d3f952f7c8d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:38.993874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe81517d-8f0b-455c-b22e-5d3f952f7c8d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:38.994573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe81517d-8f0b-455c-b22e-5d3f952f7c8d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:38.995026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe81517d-8f0b-455c-b22e-5d3f952f7c8d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:38.995448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe81517d-8f0b-455c-b22e-5d3f952f7c8d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:39.023389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fe81517d-8f0b-455c-b22e-5d3f952f7c8d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042250 Aug 06 12:37:39.023935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 469/820] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:39.954908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7283e9ae-59b6-4e6c-84d5-c0b9c0611b40 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:39.955594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7283e9ae-59b6-4e6c-84d5-c0b9c0611b40 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:39.961889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7283e9ae-59b6-4e6c-84d5-c0b9c0611b40 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:39.962359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7283e9ae-59b6-4e6c-84d5-c0b9c0611b40 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:39.962810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7283e9ae-59b6-4e6c-84d5-c0b9c0611b40 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:39.963493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7283e9ae-59b6-4e6c-84d5-c0b9c0611b40 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:39.963942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7283e9ae-59b6-4e6c-84d5-c0b9c0611b40 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:39.964391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7283e9ae-59b6-4e6c-84d5-c0b9c0611b40 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:40.025627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7283e9ae-59b6-4e6c-84d5-c0b9c0611b40 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:40.033024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7283e9ae-59b6-4e6c-84d5-c0b9c0611b40 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081966 Aug 06 12:37:40.033567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 470/821] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:39 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:40.037948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-11dd947b-7d82-4294-b9a6-f15a2f932739 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:40.040013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-11dd947b-7d82-4294-b9a6-f15a2f932739 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:40.045521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11dd947b-7d82-4294-b9a6-f15a2f932739 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:40.045989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11dd947b-7d82-4294-b9a6-f15a2f932739 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:40.046418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11dd947b-7d82-4294-b9a6-f15a2f932739 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:40.047091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11dd947b-7d82-4294-b9a6-f15a2f932739 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:40.047533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11dd947b-7d82-4294-b9a6-f15a2f932739 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:40.047947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11dd947b-7d82-4294-b9a6-f15a2f932739 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:40.076700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-11dd947b-7d82-4294-b9a6-f15a2f932739 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042122 Aug 06 12:37:40.077241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 471/822] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:40 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:40.081599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-072f486d-1f50-4ca6-ba7a-d5d553b76d40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:40.083623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-072f486d-1f50-4ca6-ba7a-d5d553b76d40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:40.088994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-072f486d-1f50-4ca6-ba7a-d5d553b76d40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:40.089466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-072f486d-1f50-4ca6-ba7a-d5d553b76d40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:40.089897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-072f486d-1f50-4ca6-ba7a-d5d553b76d40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:40.090569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-072f486d-1f50-4ca6-ba7a-d5d553b76d40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:40.091019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-072f486d-1f50-4ca6-ba7a-d5d553b76d40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:40.091444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-072f486d-1f50-4ca6-ba7a-d5d553b76d40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:40.122037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-072f486d-1f50-4ca6-ba7a-d5d553b76d40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043787 Aug 06 12:37:40.122600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 472/823] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:41.052710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-37c0b4b3-6f6e-4dda-bbfc-ea247a0e773d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:41.053433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-37c0b4b3-6f6e-4dda-bbfc-ea247a0e773d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:41.059817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-37c0b4b3-6f6e-4dda-bbfc-ea247a0e773d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:41.060287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-37c0b4b3-6f6e-4dda-bbfc-ea247a0e773d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:41.060742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-37c0b4b3-6f6e-4dda-bbfc-ea247a0e773d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:41.061421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-37c0b4b3-6f6e-4dda-bbfc-ea247a0e773d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:41.061866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-37c0b4b3-6f6e-4dda-bbfc-ea247a0e773d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:41.062280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-37c0b4b3-6f6e-4dda-bbfc-ea247a0e773d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:41.132835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-37c0b4b3-6f6e-4dda-bbfc-ea247a0e773d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:41.140450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-37c0b4b3-6f6e-4dda-bbfc-ea247a0e773d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.091575 Aug 06 12:37:41.140998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 473/824] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:41 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:41.146562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4cf6855-0048-43d3-be1c-a60e47ba676a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:41.148657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4cf6855-0048-43d3-be1c-a60e47ba676a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:41.154253 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4cf6855-0048-43d3-be1c-a60e47ba676a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:41.154728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4cf6855-0048-43d3-be1c-a60e47ba676a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:41.155152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4cf6855-0048-43d3-be1c-a60e47ba676a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:41.155827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4cf6855-0048-43d3-be1c-a60e47ba676a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:41.156270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4cf6855-0048-43d3-be1c-a60e47ba676a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:41.156704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4cf6855-0048-43d3-be1c-a60e47ba676a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:41.184563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4cf6855-0048-43d3-be1c-a60e47ba676a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Aug 06 12:37:41.185095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 474/825] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:41 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:41.189432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6568d151-d5d6-4b5b-a105-96c0e8ef5b5e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:41.191933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6568d151-d5d6-4b5b-a105-96c0e8ef5b5e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:41.197225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6568d151-d5d6-4b5b-a105-96c0e8ef5b5e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:41.197689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6568d151-d5d6-4b5b-a105-96c0e8ef5b5e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:41.198117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6568d151-d5d6-4b5b-a105-96c0e8ef5b5e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:41.198777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6568d151-d5d6-4b5b-a105-96c0e8ef5b5e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:41.199219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6568d151-d5d6-4b5b-a105-96c0e8ef5b5e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:41.199636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6568d151-d5d6-4b5b-a105-96c0e8ef5b5e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:41.226998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6568d151-d5d6-4b5b-a105-96c0e8ef5b5e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040958 Aug 06 12:37:41.227528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 475/826] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:42.162666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-856d5c4c-0107-4c6e-9beb-0a74e3d91e15 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:42.163308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-856d5c4c-0107-4c6e-9beb-0a74e3d91e15 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:42.169769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-856d5c4c-0107-4c6e-9beb-0a74e3d91e15 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:42.170255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-856d5c4c-0107-4c6e-9beb-0a74e3d91e15 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:42.170688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-856d5c4c-0107-4c6e-9beb-0a74e3d91e15 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:42.171381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-856d5c4c-0107-4c6e-9beb-0a74e3d91e15 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:42.171830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-856d5c4c-0107-4c6e-9beb-0a74e3d91e15 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:42.172252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-856d5c4c-0107-4c6e-9beb-0a74e3d91e15 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:42.232232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-856d5c4c-0107-4c6e-9beb-0a74e3d91e15 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:42.240050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-856d5c4c-0107-4c6e-9beb-0a74e3d91e15 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081961 Aug 06 12:37:42.240642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 476/827] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:42 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:42.245243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ecab5013-70c6-4cae-9f82-311dca079c2f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:42.247332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ecab5013-70c6-4cae-9f82-311dca079c2f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:42.252972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecab5013-70c6-4cae-9f82-311dca079c2f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:42.253395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecab5013-70c6-4cae-9f82-311dca079c2f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:42.253825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecab5013-70c6-4cae-9f82-311dca079c2f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:42.254531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecab5013-70c6-4cae-9f82-311dca079c2f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:42.254979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecab5013-70c6-4cae-9f82-311dca079c2f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:42.255398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ecab5013-70c6-4cae-9f82-311dca079c2f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:42.283171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ecab5013-70c6-4cae-9f82-311dca079c2f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041513 Aug 06 12:37:42.283744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 477/828] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:42 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:42.289113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-70f28735-5fc5-4479-b35e-f687d23c3134 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:42.291140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-70f28735-5fc5-4479-b35e-f687d23c3134 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:42.296472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70f28735-5fc5-4479-b35e-f687d23c3134 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:42.296949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70f28735-5fc5-4479-b35e-f687d23c3134 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:42.297378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70f28735-5fc5-4479-b35e-f687d23c3134 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:42.298044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70f28735-5fc5-4479-b35e-f687d23c3134 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:42.298499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70f28735-5fc5-4479-b35e-f687d23c3134 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:42.298919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70f28735-5fc5-4479-b35e-f687d23c3134 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:42.325973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-70f28735-5fc5-4479-b35e-f687d23c3134 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040367 Aug 06 12:37:42.326509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 478/829] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:43.260255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-208d64c1-ba11-4b28-82ca-97920dba72af tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:43.260911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-208d64c1-ba11-4b28-82ca-97920dba72af tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:43.267180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-208d64c1-ba11-4b28-82ca-97920dba72af tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:43.267655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-208d64c1-ba11-4b28-82ca-97920dba72af tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:43.268088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-208d64c1-ba11-4b28-82ca-97920dba72af tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:43.268862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-208d64c1-ba11-4b28-82ca-97920dba72af tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:43.269314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-208d64c1-ba11-4b28-82ca-97920dba72af tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:43.269731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-208d64c1-ba11-4b28-82ca-97920dba72af tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:43.329011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-208d64c1-ba11-4b28-82ca-97920dba72af tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:43.336349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-208d64c1-ba11-4b28-82ca-97920dba72af tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080040 Aug 06 12:37:43.336931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 479/830] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:43 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:43.341374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-07237fe0-6669-4865-ae13-13d5d70011a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:43.343464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-07237fe0-6669-4865-ae13-13d5d70011a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:43.349430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07237fe0-6669-4865-ae13-13d5d70011a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:43.349935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07237fe0-6669-4865-ae13-13d5d70011a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:43.350370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07237fe0-6669-4865-ae13-13d5d70011a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:43.351047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07237fe0-6669-4865-ae13-13d5d70011a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:43.351495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07237fe0-6669-4865-ae13-13d5d70011a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:43.351914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07237fe0-6669-4865-ae13-13d5d70011a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:43.380315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-07237fe0-6669-4865-ae13-13d5d70011a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042403 Aug 06 12:37:43.380854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 480/831] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:43.385188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-612e9c4e-3d46-4dfc-bf68-a7b737602395 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:43.387282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-612e9c4e-3d46-4dfc-bf68-a7b737602395 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:43.392660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-612e9c4e-3d46-4dfc-bf68-a7b737602395 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:43.393135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-612e9c4e-3d46-4dfc-bf68-a7b737602395 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:43.393597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-612e9c4e-3d46-4dfc-bf68-a7b737602395 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:43.394268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-612e9c4e-3d46-4dfc-bf68-a7b737602395 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:43.394715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-612e9c4e-3d46-4dfc-bf68-a7b737602395 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:43.395134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-612e9c4e-3d46-4dfc-bf68-a7b737602395 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:43.422619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-612e9c4e-3d46-4dfc-bf68-a7b737602395 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040830 Aug 06 12:37:43.423151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 481/832] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:44.356259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61fd6740-e351-4b88-9c1f-dcc206d3ac7e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:44.356912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61fd6740-e351-4b88-9c1f-dcc206d3ac7e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:44.363958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61fd6740-e351-4b88-9c1f-dcc206d3ac7e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:44.364466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61fd6740-e351-4b88-9c1f-dcc206d3ac7e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:44.364900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61fd6740-e351-4b88-9c1f-dcc206d3ac7e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:44.365578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61fd6740-e351-4b88-9c1f-dcc206d3ac7e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:44.366028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61fd6740-e351-4b88-9c1f-dcc206d3ac7e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:44.366447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61fd6740-e351-4b88-9c1f-dcc206d3ac7e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:44.426916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61fd6740-e351-4b88-9c1f-dcc206d3ac7e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:44.434311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61fd6740-e351-4b88-9c1f-dcc206d3ac7e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081842 Aug 06 12:37:44.434861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 482/833] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:44 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:44.439290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-72b4029b-2f05-4dfc-ba02-6999e3d49092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:44.442145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-72b4029b-2f05-4dfc-ba02-6999e3d49092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:44.448589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72b4029b-2f05-4dfc-ba02-6999e3d49092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:44.449082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72b4029b-2f05-4dfc-ba02-6999e3d49092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:44.449518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72b4029b-2f05-4dfc-ba02-6999e3d49092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:44.450207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72b4029b-2f05-4dfc-ba02-6999e3d49092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:44.450654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72b4029b-2f05-4dfc-ba02-6999e3d49092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:44.451070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72b4029b-2f05-4dfc-ba02-6999e3d49092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:44.479937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-72b4029b-2f05-4dfc-ba02-6999e3d49092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Aug 06 12:37:44.480527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 483/834] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:44.485222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd5df2a7-4519-40e7-8a4d-a1e2f1c62fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:44.487787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd5df2a7-4519-40e7-8a4d-a1e2f1c62fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:44.493231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd5df2a7-4519-40e7-8a4d-a1e2f1c62fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:44.493707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd5df2a7-4519-40e7-8a4d-a1e2f1c62fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:44.494142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd5df2a7-4519-40e7-8a4d-a1e2f1c62fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:44.494823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd5df2a7-4519-40e7-8a4d-a1e2f1c62fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:44.495273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd5df2a7-4519-40e7-8a4d-a1e2f1c62fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:44.495689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd5df2a7-4519-40e7-8a4d-a1e2f1c62fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:44.512252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:44.525223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd5df2a7-4519-40e7-8a4d-a1e2f1c62fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043727 Aug 06 12:37:44.525776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 484/835] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:45.455015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4187cbac-a14a-49cc-b0b4-9a96fd70ca17 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:45.455680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4187cbac-a14a-49cc-b0b4-9a96fd70ca17 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:45.462645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4187cbac-a14a-49cc-b0b4-9a96fd70ca17 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:45.463120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4187cbac-a14a-49cc-b0b4-9a96fd70ca17 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:45.463554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4187cbac-a14a-49cc-b0b4-9a96fd70ca17 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:45.464240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4187cbac-a14a-49cc-b0b4-9a96fd70ca17 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:45.464723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4187cbac-a14a-49cc-b0b4-9a96fd70ca17 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:45.465151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4187cbac-a14a-49cc-b0b4-9a96fd70ca17 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:45.529100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4187cbac-a14a-49cc-b0b4-9a96fd70ca17 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:45.536533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4187cbac-a14a-49cc-b0b4-9a96fd70ca17 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085473 Aug 06 12:37:45.537082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 485/836] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:45 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:45.541476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-18a1c4fb-1ba9-4d8a-ba72-ef0bc41acccc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:45.543561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-18a1c4fb-1ba9-4d8a-ba72-ef0bc41acccc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:45.549021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18a1c4fb-1ba9-4d8a-ba72-ef0bc41acccc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:45.549493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18a1c4fb-1ba9-4d8a-ba72-ef0bc41acccc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:45.549919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18a1c4fb-1ba9-4d8a-ba72-ef0bc41acccc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:45.550604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18a1c4fb-1ba9-4d8a-ba72-ef0bc41acccc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:45.551150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18a1c4fb-1ba9-4d8a-ba72-ef0bc41acccc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:45.551611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18a1c4fb-1ba9-4d8a-ba72-ef0bc41acccc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:45.579954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-18a1c4fb-1ba9-4d8a-ba72-ef0bc41acccc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041919 Aug 06 12:37:45.585145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 486/837] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:45.585553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ea2ed05f-6b4a-4d57-9841-57bc9db45257 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:45.587590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ea2ed05f-6b4a-4d57-9841-57bc9db45257 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:45.589198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:45.594180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2ed05f-6b4a-4d57-9841-57bc9db45257 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:45.594650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2ed05f-6b4a-4d57-9841-57bc9db45257 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:45.595073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2ed05f-6b4a-4d57-9841-57bc9db45257 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:45.595742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2ed05f-6b4a-4d57-9841-57bc9db45257 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:45.596185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2ed05f-6b4a-4d57-9841-57bc9db45257 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:45.596673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2ed05f-6b4a-4d57-9841-57bc9db45257 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:45.624045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ea2ed05f-6b4a-4d57-9841-57bc9db45257 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041930 Aug 06 12:37:45.624627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 487/838] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:46.556127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-17279ca6-69b9-456e-83b3-bbc48542fc59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:46.556823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-17279ca6-69b9-456e-83b3-bbc48542fc59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:46.563099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17279ca6-69b9-456e-83b3-bbc48542fc59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:46.563583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17279ca6-69b9-456e-83b3-bbc48542fc59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:46.564014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17279ca6-69b9-456e-83b3-bbc48542fc59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:46.564729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17279ca6-69b9-456e-83b3-bbc48542fc59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:46.565673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17279ca6-69b9-456e-83b3-bbc48542fc59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:46.566096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17279ca6-69b9-456e-83b3-bbc48542fc59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:46.627345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-17279ca6-69b9-456e-83b3-bbc48542fc59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:46.635583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-17279ca6-69b9-456e-83b3-bbc48542fc59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083258 Aug 06 12:37:46.636138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 488/839] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:46 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:46.640631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad36ef3b-b3e0-4bfb-a855-61a03da28c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:46.642739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad36ef3b-b3e0-4bfb-a855-61a03da28c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:46.648248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad36ef3b-b3e0-4bfb-a855-61a03da28c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:46.648758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad36ef3b-b3e0-4bfb-a855-61a03da28c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:46.649191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad36ef3b-b3e0-4bfb-a855-61a03da28c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:46.649866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad36ef3b-b3e0-4bfb-a855-61a03da28c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:46.650316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad36ef3b-b3e0-4bfb-a855-61a03da28c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:46.650735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad36ef3b-b3e0-4bfb-a855-61a03da28c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:46.679016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad36ef3b-b3e0-4bfb-a855-61a03da28c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041611 Aug 06 12:37:46.679264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 489/840] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:46.683637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5c5420ed-3410-48ed-bee0-ff404cf681dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:46.685724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5c5420ed-3410-48ed-bee0-ff404cf681dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:46.691716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c5420ed-3410-48ed-bee0-ff404cf681dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:46.692191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c5420ed-3410-48ed-bee0-ff404cf681dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:46.692662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c5420ed-3410-48ed-bee0-ff404cf681dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:46.693329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c5420ed-3410-48ed-bee0-ff404cf681dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:46.693780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c5420ed-3410-48ed-bee0-ff404cf681dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:46.694199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c5420ed-3410-48ed-bee0-ff404cf681dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:46.721703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5c5420ed-3410-48ed-bee0-ff404cf681dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041474 Aug 06 12:37:46.722236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 490/841] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:47.656068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-957c1db3-87d8-4997-bc4a-348ea909fa6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:47.656777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-957c1db3-87d8-4997-bc4a-348ea909fa6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:47.663688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957c1db3-87d8-4997-bc4a-348ea909fa6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:47.664158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957c1db3-87d8-4997-bc4a-348ea909fa6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:47.664624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957c1db3-87d8-4997-bc4a-348ea909fa6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:47.665301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957c1db3-87d8-4997-bc4a-348ea909fa6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:47.665852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957c1db3-87d8-4997-bc4a-348ea909fa6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:47.666270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957c1db3-87d8-4997-bc4a-348ea909fa6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:47.727157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-957c1db3-87d8-4997-bc4a-348ea909fa6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:47.734509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-957c1db3-87d8-4997-bc4a-348ea909fa6c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082264 Aug 06 12:37:47.735324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 491/842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:47 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:47.739748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2057deff-7953-45f7-9a5b-3c5a2a79ffeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:47.741848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2057deff-7953-45f7-9a5b-3c5a2a79ffeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:47.747260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2057deff-7953-45f7-9a5b-3c5a2a79ffeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:47.747729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2057deff-7953-45f7-9a5b-3c5a2a79ffeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:47.748151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2057deff-7953-45f7-9a5b-3c5a2a79ffeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:47.748858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2057deff-7953-45f7-9a5b-3c5a2a79ffeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:47.749332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2057deff-7953-45f7-9a5b-3c5a2a79ffeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:47.749746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2057deff-7953-45f7-9a5b-3c5a2a79ffeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:47.778467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2057deff-7953-45f7-9a5b-3c5a2a79ffeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042169 Aug 06 12:37:47.778999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 492/843] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:47.783350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-48220770-5547-4edb-84e1-25d151b8687e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:47.785414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-48220770-5547-4edb-84e1-25d151b8687e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:47.791003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48220770-5547-4edb-84e1-25d151b8687e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:47.791478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48220770-5547-4edb-84e1-25d151b8687e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:47.791907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48220770-5547-4edb-84e1-25d151b8687e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:47.792618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48220770-5547-4edb-84e1-25d151b8687e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:47.793064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48220770-5547-4edb-84e1-25d151b8687e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:47.793500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48220770-5547-4edb-84e1-25d151b8687e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:47.821704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-48220770-5547-4edb-84e1-25d151b8687e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041737 Aug 06 12:37:47.822247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 493/844] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:48.803144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e973711e-daf8-4c94-ab48-6ddea6763870 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:48.803747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e973711e-daf8-4c94-ab48-6ddea6763870 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:48.809612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e973711e-daf8-4c94-ab48-6ddea6763870 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:48.810083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e973711e-daf8-4c94-ab48-6ddea6763870 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:48.810509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e973711e-daf8-4c94-ab48-6ddea6763870 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:48.811183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e973711e-daf8-4c94-ab48-6ddea6763870 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:48.811633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e973711e-daf8-4c94-ab48-6ddea6763870 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:48.812050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e973711e-daf8-4c94-ab48-6ddea6763870 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:48.872578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e973711e-daf8-4c94-ab48-6ddea6763870 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:48.880396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e973711e-daf8-4c94-ab48-6ddea6763870 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.129486 Aug 06 12:37:48.880950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 494/845] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:48 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:48.885374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-28354eed-aba7-45e0-ab10-fb94b4e9a88e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:48.887602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-28354eed-aba7-45e0-ab10-fb94b4e9a88e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:48.893072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28354eed-aba7-45e0-ab10-fb94b4e9a88e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:48.893551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28354eed-aba7-45e0-ab10-fb94b4e9a88e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:48.893989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28354eed-aba7-45e0-ab10-fb94b4e9a88e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:48.894661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28354eed-aba7-45e0-ab10-fb94b4e9a88e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:48.895167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28354eed-aba7-45e0-ab10-fb94b4e9a88e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:48.895582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28354eed-aba7-45e0-ab10-fb94b4e9a88e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:48.922813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-28354eed-aba7-45e0-ab10-fb94b4e9a88e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040901 Aug 06 12:37:48.923350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 495/846] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:48.928163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1b269816-67b9-496e-bf90-f781512c8c76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:48.930247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1b269816-67b9-496e-bf90-f781512c8c76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:48.935445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b269816-67b9-496e-bf90-f781512c8c76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:48.935919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b269816-67b9-496e-bf90-f781512c8c76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:48.936375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b269816-67b9-496e-bf90-f781512c8c76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:48.937043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b269816-67b9-496e-bf90-f781512c8c76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:48.937487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b269816-67b9-496e-bf90-f781512c8c76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:48.937901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b269816-67b9-496e-bf90-f781512c8c76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:48.965515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1b269816-67b9-496e-bf90-f781512c8c76 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041223 Aug 06 12:37:48.966041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 496/847] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:49.899680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0305493f-c079-4c72-b3ae-d60edd14f661 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:49.900355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0305493f-c079-4c72-b3ae-d60edd14f661 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:49.906754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0305493f-c079-4c72-b3ae-d60edd14f661 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:49.907232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0305493f-c079-4c72-b3ae-d60edd14f661 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:49.907664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0305493f-c079-4c72-b3ae-d60edd14f661 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:49.908368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0305493f-c079-4c72-b3ae-d60edd14f661 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:49.908847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0305493f-c079-4c72-b3ae-d60edd14f661 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:49.909269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0305493f-c079-4c72-b3ae-d60edd14f661 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:49.972408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0305493f-c079-4c72-b3ae-d60edd14f661 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:49.979857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0305493f-c079-4c72-b3ae-d60edd14f661 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084028 Aug 06 12:37:49.980430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 497/848] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:49 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:49.985106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f40b3a11-236d-4cec-b4df-ac6b8ad46270 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:49.987785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f40b3a11-236d-4cec-b4df-ac6b8ad46270 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:49.993479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f40b3a11-236d-4cec-b4df-ac6b8ad46270 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:49.993954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f40b3a11-236d-4cec-b4df-ac6b8ad46270 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:49.998178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f40b3a11-236d-4cec-b4df-ac6b8ad46270 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:49.998178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f40b3a11-236d-4cec-b4df-ac6b8ad46270 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:49.998178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f40b3a11-236d-4cec-b4df-ac6b8ad46270 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:49.998178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f40b3a11-236d-4cec-b4df-ac6b8ad46270 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:50.025528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f40b3a11-236d-4cec-b4df-ac6b8ad46270 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Aug 06 12:37:50.026076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 498/849] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:50.030458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-62d54447-87e3-4a81-a1be-1ed31a870eb7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:50.032546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-62d54447-87e3-4a81-a1be-1ed31a870eb7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:50.037909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d54447-87e3-4a81-a1be-1ed31a870eb7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:50.038381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d54447-87e3-4a81-a1be-1ed31a870eb7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:50.038807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d54447-87e3-4a81-a1be-1ed31a870eb7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:50.039480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d54447-87e3-4a81-a1be-1ed31a870eb7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:50.039926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d54447-87e3-4a81-a1be-1ed31a870eb7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:50.040363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d54447-87e3-4a81-a1be-1ed31a870eb7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:50.068139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-62d54447-87e3-4a81-a1be-1ed31a870eb7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041106 Aug 06 12:37:50.068709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 499/850] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:51.000424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d9ec709-3923-4b96-9b1e-7fd3975e7c0e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:51.001038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d9ec709-3923-4b96-9b1e-7fd3975e7c0e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:51.007934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d9ec709-3923-4b96-9b1e-7fd3975e7c0e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:51.008441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d9ec709-3923-4b96-9b1e-7fd3975e7c0e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:51.008877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d9ec709-3923-4b96-9b1e-7fd3975e7c0e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:51.009562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d9ec709-3923-4b96-9b1e-7fd3975e7c0e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:51.010015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d9ec709-3923-4b96-9b1e-7fd3975e7c0e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:51.010438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d9ec709-3923-4b96-9b1e-7fd3975e7c0e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:51.071072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d9ec709-3923-4b96-9b1e-7fd3975e7c0e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:51.078427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d9ec709-3923-4b96-9b1e-7fd3975e7c0e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081867 Aug 06 12:37:51.078981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 500/851] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:50 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:51.084047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f3d27586-d4bd-4594-b9a3-4589b46d6e95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:51.086183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f3d27586-d4bd-4594-b9a3-4589b46d6e95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:51.091713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3d27586-d4bd-4594-b9a3-4589b46d6e95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:51.092190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3d27586-d4bd-4594-b9a3-4589b46d6e95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:51.092652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3d27586-d4bd-4594-b9a3-4589b46d6e95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:51.093328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3d27586-d4bd-4594-b9a3-4589b46d6e95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:51.093780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3d27586-d4bd-4594-b9a3-4589b46d6e95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:51.094198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3d27586-d4bd-4594-b9a3-4589b46d6e95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:51.097809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:37:51.123130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f3d27586-d4bd-4594-b9a3-4589b46d6e95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043175 Aug 06 12:37:51.123670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 501/852] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:51.128649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96463d73-5773-4337-a8e0-eaedbbf9ab84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:51.130701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-96463d73-5773-4337-a8e0-eaedbbf9ab84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:51.136062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96463d73-5773-4337-a8e0-eaedbbf9ab84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:51.136573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96463d73-5773-4337-a8e0-eaedbbf9ab84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:51.137007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96463d73-5773-4337-a8e0-eaedbbf9ab84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:51.137682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96463d73-5773-4337-a8e0-eaedbbf9ab84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:51.138130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96463d73-5773-4337-a8e0-eaedbbf9ab84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:51.138557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96463d73-5773-4337-a8e0-eaedbbf9ab84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:51.165976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-96463d73-5773-4337-a8e0-eaedbbf9ab84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041354 Aug 06 12:37:51.166509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 502/853] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:52.099480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3dcef9a9-f931-4bc3-bc64-42dc5b36f2ac tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:52.100093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3dcef9a9-f931-4bc3-bc64-42dc5b36f2ac tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:52.106560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dcef9a9-f931-4bc3-bc64-42dc5b36f2ac tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:52.107046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dcef9a9-f931-4bc3-bc64-42dc5b36f2ac tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:52.107483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dcef9a9-f931-4bc3-bc64-42dc5b36f2ac tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:52.108166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dcef9a9-f931-4bc3-bc64-42dc5b36f2ac tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:52.108651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dcef9a9-f931-4bc3-bc64-42dc5b36f2ac tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:52.109072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dcef9a9-f931-4bc3-bc64-42dc5b36f2ac tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:52.170711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3dcef9a9-f931-4bc3-bc64-42dc5b36f2ac tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:37:52.178869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3dcef9a9-f931-4bc3-bc64-42dc5b36f2ac tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083293 Aug 06 12:37:52.179421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 503/854] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:37:52 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:37:52.183958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5740a0a5-ecbd-4d19-8101-5e4202b82f0e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:52.186071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5740a0a5-ecbd-4d19-8101-5e4202b82f0e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:52.192374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5740a0a5-ecbd-4d19-8101-5e4202b82f0e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:52.192886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5740a0a5-ecbd-4d19-8101-5e4202b82f0e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:52.193362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5740a0a5-ecbd-4d19-8101-5e4202b82f0e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:52.194078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5740a0a5-ecbd-4d19-8101-5e4202b82f0e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:52.194529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5740a0a5-ecbd-4d19-8101-5e4202b82f0e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:52.194949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5740a0a5-ecbd-4d19-8101-5e4202b82f0e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:52.223416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5740a0a5-ecbd-4d19-8101-5e4202b82f0e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042965 Aug 06 12:37:52.224016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 504/855] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:37:52 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:37:52.228691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b2fc605e-b45c-4275-a6de-848a69810cb4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:52.230789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b2fc605e-b45c-4275-a6de-848a69810cb4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:52.236497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fc605e-b45c-4275-a6de-848a69810cb4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:52.237568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fc605e-b45c-4275-a6de-848a69810cb4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:52.238002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fc605e-b45c-4275-a6de-848a69810cb4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:52.238687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fc605e-b45c-4275-a6de-848a69810cb4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:52.239143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fc605e-b45c-4275-a6de-848a69810cb4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:52.239570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fc605e-b45c-4275-a6de-848a69810cb4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:52.267076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b2fc605e-b45c-4275-a6de-848a69810cb4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042026 Aug 06 12:37:52.267550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 505/856] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:37:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:37:52.475102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:37:52.475619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:37:52.481521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:52.482004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:52.482442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:37:52.483137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:37:52.483595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:37:52.484022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:02.479513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=39 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:38:02.502033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=32 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:38:22.403061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Cannot 'detach_volume' instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e while it is in vm_state rescued Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa HTTP/1.1 Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:38:22.404719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:38:22.406304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Cannot 'detach_volume' instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e while it is in vm_state rescued Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': '7a8a8915-eeca-4909-aab7-6fe8381ced6e', 'id': 'd1b59212-9312-4893-97c3-6c27d1ef81aa'} Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:38:22.407121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e while it is in vm_state rescued Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e while it is in vm_state rescued Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:38:22.408703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 409 to user: Cannot 'detach_volume' instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e while it is in vm_state rescued {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:38:22.409911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c3bff5eb-bc6a-4485-82ab-d72afaa3122f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa" status: 409 len: 152 microversion: 2.1 time: 89.993615 Aug 06 12:38:22.409911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 352/857] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:36:52 2022] DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa => generated 152 bytes in 89995 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 12:38:22.412530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5162f0f6-f741-4f5e-85a6-956ae586fdeb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:22.413133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5162f0f6-f741-4f5e-85a6-956ae586fdeb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:22.424743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5162f0f6-f741-4f5e-85a6-956ae586fdeb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:22.425231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5162f0f6-f741-4f5e-85a6-956ae586fdeb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:22.425662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5162f0f6-f741-4f5e-85a6-956ae586fdeb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:22.426977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5162f0f6-f741-4f5e-85a6-956ae586fdeb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:22.427435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5162f0f6-f741-4f5e-85a6-956ae586fdeb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:22.427857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5162f0f6-f741-4f5e-85a6-956ae586fdeb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:22.505665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5162f0f6-f741-4f5e-85a6-956ae586fdeb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:22.505825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Cannot 'detach_volume' instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e while it is in vm_state rescued Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa HTTP/1.1 Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:38:22.507463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 12:38:22.508785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Cannot 'detach_volume' instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e while it is in vm_state rescued Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '7a8a8915-eeca-4909-aab7-6fe8381ced6e', 'id': 'd1b59212-9312-4893-97c3-6c27d1ef81aa'} Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:38:22.509452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e while it is in vm_state rescued Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e while it is in vm_state rescued Aug 06 12:38:22.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:38:22.512733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 409 to user: Cannot 'detach_volume' instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e while it is in vm_state rescued {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:38:22.513508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5162f0f6-f741-4f5e-85a6-956ae586fdeb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.105587 Aug 06 12:38:22.513848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-64a1136b-cf49-4043-b8d9-25741cab788e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa" status: 409 len: 152 microversion: 2.1 time: 30.042716 Aug 06 12:38:22.514474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 506/858] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:37:52 2022] DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa => generated 152 bytes in 30044 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 06 12:38:22.520862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6b5da69e-2080-4b4f-9632-9d48016eeb72 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:22.523377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6b5da69e-2080-4b4f-9632-9d48016eeb72 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:22.525510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 353/859] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:22 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:22.530404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b5da69e-2080-4b4f-9632-9d48016eeb72 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:22.530626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9c256c6c-016b-4947-b531-2eed5c9e6868 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:22.531060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b5da69e-2080-4b4f-9632-9d48016eeb72 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:22.531564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b5da69e-2080-4b4f-9632-9d48016eeb72 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:22.532403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b5da69e-2080-4b4f-9632-9d48016eeb72 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:22.532946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b5da69e-2080-4b4f-9632-9d48016eeb72 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:22.533061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9c256c6c-016b-4947-b531-2eed5c9e6868 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:22.533515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b5da69e-2080-4b4f-9632-9d48016eeb72 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:22.539597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c256c6c-016b-4947-b531-2eed5c9e6868 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:22.540082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c256c6c-016b-4947-b531-2eed5c9e6868 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:22.540630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c256c6c-016b-4947-b531-2eed5c9e6868 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:22.541324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c256c6c-016b-4947-b531-2eed5c9e6868 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:22.541844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c256c6c-016b-4947-b531-2eed5c9e6868 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:22.542269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c256c6c-016b-4947-b531-2eed5c9e6868 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:22.562864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6b5da69e-2080-4b4f-9632-9d48016eeb72 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046993 Aug 06 12:38:22.563414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 507/860] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:22 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:22.568175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-99f00012-ba7e-443c-831d-b28ac9d5e394 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:38:22.568726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-99f00012-ba7e-443c-831d-b28ac9d5e394 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:22.571294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9c256c6c-016b-4947-b531-2eed5c9e6868 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044640 Aug 06 12:38:22.571910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 354/861] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:22.574344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f00012-ba7e-443c-831d-b28ac9d5e394 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:22.574828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f00012-ba7e-443c-831d-b28ac9d5e394 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:22.575262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f00012-ba7e-443c-831d-b28ac9d5e394 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:22.575946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f00012-ba7e-443c-831d-b28ac9d5e394 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:22.576422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f00012-ba7e-443c-831d-b28ac9d5e394 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:22.576846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f00012-ba7e-443c-831d-b28ac9d5e394 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:22.642432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-99f00012-ba7e-443c-831d-b28ac9d5e394 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/action" status: 202 len: 0 microversion: 2.1 time: 0.077545 Aug 06 12:38:22.642987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 508/862] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 12:38:22 2022] POST /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:38:22.651706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d42df179-5f2d-42a1-a9ba-3974d0ca43bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:22.652492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d42df179-5f2d-42a1-a9ba-3974d0ca43bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:22.658162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d42df179-5f2d-42a1-a9ba-3974d0ca43bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:22.658664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d42df179-5f2d-42a1-a9ba-3974d0ca43bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:22.659176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d42df179-5f2d-42a1-a9ba-3974d0ca43bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:22.659957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d42df179-5f2d-42a1-a9ba-3974d0ca43bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:22.660436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d42df179-5f2d-42a1-a9ba-3974d0ca43bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:22.661543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d42df179-5f2d-42a1-a9ba-3974d0ca43bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:22.792600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d42df179-5f2d-42a1-a9ba-3974d0ca43bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:22.800677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d42df179-5f2d-42a1-a9ba-3974d0ca43bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1724 microversion: 2.1 time: 0.152683 Aug 06 12:38:22.801232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 355/863] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:23.536150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c9614788-93e5-4ee7-be20-4dc9ba380f84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:23.536872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c9614788-93e5-4ee7-be20-4dc9ba380f84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:23.543539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9614788-93e5-4ee7-be20-4dc9ba380f84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:23.544050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9614788-93e5-4ee7-be20-4dc9ba380f84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:23.544519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9614788-93e5-4ee7-be20-4dc9ba380f84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:23.545206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9614788-93e5-4ee7-be20-4dc9ba380f84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:23.545662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9614788-93e5-4ee7-be20-4dc9ba380f84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:23.546085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9614788-93e5-4ee7-be20-4dc9ba380f84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:23.574897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5d543198-99db-411f-9acd-4803cd9c7ee9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:23.577048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5d543198-99db-411f-9acd-4803cd9c7ee9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:23.583367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d543198-99db-411f-9acd-4803cd9c7ee9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:23.583843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d543198-99db-411f-9acd-4803cd9c7ee9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:23.584270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d543198-99db-411f-9acd-4803cd9c7ee9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:23.584974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d543198-99db-411f-9acd-4803cd9c7ee9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:23.585416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d543198-99db-411f-9acd-4803cd9c7ee9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:23.585825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d543198-99db-411f-9acd-4803cd9c7ee9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:23.611547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c9614788-93e5-4ee7-be20-4dc9ba380f84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:23.615149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5d543198-99db-411f-9acd-4803cd9c7ee9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Aug 06 12:38:23.615910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 356/864] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:38:23.619966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c9614788-93e5-4ee7-be20-4dc9ba380f84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.088037 Aug 06 12:38:23.620548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 509/865] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:23 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:23.622608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ab2791cf-7825-4ebd-bafd-85bbff48a600 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:23.624876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ab2791cf-7825-4ebd-bafd-85bbff48a600 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:23.631268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab2791cf-7825-4ebd-bafd-85bbff48a600 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:23.631749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab2791cf-7825-4ebd-bafd-85bbff48a600 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:23.632186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab2791cf-7825-4ebd-bafd-85bbff48a600 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:23.632901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab2791cf-7825-4ebd-bafd-85bbff48a600 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:23.633350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab2791cf-7825-4ebd-bafd-85bbff48a600 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:23.633783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab2791cf-7825-4ebd-bafd-85bbff48a600 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:23.661653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ab2791cf-7825-4ebd-bafd-85bbff48a600 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042672 Aug 06 12:38:23.662191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 357/866] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:23.821152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-942fd13e-cab2-453b-bcfb-b438de11eb20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:23.821673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-942fd13e-cab2-453b-bcfb-b438de11eb20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:23.827521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942fd13e-cab2-453b-bcfb-b438de11eb20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:23.827993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942fd13e-cab2-453b-bcfb-b438de11eb20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:23.828454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942fd13e-cab2-453b-bcfb-b438de11eb20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:23.829129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942fd13e-cab2-453b-bcfb-b438de11eb20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:23.829579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942fd13e-cab2-453b-bcfb-b438de11eb20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:23.829996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942fd13e-cab2-453b-bcfb-b438de11eb20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:23.955895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-942fd13e-cab2-453b-bcfb-b438de11eb20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:23.963721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-942fd13e-cab2-453b-bcfb-b438de11eb20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1724 microversion: 2.1 time: 0.146560 Aug 06 12:38:23.964275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 510/867] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:38:24.627068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-33a35413-cd1f-48ad-8a0d-ef0a40dd95c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:24.629222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-33a35413-cd1f-48ad-8a0d-ef0a40dd95c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:24.636305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33a35413-cd1f-48ad-8a0d-ef0a40dd95c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:24.636858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33a35413-cd1f-48ad-8a0d-ef0a40dd95c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:24.637299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33a35413-cd1f-48ad-8a0d-ef0a40dd95c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:24.638080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33a35413-cd1f-48ad-8a0d-ef0a40dd95c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:24.638571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33a35413-cd1f-48ad-8a0d-ef0a40dd95c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:24.639022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33a35413-cd1f-48ad-8a0d-ef0a40dd95c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:24.640208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d985e81a-cedc-41a7-ae54-301a69dd408a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:24.640845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d985e81a-cedc-41a7-ae54-301a69dd408a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:24.647723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d985e81a-cedc-41a7-ae54-301a69dd408a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:24.648270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d985e81a-cedc-41a7-ae54-301a69dd408a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:24.648733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d985e81a-cedc-41a7-ae54-301a69dd408a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:24.649452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d985e81a-cedc-41a7-ae54-301a69dd408a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:24.649933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d985e81a-cedc-41a7-ae54-301a69dd408a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:24.650358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d985e81a-cedc-41a7-ae54-301a69dd408a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:24.669540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-33a35413-cd1f-48ad-8a0d-ef0a40dd95c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046326 Aug 06 12:38:24.670118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 358/868] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:24.674739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a8435d27-8134-4f27-8b26-f815a82cb3e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:24.676887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a8435d27-8134-4f27-8b26-f815a82cb3e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:24.682531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8435d27-8134-4f27-8b26-f815a82cb3e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:24.683002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8435d27-8134-4f27-8b26-f815a82cb3e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:24.683428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8435d27-8134-4f27-8b26-f815a82cb3e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:24.684100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8435d27-8134-4f27-8b26-f815a82cb3e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:24.684565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8435d27-8134-4f27-8b26-f815a82cb3e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:24.684977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8435d27-8134-4f27-8b26-f815a82cb3e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:24.711121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d985e81a-cedc-41a7-ae54-301a69dd408a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:24.714857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a8435d27-8134-4f27-8b26-f815a82cb3e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043704 Aug 06 12:38:24.715411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 359/869] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:24.718707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d985e81a-cedc-41a7-ae54-301a69dd408a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082313 Aug 06 12:38:24.719257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 511/870] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:24 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:38:24.984751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-29071ec4-c7be-49b1-8e06-217a3a356b34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:24.985278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-29071ec4-c7be-49b1-8e06-217a3a356b34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:24.991750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29071ec4-c7be-49b1-8e06-217a3a356b34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:24.992231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29071ec4-c7be-49b1-8e06-217a3a356b34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:24.992710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29071ec4-c7be-49b1-8e06-217a3a356b34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:24.993399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29071ec4-c7be-49b1-8e06-217a3a356b34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:24.993852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29071ec4-c7be-49b1-8e06-217a3a356b34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:24.994275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29071ec4-c7be-49b1-8e06-217a3a356b34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:25.121040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-29071ec4-c7be-49b1-8e06-217a3a356b34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:25.128897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-29071ec4-c7be-49b1-8e06-217a3a356b34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1724 microversion: 2.1 time: 0.148415 Aug 06 12:38:25.130044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 360/871] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:25.681530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d1e42856-85e3-4b72-8179-bc191c6fd80d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:25.683773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d1e42856-85e3-4b72-8179-bc191c6fd80d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:25.690271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1e42856-85e3-4b72-8179-bc191c6fd80d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:25.690754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1e42856-85e3-4b72-8179-bc191c6fd80d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:25.691187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1e42856-85e3-4b72-8179-bc191c6fd80d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:25.691879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1e42856-85e3-4b72-8179-bc191c6fd80d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:25.692361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1e42856-85e3-4b72-8179-bc191c6fd80d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:25.692789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1e42856-85e3-4b72-8179-bc191c6fd80d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:25.722454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d1e42856-85e3-4b72-8179-bc191c6fd80d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 Aug 06 12:38:25.725087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 512/872] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:25 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:38:25.736655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9bca1629-e938-44cd-85b4-9bc3a9a808b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:25.738911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9bca1629-e938-44cd-85b4-9bc3a9a808b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:25.739189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a300eb87-e9f3-449e-a4a6-1ad16d0f6f25 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:25.739801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a300eb87-e9f3-449e-a4a6-1ad16d0f6f25 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:25.745276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bca1629-e938-44cd-85b4-9bc3a9a808b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:25.745830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bca1629-e938-44cd-85b4-9bc3a9a808b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:25.746150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a300eb87-e9f3-449e-a4a6-1ad16d0f6f25 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:25.746263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bca1629-e938-44cd-85b4-9bc3a9a808b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:25.746639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a300eb87-e9f3-449e-a4a6-1ad16d0f6f25 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:25.746940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bca1629-e938-44cd-85b4-9bc3a9a808b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:25.747384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bca1629-e938-44cd-85b4-9bc3a9a808b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:25.747496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a300eb87-e9f3-449e-a4a6-1ad16d0f6f25 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:25.747792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bca1629-e938-44cd-85b4-9bc3a9a808b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:25.748126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a300eb87-e9f3-449e-a4a6-1ad16d0f6f25 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:25.748859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a300eb87-e9f3-449e-a4a6-1ad16d0f6f25 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:25.749260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a300eb87-e9f3-449e-a4a6-1ad16d0f6f25 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:25.778148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9bca1629-e938-44cd-85b4-9bc3a9a808b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054767 Aug 06 12:38:25.778715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 361/873] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:38:25.812628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a300eb87-e9f3-449e-a4a6-1ad16d0f6f25 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:25.820312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a300eb87-e9f3-449e-a4a6-1ad16d0f6f25 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085152 Aug 06 12:38:25.820883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 513/874] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:25 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:38:26.150919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-110cd526-125a-4472-b9f9-9f3f627ff3df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:26.151523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-110cd526-125a-4472-b9f9-9f3f627ff3df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:26.157581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-110cd526-125a-4472-b9f9-9f3f627ff3df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:26.158055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-110cd526-125a-4472-b9f9-9f3f627ff3df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:26.158482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-110cd526-125a-4472-b9f9-9f3f627ff3df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:26.159158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-110cd526-125a-4472-b9f9-9f3f627ff3df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:26.159606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-110cd526-125a-4472-b9f9-9f3f627ff3df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:26.160029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-110cd526-125a-4472-b9f9-9f3f627ff3df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:26.287819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-110cd526-125a-4472-b9f9-9f3f627ff3df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:26.295821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-110cd526-125a-4472-b9f9-9f3f627ff3df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1730 microversion: 2.1 time: 0.148721 Aug 06 12:38:26.296410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 362/875] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:38:26.316198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-11ed4043-610c-4d41-9faa-c8ad31f5665c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:26.317328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-11ed4043-610c-4d41-9faa-c8ad31f5665c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:26.323215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ed4043-610c-4d41-9faa-c8ad31f5665c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:26.323690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ed4043-610c-4d41-9faa-c8ad31f5665c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:26.324119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ed4043-610c-4d41-9faa-c8ad31f5665c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:26.324826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ed4043-610c-4d41-9faa-c8ad31f5665c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:26.325274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ed4043-610c-4d41-9faa-c8ad31f5665c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:26.325691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ed4043-610c-4d41-9faa-c8ad31f5665c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:26.405144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-11ed4043-610c-4d41-9faa-c8ad31f5665c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092733 Aug 06 12:38:26.405736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 514/876] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Aug 6 12:38:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:26.735384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8142e356-e213-4d91-9df3-434c6e0adf38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:26.737653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8142e356-e213-4d91-9df3-434c6e0adf38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:26.744703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8142e356-e213-4d91-9df3-434c6e0adf38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:26.745259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8142e356-e213-4d91-9df3-434c6e0adf38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:26.745757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8142e356-e213-4d91-9df3-434c6e0adf38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:26.746521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8142e356-e213-4d91-9df3-434c6e0adf38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:26.747058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8142e356-e213-4d91-9df3-434c6e0adf38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:26.747546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8142e356-e213-4d91-9df3-434c6e0adf38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:26.777259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8142e356-e213-4d91-9df3-434c6e0adf38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046036 Aug 06 12:38:26.777820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 363/877] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:26.793740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a9203411-49c4-4557-9865-51fc26662cbf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:26.796247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a9203411-49c4-4557-9865-51fc26662cbf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:26.803098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9203411-49c4-4557-9865-51fc26662cbf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:26.803587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9203411-49c4-4557-9865-51fc26662cbf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:26.804019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9203411-49c4-4557-9865-51fc26662cbf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:26.804757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9203411-49c4-4557-9865-51fc26662cbf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:26.805203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9203411-49c4-4557-9865-51fc26662cbf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:26.805622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9203411-49c4-4557-9865-51fc26662cbf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:26.834821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a9203411-49c4-4557-9865-51fc26662cbf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047143 Aug 06 12:38:26.835646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 515/878] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:26.841111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a8a4ec49-7263-4a61-ab55-c3fda28bdfea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:26.841756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a8a4ec49-7263-4a61-ab55-c3fda28bdfea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:26.856057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec49-7263-4a61-ab55-c3fda28bdfea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:26.856576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec49-7263-4a61-ab55-c3fda28bdfea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:26.857009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec49-7263-4a61-ab55-c3fda28bdfea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:26.857705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec49-7263-4a61-ab55-c3fda28bdfea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:26.858154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec49-7263-4a61-ab55-c3fda28bdfea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:26.858595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8a4ec49-7263-4a61-ab55-c3fda28bdfea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:26.919605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a8a4ec49-7263-4a61-ab55-c3fda28bdfea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:26.927645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a8a4ec49-7263-4a61-ab55-c3fda28bdfea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.090680 Aug 06 12:38:26.928241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 364/879] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:26 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:38:27.536364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-d06c9fdd-bd61-431f-9dca-93afcf54ea81 req-3a7d46f9-f6e5-4fe6-b73a-ae426a93f12c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8a8915-eeca-4909-aab7-6fe8381ced6e", "tag": "57231bce-1a43-402f-869f-8f5913fcf388"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:38:27.546128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-d06c9fdd-bd61-431f-9dca-93afcf54ea81 req-3a7d46f9-f6e5-4fe6-b73a-ae426a93f12c service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:27.546702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-d06c9fdd-bd61-431f-9dca-93afcf54ea81 req-3a7d46f9-f6e5-4fe6-b73a-ae426a93f12c service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:27.547214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-d06c9fdd-bd61-431f-9dca-93afcf54ea81 req-3a7d46f9-f6e5-4fe6-b73a-ae426a93f12c service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:27.559616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-d06c9fdd-bd61-431f-9dca-93afcf54ea81 req-3a7d46f9-f6e5-4fe6-b73a-ae426a93f12c service nova] Creating event network-changed:57231bce-1a43-402f-869f-8f5913fcf388 for instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e on hv-cinder-85199 Aug 06 12:38:27.564562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-d06c9fdd-bd61-431f-9dca-93afcf54ea81 req-3a7d46f9-f6e5-4fe6-b73a-ae426a93f12c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032076 Aug 06 12:38:27.565152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 516/880] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:38:27.789405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2c93c253-0cbf-491a-812d-f05ccc67c6cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:27.791515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2c93c253-0cbf-491a-812d-f05ccc67c6cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:27.797903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c93c253-0cbf-491a-812d-f05ccc67c6cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:27.798386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c93c253-0cbf-491a-812d-f05ccc67c6cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:27.798818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c93c253-0cbf-491a-812d-f05ccc67c6cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:27.799505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c93c253-0cbf-491a-812d-f05ccc67c6cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:27.799952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c93c253-0cbf-491a-812d-f05ccc67c6cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:27.800624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c93c253-0cbf-491a-812d-f05ccc67c6cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:27.835155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2c93c253-0cbf-491a-812d-f05ccc67c6cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049600 Aug 06 12:38:27.835735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 365/881] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:27 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:27.848117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-02a4a1e1-65c0-4164-a717-0147e0f6ffa4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:27.850435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-02a4a1e1-65c0-4164-a717-0147e0f6ffa4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:27.856649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02a4a1e1-65c0-4164-a717-0147e0f6ffa4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:27.857130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02a4a1e1-65c0-4164-a717-0147e0f6ffa4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:27.857563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02a4a1e1-65c0-4164-a717-0147e0f6ffa4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:27.858245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02a4a1e1-65c0-4164-a717-0147e0f6ffa4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:27.858694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02a4a1e1-65c0-4164-a717-0147e0f6ffa4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:27.859371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02a4a1e1-65c0-4164-a717-0147e0f6ffa4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:27.889491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-02a4a1e1-65c0-4164-a717-0147e0f6ffa4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046128 Aug 06 12:38:27.890055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 517/882] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:27.948983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e988bb99-7c81-4e72-b45c-1a23fd9900dc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:27.949690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e988bb99-7c81-4e72-b45c-1a23fd9900dc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:27.955632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e988bb99-7c81-4e72-b45c-1a23fd9900dc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:27.956113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e988bb99-7c81-4e72-b45c-1a23fd9900dc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:27.956559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e988bb99-7c81-4e72-b45c-1a23fd9900dc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:27.957276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e988bb99-7c81-4e72-b45c-1a23fd9900dc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:27.957725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e988bb99-7c81-4e72-b45c-1a23fd9900dc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:27.958140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e988bb99-7c81-4e72-b45c-1a23fd9900dc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:28.021563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e988bb99-7c81-4e72-b45c-1a23fd9900dc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:28.029380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e988bb99-7c81-4e72-b45c-1a23fd9900dc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084203 Aug 06 12:38:28.029947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 366/883] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:27 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:38:28.847280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-29767093-5f49-4fbd-99d0-9a68e5939075 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:28.850177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-29767093-5f49-4fbd-99d0-9a68e5939075 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:28.856581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29767093-5f49-4fbd-99d0-9a68e5939075 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:28.857065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29767093-5f49-4fbd-99d0-9a68e5939075 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:28.857501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29767093-5f49-4fbd-99d0-9a68e5939075 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:28.858240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29767093-5f49-4fbd-99d0-9a68e5939075 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:28.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29767093-5f49-4fbd-99d0-9a68e5939075 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:28.859441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29767093-5f49-4fbd-99d0-9a68e5939075 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:28.888444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-29767093-5f49-4fbd-99d0-9a68e5939075 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045096 Aug 06 12:38:28.889001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 518/884] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:28 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:28.902145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d99dd340-7c70-45a4-9ad6-1f632e45f8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:28.904283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d99dd340-7c70-45a4-9ad6-1f632e45f8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:28.910505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d99dd340-7c70-45a4-9ad6-1f632e45f8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:28.910979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d99dd340-7c70-45a4-9ad6-1f632e45f8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:28.911411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d99dd340-7c70-45a4-9ad6-1f632e45f8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:28.912088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d99dd340-7c70-45a4-9ad6-1f632e45f8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:28.912563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d99dd340-7c70-45a4-9ad6-1f632e45f8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:28.912984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d99dd340-7c70-45a4-9ad6-1f632e45f8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:28.940563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d99dd340-7c70-45a4-9ad6-1f632e45f8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042256 Aug 06 12:38:28.941021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 367/885] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:29.049786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-17df9412-f441-46f9-96d5-48c27c2cfe6f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:29.050399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-17df9412-f441-46f9-96d5-48c27c2cfe6f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:29.056413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17df9412-f441-46f9-96d5-48c27c2cfe6f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:29.056900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17df9412-f441-46f9-96d5-48c27c2cfe6f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:29.057334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17df9412-f441-46f9-96d5-48c27c2cfe6f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:29.058020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17df9412-f441-46f9-96d5-48c27c2cfe6f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:29.058474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17df9412-f441-46f9-96d5-48c27c2cfe6f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:29.058899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17df9412-f441-46f9-96d5-48c27c2cfe6f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:29.120638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-17df9412-f441-46f9-96d5-48c27c2cfe6f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:29.128223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-17df9412-f441-46f9-96d5-48c27c2cfe6f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082305 Aug 06 12:38:29.129525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 519/886] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:29 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:29.578816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-f5145d68-ba9d-4ee6-b695-b4f271419c7d req-189c96e8-d0d3-4ad1-ac87-f16a12f81a07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8a8915-eeca-4909-aab7-6fe8381ced6e", "tag": "57231bce-1a43-402f-869f-8f5913fcf388"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:38:29.587875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-f5145d68-ba9d-4ee6-b695-b4f271419c7d req-189c96e8-d0d3-4ad1-ac87-f16a12f81a07 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:29.588367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-f5145d68-ba9d-4ee6-b695-b4f271419c7d req-189c96e8-d0d3-4ad1-ac87-f16a12f81a07 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:29.588795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-f5145d68-ba9d-4ee6-b695-b4f271419c7d req-189c96e8-d0d3-4ad1-ac87-f16a12f81a07 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:29.599283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-f5145d68-ba9d-4ee6-b695-b4f271419c7d req-189c96e8-d0d3-4ad1-ac87-f16a12f81a07 service nova] Creating event network-changed:57231bce-1a43-402f-869f-8f5913fcf388 for instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e on hv-cinder-85199 Aug 06 12:38:29.604253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-f5145d68-ba9d-4ee6-b695-b4f271419c7d req-189c96e8-d0d3-4ad1-ac87-f16a12f81a07 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029060 Aug 06 12:38:29.604837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 368/887] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:29.900328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c9a22ae0-247f-477e-a106-bbea9872e11d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:29.902514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c9a22ae0-247f-477e-a106-bbea9872e11d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:29.908839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9a22ae0-247f-477e-a106-bbea9872e11d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:29.909326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9a22ae0-247f-477e-a106-bbea9872e11d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:29.909745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9a22ae0-247f-477e-a106-bbea9872e11d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:29.910939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9a22ae0-247f-477e-a106-bbea9872e11d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:29.911392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9a22ae0-247f-477e-a106-bbea9872e11d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:29.911816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9a22ae0-247f-477e-a106-bbea9872e11d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:29.941535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c9a22ae0-247f-477e-a106-bbea9872e11d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Aug 06 12:38:29.942283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 520/888] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:29 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:29.954658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7b649270-4b73-484f-a166-dab4d1c7a93b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:29.956930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7b649270-4b73-484f-a166-dab4d1c7a93b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:29.962999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b649270-4b73-484f-a166-dab4d1c7a93b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:29.963480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b649270-4b73-484f-a166-dab4d1c7a93b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:29.963913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b649270-4b73-484f-a166-dab4d1c7a93b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:29.964626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b649270-4b73-484f-a166-dab4d1c7a93b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:29.965074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b649270-4b73-484f-a166-dab4d1c7a93b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:29.965493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b649270-4b73-484f-a166-dab4d1c7a93b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:29.992064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:38:29.997183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7b649270-4b73-484f-a166-dab4d1c7a93b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047263 Aug 06 12:38:29.997754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 369/889] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:30.151422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ba34207b-4f8a-480b-a97c-747f5c7d11c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:30.152034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ba34207b-4f8a-480b-a97c-747f5c7d11c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:30.158397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba34207b-4f8a-480b-a97c-747f5c7d11c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:30.158893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba34207b-4f8a-480b-a97c-747f5c7d11c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:30.159326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba34207b-4f8a-480b-a97c-747f5c7d11c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:30.160032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba34207b-4f8a-480b-a97c-747f5c7d11c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:30.161063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba34207b-4f8a-480b-a97c-747f5c7d11c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:30.161490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba34207b-4f8a-480b-a97c-747f5c7d11c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:30.227659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ba34207b-4f8a-480b-a97c-747f5c7d11c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:30.235541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ba34207b-4f8a-480b-a97c-747f5c7d11c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.088009 Aug 06 12:38:30.236104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 521/890] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:30 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:30.953858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e12f46a8-7bbf-4b4d-aa37-bbac628ab000 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:30.955882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e12f46a8-7bbf-4b4d-aa37-bbac628ab000 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:30.962160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e12f46a8-7bbf-4b4d-aa37-bbac628ab000 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:30.962637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e12f46a8-7bbf-4b4d-aa37-bbac628ab000 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:30.963067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e12f46a8-7bbf-4b4d-aa37-bbac628ab000 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:30.963746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e12f46a8-7bbf-4b4d-aa37-bbac628ab000 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:30.964196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e12f46a8-7bbf-4b4d-aa37-bbac628ab000 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:30.964640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e12f46a8-7bbf-4b4d-aa37-bbac628ab000 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:30.993050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e12f46a8-7bbf-4b4d-aa37-bbac628ab000 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043504 Aug 06 12:38:30.993601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 370/891] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:30 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:38:31.010765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa9694a2-6bb2-48cf-a680-3e610954d6ca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:31.012942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa9694a2-6bb2-48cf-a680-3e610954d6ca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:31.019220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa9694a2-6bb2-48cf-a680-3e610954d6ca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:31.019728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa9694a2-6bb2-48cf-a680-3e610954d6ca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:31.020157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa9694a2-6bb2-48cf-a680-3e610954d6ca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:31.020875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa9694a2-6bb2-48cf-a680-3e610954d6ca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:31.021326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa9694a2-6bb2-48cf-a680-3e610954d6ca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:31.021747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa9694a2-6bb2-48cf-a680-3e610954d6ca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:31.049552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa9694a2-6bb2-48cf-a680-3e610954d6ca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042759 Aug 06 12:38:31.050093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 522/892] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:31.254995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f0ab37d9-ffe5-46b3-8ca9-6edc831d2763 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:31.255520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f0ab37d9-ffe5-46b3-8ca9-6edc831d2763 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:31.261332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ab37d9-ffe5-46b3-8ca9-6edc831d2763 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:31.261810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ab37d9-ffe5-46b3-8ca9-6edc831d2763 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:31.262235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ab37d9-ffe5-46b3-8ca9-6edc831d2763 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:31.262914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ab37d9-ffe5-46b3-8ca9-6edc831d2763 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:31.263364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ab37d9-ffe5-46b3-8ca9-6edc831d2763 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:31.263784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ab37d9-ffe5-46b3-8ca9-6edc831d2763 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:31.326812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0ab37d9-ffe5-46b3-8ca9-6edc831d2763 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:31.334258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f0ab37d9-ffe5-46b3-8ca9-6edc831d2763 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083211 Aug 06 12:38:31.334813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 371/893] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:31 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:32.005794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d8c6ee4-bd64-4f7d-aac6-d09265498fc3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:32.007948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1d8c6ee4-bd64-4f7d-aac6-d09265498fc3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:32.013943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8c6ee4-bd64-4f7d-aac6-d09265498fc3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:32.014445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8c6ee4-bd64-4f7d-aac6-d09265498fc3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:32.014860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8c6ee4-bd64-4f7d-aac6-d09265498fc3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:32.015549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8c6ee4-bd64-4f7d-aac6-d09265498fc3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:32.016005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8c6ee4-bd64-4f7d-aac6-d09265498fc3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:32.016470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8c6ee4-bd64-4f7d-aac6-d09265498fc3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:32.021230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:38:32.047699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1d8c6ee4-bd64-4f7d-aac6-d09265498fc3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046393 Aug 06 12:38:32.048288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 523/894] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:32.062644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-05d2760f-bfbe-42e5-812d-1810072d77eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:32.064835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-05d2760f-bfbe-42e5-812d-1810072d77eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:32.071697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05d2760f-bfbe-42e5-812d-1810072d77eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:32.072167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05d2760f-bfbe-42e5-812d-1810072d77eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:32.072622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05d2760f-bfbe-42e5-812d-1810072d77eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:32.073298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05d2760f-bfbe-42e5-812d-1810072d77eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:32.073740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05d2760f-bfbe-42e5-812d-1810072d77eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:32.074152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05d2760f-bfbe-42e5-812d-1810072d77eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:32.103981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-05d2760f-bfbe-42e5-812d-1810072d77eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045260 Aug 06 12:38:32.104556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 372/895] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:32.354766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13f25699-e087-493f-9c58-7c44e29e93c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:32.355377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-13f25699-e087-493f-9c58-7c44e29e93c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:32.361542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f25699-e087-493f-9c58-7c44e29e93c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:32.362047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f25699-e087-493f-9c58-7c44e29e93c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:32.362488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f25699-e087-493f-9c58-7c44e29e93c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:32.363177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f25699-e087-493f-9c58-7c44e29e93c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:32.364170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f25699-e087-493f-9c58-7c44e29e93c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:32.364625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f25699-e087-493f-9c58-7c44e29e93c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:32.428413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-13f25699-e087-493f-9c58-7c44e29e93c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:32.435868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-13f25699-e087-493f-9c58-7c44e29e93c7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084996 Aug 06 12:38:32.436452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 524/896] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:32 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:33.059187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eec177df-f3be-4074-a1b5-ee96d4ad5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:33.061357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eec177df-f3be-4074-a1b5-ee96d4ad5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:33.067945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eec177df-f3be-4074-a1b5-ee96d4ad5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:33.068595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eec177df-f3be-4074-a1b5-ee96d4ad5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:33.068949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eec177df-f3be-4074-a1b5-ee96d4ad5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:33.069637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eec177df-f3be-4074-a1b5-ee96d4ad5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:33.070089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eec177df-f3be-4074-a1b5-ee96d4ad5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:33.070514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eec177df-f3be-4074-a1b5-ee96d4ad5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:33.098762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eec177df-f3be-4074-a1b5-ee96d4ad5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 Aug 06 12:38:33.099303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 373/897] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:33.116835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d92a8767-92fb-4262-8d33-9a8676f3341c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:33.118980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d92a8767-92fb-4262-8d33-9a8676f3341c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:33.124903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d92a8767-92fb-4262-8d33-9a8676f3341c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:33.125381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d92a8767-92fb-4262-8d33-9a8676f3341c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:33.125813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d92a8767-92fb-4262-8d33-9a8676f3341c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:33.126596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d92a8767-92fb-4262-8d33-9a8676f3341c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:33.126944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d92a8767-92fb-4262-8d33-9a8676f3341c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:33.127389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d92a8767-92fb-4262-8d33-9a8676f3341c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:33.155751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d92a8767-92fb-4262-8d33-9a8676f3341c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043593 Aug 06 12:38:33.156293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 525/898] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:33.456903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f249e05b-230c-4db1-9a51-21bfacef253b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:33.457508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f249e05b-230c-4db1-9a51-21bfacef253b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:33.463335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f249e05b-230c-4db1-9a51-21bfacef253b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:33.463807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f249e05b-230c-4db1-9a51-21bfacef253b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:33.464236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f249e05b-230c-4db1-9a51-21bfacef253b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:33.464945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f249e05b-230c-4db1-9a51-21bfacef253b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:33.465392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f249e05b-230c-4db1-9a51-21bfacef253b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:33.465811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f249e05b-230c-4db1-9a51-21bfacef253b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:33.525978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f249e05b-230c-4db1-9a51-21bfacef253b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:33.533373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f249e05b-230c-4db1-9a51-21bfacef253b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080281 Aug 06 12:38:33.533928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 374/899] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:33 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:34.111285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-80f60cca-219b-44c7-ab02-1f0a4ba66c6a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:34.113468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-80f60cca-219b-44c7-ab02-1f0a4ba66c6a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:34.119837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80f60cca-219b-44c7-ab02-1f0a4ba66c6a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:34.120401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80f60cca-219b-44c7-ab02-1f0a4ba66c6a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:34.120755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80f60cca-219b-44c7-ab02-1f0a4ba66c6a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:34.121427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80f60cca-219b-44c7-ab02-1f0a4ba66c6a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:34.121871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80f60cca-219b-44c7-ab02-1f0a4ba66c6a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:34.122288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80f60cca-219b-44c7-ab02-1f0a4ba66c6a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:34.151139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-80f60cca-219b-44c7-ab02-1f0a4ba66c6a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Aug 06 12:38:34.151686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 526/900] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:34 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:34.167615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9a8f38ad-fbb8-4d23-8c96-b144b648ef15 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:34.169772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9a8f38ad-fbb8-4d23-8c96-b144b648ef15 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:34.176032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f38ad-fbb8-4d23-8c96-b144b648ef15 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:34.176549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f38ad-fbb8-4d23-8c96-b144b648ef15 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:34.176973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f38ad-fbb8-4d23-8c96-b144b648ef15 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:34.177642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f38ad-fbb8-4d23-8c96-b144b648ef15 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:34.178084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f38ad-fbb8-4d23-8c96-b144b648ef15 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:34.178494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a8f38ad-fbb8-4d23-8c96-b144b648ef15 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:34.207585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9a8f38ad-fbb8-4d23-8c96-b144b648ef15 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043432 Aug 06 12:38:34.208173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 375/901] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:34.553721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6d293c68-d996-4fb6-9675-36fc07b6d4c9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:34.554353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6d293c68-d996-4fb6-9675-36fc07b6d4c9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:34.560326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d293c68-d996-4fb6-9675-36fc07b6d4c9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:34.560801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d293c68-d996-4fb6-9675-36fc07b6d4c9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:34.561231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d293c68-d996-4fb6-9675-36fc07b6d4c9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:34.561910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d293c68-d996-4fb6-9675-36fc07b6d4c9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:34.562363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d293c68-d996-4fb6-9675-36fc07b6d4c9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:34.562785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d293c68-d996-4fb6-9675-36fc07b6d4c9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:34.622311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6d293c68-d996-4fb6-9675-36fc07b6d4c9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:34.630287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6d293c68-d996-4fb6-9675-36fc07b6d4c9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080937 Aug 06 12:38:34.630840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 527/902] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:34 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:35.163865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3454fb34-7603-49da-a6ab-d11838f0ed9c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:35.166029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3454fb34-7603-49da-a6ab-d11838f0ed9c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:35.172100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3454fb34-7603-49da-a6ab-d11838f0ed9c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:35.172707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3454fb34-7603-49da-a6ab-d11838f0ed9c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:35.173022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3454fb34-7603-49da-a6ab-d11838f0ed9c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:35.173697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3454fb34-7603-49da-a6ab-d11838f0ed9c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:35.174144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3454fb34-7603-49da-a6ab-d11838f0ed9c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:35.174561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3454fb34-7603-49da-a6ab-d11838f0ed9c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:35.203235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3454fb34-7603-49da-a6ab-d11838f0ed9c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 Aug 06 12:38:35.203776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 376/903] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:35 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:35.219004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4ef6fa3b-5f92-4c6b-ad60-2635da3007c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:35.221168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4ef6fa3b-5f92-4c6b-ad60-2635da3007c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:35.228031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef6fa3b-5f92-4c6b-ad60-2635da3007c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:35.228543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef6fa3b-5f92-4c6b-ad60-2635da3007c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:35.228974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef6fa3b-5f92-4c6b-ad60-2635da3007c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:35.229655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef6fa3b-5f92-4c6b-ad60-2635da3007c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:35.230102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef6fa3b-5f92-4c6b-ad60-2635da3007c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:35.230517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef6fa3b-5f92-4c6b-ad60-2635da3007c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:35.259956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4ef6fa3b-5f92-4c6b-ad60-2635da3007c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044844 Aug 06 12:38:35.260466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 528/904] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:35.650981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a62b17c0-d5ee-49a9-bf83-5c72a490f490 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:35.651573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a62b17c0-d5ee-49a9-bf83-5c72a490f490 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:35.657332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a62b17c0-d5ee-49a9-bf83-5c72a490f490 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:35.657800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a62b17c0-d5ee-49a9-bf83-5c72a490f490 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:35.658226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a62b17c0-d5ee-49a9-bf83-5c72a490f490 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:35.658893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a62b17c0-d5ee-49a9-bf83-5c72a490f490 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:35.659338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a62b17c0-d5ee-49a9-bf83-5c72a490f490 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:35.659750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a62b17c0-d5ee-49a9-bf83-5c72a490f490 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:35.719318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a62b17c0-d5ee-49a9-bf83-5c72a490f490 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:35.726563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a62b17c0-d5ee-49a9-bf83-5c72a490f490 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.079458 Aug 06 12:38:35.727108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 377/905] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:35 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:36.215631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-22d3a486-73df-4376-aa68-df17e41fba6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:36.217824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-22d3a486-73df-4376-aa68-df17e41fba6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:36.223911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22d3a486-73df-4376-aa68-df17e41fba6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:36.224522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22d3a486-73df-4376-aa68-df17e41fba6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:36.224839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22d3a486-73df-4376-aa68-df17e41fba6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:36.225521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22d3a486-73df-4376-aa68-df17e41fba6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:36.225969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22d3a486-73df-4376-aa68-df17e41fba6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:36.226386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22d3a486-73df-4376-aa68-df17e41fba6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:36.256936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-22d3a486-73df-4376-aa68-df17e41fba6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Aug 06 12:38:36.257426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 529/906] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:36 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:36.270945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-94a5c054-7ebd-40d8-a28c-0e97d46242f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:36.273060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-94a5c054-7ebd-40d8-a28c-0e97d46242f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:36.279459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94a5c054-7ebd-40d8-a28c-0e97d46242f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:36.279946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94a5c054-7ebd-40d8-a28c-0e97d46242f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:36.280407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94a5c054-7ebd-40d8-a28c-0e97d46242f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:36.281093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94a5c054-7ebd-40d8-a28c-0e97d46242f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:36.281569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94a5c054-7ebd-40d8-a28c-0e97d46242f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:36.281986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94a5c054-7ebd-40d8-a28c-0e97d46242f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:36.310239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-94a5c054-7ebd-40d8-a28c-0e97d46242f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043211 Aug 06 12:38:36.310776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 378/907] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:36.746082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7bdb9ee-63d4-49ec-852a-8517a88a000c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:36.746686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7bdb9ee-63d4-49ec-852a-8517a88a000c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:36.752793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7bdb9ee-63d4-49ec-852a-8517a88a000c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:36.753272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7bdb9ee-63d4-49ec-852a-8517a88a000c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:36.754219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7bdb9ee-63d4-49ec-852a-8517a88a000c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:36.754900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7bdb9ee-63d4-49ec-852a-8517a88a000c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:36.755352 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7bdb9ee-63d4-49ec-852a-8517a88a000c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:36.755771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7bdb9ee-63d4-49ec-852a-8517a88a000c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:36.816061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7bdb9ee-63d4-49ec-852a-8517a88a000c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:36.824099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7bdb9ee-63d4-49ec-852a-8517a88a000c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081894 Aug 06 12:38:36.824683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 530/908] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:36 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:38:37.269023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-54b6a6c2-2135-4efa-acca-9eedfc769f01 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:37.271241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-54b6a6c2-2135-4efa-acca-9eedfc769f01 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:37.277574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b6a6c2-2135-4efa-acca-9eedfc769f01 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:37.278046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b6a6c2-2135-4efa-acca-9eedfc769f01 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:37.278472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b6a6c2-2135-4efa-acca-9eedfc769f01 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:37.279144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b6a6c2-2135-4efa-acca-9eedfc769f01 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:37.279585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b6a6c2-2135-4efa-acca-9eedfc769f01 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:37.279993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b6a6c2-2135-4efa-acca-9eedfc769f01 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:37.308739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-54b6a6c2-2135-4efa-acca-9eedfc769f01 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Aug 06 12:38:37.309271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 379/909] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:37.322688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d669720a-674c-471e-8251-709864037a60 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:37.324854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d669720a-674c-471e-8251-709864037a60 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:37.331156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d669720a-674c-471e-8251-709864037a60 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:37.331667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d669720a-674c-471e-8251-709864037a60 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:37.332098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d669720a-674c-471e-8251-709864037a60 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:37.332807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d669720a-674c-471e-8251-709864037a60 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:37.333260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d669720a-674c-471e-8251-709864037a60 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:37.333683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d669720a-674c-471e-8251-709864037a60 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:37.362377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d669720a-674c-471e-8251-709864037a60 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043660 Aug 06 12:38:37.362945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 531/910] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:37.679991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:38:37.680224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:38:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:38:37.844023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-68be8824-e810-4b0a-9285-1c9b7c7225a6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:37.844642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-68be8824-e810-4b0a-9285-1c9b7c7225a6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:37.851293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68be8824-e810-4b0a-9285-1c9b7c7225a6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:37.851772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68be8824-e810-4b0a-9285-1c9b7c7225a6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:37.852209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68be8824-e810-4b0a-9285-1c9b7c7225a6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:37.852927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68be8824-e810-4b0a-9285-1c9b7c7225a6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:37.853377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68be8824-e810-4b0a-9285-1c9b7c7225a6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:37.853796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68be8824-e810-4b0a-9285-1c9b7c7225a6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:37.914088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-68be8824-e810-4b0a-9285-1c9b7c7225a6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:37.921481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-68be8824-e810-4b0a-9285-1c9b7c7225a6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081228 Aug 06 12:38:37.922038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 380/911] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:37 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:38.321414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3ed16fe3-5c00-40fb-89c8-5f89ebfcf958 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:38.323584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3ed16fe3-5c00-40fb-89c8-5f89ebfcf958 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:38.329924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ed16fe3-5c00-40fb-89c8-5f89ebfcf958 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:38.330394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ed16fe3-5c00-40fb-89c8-5f89ebfcf958 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:38.330855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ed16fe3-5c00-40fb-89c8-5f89ebfcf958 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:38.331573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ed16fe3-5c00-40fb-89c8-5f89ebfcf958 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:38.332028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ed16fe3-5c00-40fb-89c8-5f89ebfcf958 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:38.332478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ed16fe3-5c00-40fb-89c8-5f89ebfcf958 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:38.360700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3ed16fe3-5c00-40fb-89c8-5f89ebfcf958 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043246 Aug 06 12:38:38.361236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 532/912] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:38.375013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-039b0aca-6157-46ca-9f6f-db6b2d3dc276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:38.377168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-039b0aca-6157-46ca-9f6f-db6b2d3dc276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:38.384066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-039b0aca-6157-46ca-9f6f-db6b2d3dc276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:38.384578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-039b0aca-6157-46ca-9f6f-db6b2d3dc276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:38.385014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-039b0aca-6157-46ca-9f6f-db6b2d3dc276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:38.385692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-039b0aca-6157-46ca-9f6f-db6b2d3dc276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:38.386141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-039b0aca-6157-46ca-9f6f-db6b2d3dc276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:38.386561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-039b0aca-6157-46ca-9f6f-db6b2d3dc276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:38.416280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-039b0aca-6157-46ca-9f6f-db6b2d3dc276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045185 Aug 06 12:38:38.416849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 381/913] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:38.941932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7689aaf2-3d84-401d-8ed1-0a7b19edf3fd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:38.942552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7689aaf2-3d84-401d-8ed1-0a7b19edf3fd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:38.948488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7689aaf2-3d84-401d-8ed1-0a7b19edf3fd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:38.948965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7689aaf2-3d84-401d-8ed1-0a7b19edf3fd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:38.949393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7689aaf2-3d84-401d-8ed1-0a7b19edf3fd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:38.950068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7689aaf2-3d84-401d-8ed1-0a7b19edf3fd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:38.950513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7689aaf2-3d84-401d-8ed1-0a7b19edf3fd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:38.950928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7689aaf2-3d84-401d-8ed1-0a7b19edf3fd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:39.011330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7689aaf2-3d84-401d-8ed1-0a7b19edf3fd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:39.018888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7689aaf2-3d84-401d-8ed1-0a7b19edf3fd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080837 Aug 06 12:38:39.019931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 533/914] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:38 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:39.373259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-83e44b38-02f4-436e-8bc8-ee3ae95028a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:39.375400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-83e44b38-02f4-436e-8bc8-ee3ae95028a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:39.382288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83e44b38-02f4-436e-8bc8-ee3ae95028a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:39.382757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83e44b38-02f4-436e-8bc8-ee3ae95028a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:39.383179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83e44b38-02f4-436e-8bc8-ee3ae95028a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:39.383847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83e44b38-02f4-436e-8bc8-ee3ae95028a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:39.384287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83e44b38-02f4-436e-8bc8-ee3ae95028a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:39.384725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83e44b38-02f4-436e-8bc8-ee3ae95028a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:39.412900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-83e44b38-02f4-436e-8bc8-ee3ae95028a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 Aug 06 12:38:39.413430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 382/915] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:39 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:39.427839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aa9d5cfe-f657-441f-8844-1e38686b1332 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:39.430012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aa9d5cfe-f657-441f-8844-1e38686b1332 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:39.436217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa9d5cfe-f657-441f-8844-1e38686b1332 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:39.436726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa9d5cfe-f657-441f-8844-1e38686b1332 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:39.437155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa9d5cfe-f657-441f-8844-1e38686b1332 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:39.437830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa9d5cfe-f657-441f-8844-1e38686b1332 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:39.438272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa9d5cfe-f657-441f-8844-1e38686b1332 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:39.438686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa9d5cfe-f657-441f-8844-1e38686b1332 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:39.467421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aa9d5cfe-f657-441f-8844-1e38686b1332 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043570 Aug 06 12:38:39.467951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 534/916] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:40.039207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b195f021-56c4-4bb9-ba97-2c3d70e0629d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:40.039815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b195f021-56c4-4bb9-ba97-2c3d70e0629d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:40.045668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b195f021-56c4-4bb9-ba97-2c3d70e0629d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:40.046141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b195f021-56c4-4bb9-ba97-2c3d70e0629d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:40.046566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b195f021-56c4-4bb9-ba97-2c3d70e0629d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:40.047240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b195f021-56c4-4bb9-ba97-2c3d70e0629d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:40.047688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b195f021-56c4-4bb9-ba97-2c3d70e0629d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:40.048104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b195f021-56c4-4bb9-ba97-2c3d70e0629d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:40.107800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b195f021-56c4-4bb9-ba97-2c3d70e0629d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:40.115921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b195f021-56c4-4bb9-ba97-2c3d70e0629d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080615 Aug 06 12:38:40.116514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 383/917] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:40 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:40.425013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3e34c78c-97b8-467d-b2ed-d66c4d06c2ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:40.427740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3e34c78c-97b8-467d-b2ed-d66c4d06c2ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:40.434177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e34c78c-97b8-467d-b2ed-d66c4d06c2ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:40.434748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e34c78c-97b8-467d-b2ed-d66c4d06c2ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:40.435085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e34c78c-97b8-467d-b2ed-d66c4d06c2ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:40.435772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e34c78c-97b8-467d-b2ed-d66c4d06c2ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:40.436229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e34c78c-97b8-467d-b2ed-d66c4d06c2ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:40.436676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e34c78c-97b8-467d-b2ed-d66c4d06c2ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:40.465297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3e34c78c-97b8-467d-b2ed-d66c4d06c2ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Aug 06 12:38:40.465844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 535/918] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:40 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:40.479680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aac4438c-09f6-4528-b3f0-352a13e4c843 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:40.481806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aac4438c-09f6-4528-b3f0-352a13e4c843 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:40.489206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aac4438c-09f6-4528-b3f0-352a13e4c843 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:40.489717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aac4438c-09f6-4528-b3f0-352a13e4c843 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:40.490149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aac4438c-09f6-4528-b3f0-352a13e4c843 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:40.490840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aac4438c-09f6-4528-b3f0-352a13e4c843 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:40.491292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aac4438c-09f6-4528-b3f0-352a13e4c843 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:40.491715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aac4438c-09f6-4528-b3f0-352a13e4c843 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:40.523775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aac4438c-09f6-4528-b3f0-352a13e4c843 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048361 Aug 06 12:38:40.524362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 384/919] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:41.135831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2e362351-c057-4c14-a17a-96ed081dad61 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:41.136517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2e362351-c057-4c14-a17a-96ed081dad61 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:41.142441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e362351-c057-4c14-a17a-96ed081dad61 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:41.142917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e362351-c057-4c14-a17a-96ed081dad61 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:41.143349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e362351-c057-4c14-a17a-96ed081dad61 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:41.144033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e362351-c057-4c14-a17a-96ed081dad61 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:41.145108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e362351-c057-4c14-a17a-96ed081dad61 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:41.145644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e362351-c057-4c14-a17a-96ed081dad61 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:41.207895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2e362351-c057-4c14-a17a-96ed081dad61 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:41.215362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2e362351-c057-4c14-a17a-96ed081dad61 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083355 Aug 06 12:38:41.215921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 536/920] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:41 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:41.477126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-495036e4-23f3-4802-86f4-99c43fec0de3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:41.479273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-495036e4-23f3-4802-86f4-99c43fec0de3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:41.485869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-495036e4-23f3-4802-86f4-99c43fec0de3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:41.486447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-495036e4-23f3-4802-86f4-99c43fec0de3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:41.486744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-495036e4-23f3-4802-86f4-99c43fec0de3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:41.487414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-495036e4-23f3-4802-86f4-99c43fec0de3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:41.488411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-495036e4-23f3-4802-86f4-99c43fec0de3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:41.488825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-495036e4-23f3-4802-86f4-99c43fec0de3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:41.519033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-495036e4-23f3-4802-86f4-99c43fec0de3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Aug 06 12:38:41.519580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 385/921] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:41 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:41.535429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-36266686-01b4-48d3-acc2-2987724999f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:41.537604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-36266686-01b4-48d3-acc2-2987724999f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:41.543941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36266686-01b4-48d3-acc2-2987724999f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:41.544451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36266686-01b4-48d3-acc2-2987724999f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:41.544885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36266686-01b4-48d3-acc2-2987724999f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:41.545572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36266686-01b4-48d3-acc2-2987724999f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:41.546020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36266686-01b4-48d3-acc2-2987724999f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:41.546440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36266686-01b4-48d3-acc2-2987724999f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:41.575354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-36266686-01b4-48d3-acc2-2987724999f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043913 Aug 06 12:38:41.575894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 537/922] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:42.235412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-79abbfc4-3add-47c6-9b1a-12f3a0e7e60a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:42.236017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-79abbfc4-3add-47c6-9b1a-12f3a0e7e60a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:42.241934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79abbfc4-3add-47c6-9b1a-12f3a0e7e60a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:42.242409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79abbfc4-3add-47c6-9b1a-12f3a0e7e60a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:42.242837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79abbfc4-3add-47c6-9b1a-12f3a0e7e60a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:42.243510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79abbfc4-3add-47c6-9b1a-12f3a0e7e60a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:42.243958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79abbfc4-3add-47c6-9b1a-12f3a0e7e60a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:42.244404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79abbfc4-3add-47c6-9b1a-12f3a0e7e60a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:42.261790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:38:42.307551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-79abbfc4-3add-47c6-9b1a-12f3a0e7e60a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:42.315041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-79abbfc4-3add-47c6-9b1a-12f3a0e7e60a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083726 Aug 06 12:38:42.315594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 386/923] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:42 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:42.531348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0b80b3e-d41b-4ddf-a8c6-8a950d53fa58 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:42.533467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0b80b3e-d41b-4ddf-a8c6-8a950d53fa58 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:42.539409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0b80b3e-d41b-4ddf-a8c6-8a950d53fa58 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:42.539974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0b80b3e-d41b-4ddf-a8c6-8a950d53fa58 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:42.540326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0b80b3e-d41b-4ddf-a8c6-8a950d53fa58 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:42.541017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0b80b3e-d41b-4ddf-a8c6-8a950d53fa58 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:42.541470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0b80b3e-d41b-4ddf-a8c6-8a950d53fa58 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:42.541889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0b80b3e-d41b-4ddf-a8c6-8a950d53fa58 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:42.570539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0b80b3e-d41b-4ddf-a8c6-8a950d53fa58 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043277 Aug 06 12:38:42.571075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 538/924] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:42 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:42.587550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e56135da-9ae0-4ed2-9f7e-c9191c57dda5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:42.589697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e56135da-9ae0-4ed2-9f7e-c9191c57dda5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:42.591915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=69 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:38:42.597092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e56135da-9ae0-4ed2-9f7e-c9191c57dda5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:42.597566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e56135da-9ae0-4ed2-9f7e-c9191c57dda5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:42.597989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e56135da-9ae0-4ed2-9f7e-c9191c57dda5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:42.598673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e56135da-9ae0-4ed2-9f7e-c9191c57dda5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:42.599097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e56135da-9ae0-4ed2-9f7e-c9191c57dda5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:42.599508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e56135da-9ae0-4ed2-9f7e-c9191c57dda5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:42.627656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e56135da-9ae0-4ed2-9f7e-c9191c57dda5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043984 Aug 06 12:38:42.628193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 387/925] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:43.335291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7d8c8332-87ac-49ec-a434-99a4f557698f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:43.335896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7d8c8332-87ac-49ec-a434-99a4f557698f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:43.341730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d8c8332-87ac-49ec-a434-99a4f557698f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:43.342204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d8c8332-87ac-49ec-a434-99a4f557698f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:43.342632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d8c8332-87ac-49ec-a434-99a4f557698f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:43.343318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d8c8332-87ac-49ec-a434-99a4f557698f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:43.343770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d8c8332-87ac-49ec-a434-99a4f557698f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:43.344188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d8c8332-87ac-49ec-a434-99a4f557698f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:43.405076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7d8c8332-87ac-49ec-a434-99a4f557698f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:43.408405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:38:43.413892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7d8c8332-87ac-49ec-a434-99a4f557698f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082600 Aug 06 12:38:43.414452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 539/926] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:43 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:43.494598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:38:43.494755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:38:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:38:43.583071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cd4fce41-f231-4b7c-83cc-59a39aaee294 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:43.585198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cd4fce41-f231-4b7c-83cc-59a39aaee294 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:43.591091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd4fce41-f231-4b7c-83cc-59a39aaee294 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:43.591651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd4fce41-f231-4b7c-83cc-59a39aaee294 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:43.591923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd4fce41-f231-4b7c-83cc-59a39aaee294 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:43.592619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd4fce41-f231-4b7c-83cc-59a39aaee294 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:43.593064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd4fce41-f231-4b7c-83cc-59a39aaee294 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:43.593475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd4fce41-f231-4b7c-83cc-59a39aaee294 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:43.622271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cd4fce41-f231-4b7c-83cc-59a39aaee294 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043565 Aug 06 12:38:43.622802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 388/927] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:43.640458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5adbeac6-4de2-445b-91b5-09c696b8b377 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:43.642592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5adbeac6-4de2-445b-91b5-09c696b8b377 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:43.649494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5adbeac6-4de2-445b-91b5-09c696b8b377 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:43.649972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5adbeac6-4de2-445b-91b5-09c696b8b377 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:43.650403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5adbeac6-4de2-445b-91b5-09c696b8b377 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:43.651088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5adbeac6-4de2-445b-91b5-09c696b8b377 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:43.651531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5adbeac6-4de2-445b-91b5-09c696b8b377 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:43.651948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5adbeac6-4de2-445b-91b5-09c696b8b377 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:43.680605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5adbeac6-4de2-445b-91b5-09c696b8b377 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044158 Aug 06 12:38:43.681139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 540/928] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:44.434748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a30111ac-eaf7-4184-a78a-5749e379082a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:44.435357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a30111ac-eaf7-4184-a78a-5749e379082a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:44.441879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30111ac-eaf7-4184-a78a-5749e379082a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:44.442354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30111ac-eaf7-4184-a78a-5749e379082a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:44.442810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30111ac-eaf7-4184-a78a-5749e379082a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:44.443490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30111ac-eaf7-4184-a78a-5749e379082a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:44.443942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30111ac-eaf7-4184-a78a-5749e379082a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:44.444395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a30111ac-eaf7-4184-a78a-5749e379082a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:44.504165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a30111ac-eaf7-4184-a78a-5749e379082a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:44.511549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a30111ac-eaf7-4184-a78a-5749e379082a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080678 Aug 06 12:38:44.512103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 389/929] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:44 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:44.634868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-45b0da5e-9d9e-4add-b5ec-d98ca70aed7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:44.637064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-45b0da5e-9d9e-4add-b5ec-d98ca70aed7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:44.642936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b0da5e-9d9e-4add-b5ec-d98ca70aed7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:44.643477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b0da5e-9d9e-4add-b5ec-d98ca70aed7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:44.643832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b0da5e-9d9e-4add-b5ec-d98ca70aed7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:44.644545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b0da5e-9d9e-4add-b5ec-d98ca70aed7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:44.644999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b0da5e-9d9e-4add-b5ec-d98ca70aed7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:44.645423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b0da5e-9d9e-4add-b5ec-d98ca70aed7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:44.673941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-45b0da5e-9d9e-4add-b5ec-d98ca70aed7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042962 Aug 06 12:38:44.674464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 541/930] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:44.692826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a579eb8a-40d3-45e5-88a5-cf9a3f619623 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:44.694873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a579eb8a-40d3-45e5-88a5-cf9a3f619623 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:44.701165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a579eb8a-40d3-45e5-88a5-cf9a3f619623 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:44.701647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a579eb8a-40d3-45e5-88a5-cf9a3f619623 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:44.702078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a579eb8a-40d3-45e5-88a5-cf9a3f619623 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:44.702768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a579eb8a-40d3-45e5-88a5-cf9a3f619623 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:44.703219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a579eb8a-40d3-45e5-88a5-cf9a3f619623 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:44.703639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a579eb8a-40d3-45e5-88a5-cf9a3f619623 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:44.732643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a579eb8a-40d3-45e5-88a5-cf9a3f619623 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043825 Aug 06 12:38:44.733189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 390/931] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:45.533785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5a526b73-ab58-4364-b97d-c05eb5ada0cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:45.534428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5a526b73-ab58-4364-b97d-c05eb5ada0cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:45.540370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a526b73-ab58-4364-b97d-c05eb5ada0cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:45.540856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a526b73-ab58-4364-b97d-c05eb5ada0cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:45.541295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a526b73-ab58-4364-b97d-c05eb5ada0cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:45.541982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a526b73-ab58-4364-b97d-c05eb5ada0cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:45.542443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a526b73-ab58-4364-b97d-c05eb5ada0cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:45.542868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a526b73-ab58-4364-b97d-c05eb5ada0cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:45.602414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5a526b73-ab58-4364-b97d-c05eb5ada0cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:45.610035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5a526b73-ab58-4364-b97d-c05eb5ada0cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081788 Aug 06 12:38:45.610591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 542/932] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:45 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:45.686762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a4443a42-053c-4657-b5f8-b78c686c4020 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:45.688934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a4443a42-053c-4657-b5f8-b78c686c4020 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:45.695428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4443a42-053c-4657-b5f8-b78c686c4020 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:45.695969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4443a42-053c-4657-b5f8-b78c686c4020 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:45.696349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4443a42-053c-4657-b5f8-b78c686c4020 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:45.697034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4443a42-053c-4657-b5f8-b78c686c4020 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:45.697490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4443a42-053c-4657-b5f8-b78c686c4020 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:45.697915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4443a42-053c-4657-b5f8-b78c686c4020 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:45.726321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a4443a42-053c-4657-b5f8-b78c686c4020 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043566 Aug 06 12:38:45.726860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 391/933] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:45.745024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-15925c52-21a3-4d87-86c6-1435b57d81ba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:45.747247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-15925c52-21a3-4d87-86c6-1435b57d81ba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:45.753974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15925c52-21a3-4d87-86c6-1435b57d81ba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:45.754449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15925c52-21a3-4d87-86c6-1435b57d81ba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:45.754877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15925c52-21a3-4d87-86c6-1435b57d81ba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:45.755583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15925c52-21a3-4d87-86c6-1435b57d81ba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:45.756028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15925c52-21a3-4d87-86c6-1435b57d81ba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:45.756476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15925c52-21a3-4d87-86c6-1435b57d81ba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:45.784612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-15925c52-21a3-4d87-86c6-1435b57d81ba tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043412 Aug 06 12:38:45.785080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 543/934] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:46.630202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3c5dab0f-b665-4633-a026-a4b293936022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:46.631440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3c5dab0f-b665-4633-a026-a4b293936022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:46.637402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c5dab0f-b665-4633-a026-a4b293936022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:46.637891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c5dab0f-b665-4633-a026-a4b293936022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:46.638307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c5dab0f-b665-4633-a026-a4b293936022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:46.638988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c5dab0f-b665-4633-a026-a4b293936022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:46.639438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c5dab0f-b665-4633-a026-a4b293936022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:46.639858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c5dab0f-b665-4633-a026-a4b293936022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:46.699111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3c5dab0f-b665-4633-a026-a4b293936022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:46.706449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3c5dab0f-b665-4633-a026-a4b293936022 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080093 Aug 06 12:38:46.707006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 392/935] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:46 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:46.738656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e44b1461-b4a9-499c-b881-77bb06ba447c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:46.741467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e44b1461-b4a9-499c-b881-77bb06ba447c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:46.747479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44b1461-b4a9-499c-b881-77bb06ba447c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:46.748030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44b1461-b4a9-499c-b881-77bb06ba447c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:46.748399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44b1461-b4a9-499c-b881-77bb06ba447c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:46.749081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44b1461-b4a9-499c-b881-77bb06ba447c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:46.749527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44b1461-b4a9-499c-b881-77bb06ba447c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:46.749948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44b1461-b4a9-499c-b881-77bb06ba447c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:46.779637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e44b1461-b4a9-499c-b881-77bb06ba447c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 Aug 06 12:38:46.780179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 544/936] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:46.796582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-195fa904-57bf-42eb-baee-75748a0fa3c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:46.798747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-195fa904-57bf-42eb-baee-75748a0fa3c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:46.805095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-195fa904-57bf-42eb-baee-75748a0fa3c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:46.805567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-195fa904-57bf-42eb-baee-75748a0fa3c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:46.805990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-195fa904-57bf-42eb-baee-75748a0fa3c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:46.806660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-195fa904-57bf-42eb-baee-75748a0fa3c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:46.807099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-195fa904-57bf-42eb-baee-75748a0fa3c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:46.807510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-195fa904-57bf-42eb-baee-75748a0fa3c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:46.836089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-195fa904-57bf-42eb-baee-75748a0fa3c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043483 Aug 06 12:38:46.836651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 393/937] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:47.726925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-77f937d5-38c2-454d-9681-9f2261f5ba8e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:47.727523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-77f937d5-38c2-454d-9681-9f2261f5ba8e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:47.733442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77f937d5-38c2-454d-9681-9f2261f5ba8e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:47.734168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77f937d5-38c2-454d-9681-9f2261f5ba8e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:47.734592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77f937d5-38c2-454d-9681-9f2261f5ba8e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:47.735263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77f937d5-38c2-454d-9681-9f2261f5ba8e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:47.735707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77f937d5-38c2-454d-9681-9f2261f5ba8e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:47.736119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77f937d5-38c2-454d-9681-9f2261f5ba8e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:47.791307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2c6d7838-9b8e-4d8d-9842-5d05ae21b418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:47.793623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2c6d7838-9b8e-4d8d-9842-5d05ae21b418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:47.796861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-77f937d5-38c2-454d-9681-9f2261f5ba8e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:47.800045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c6d7838-9b8e-4d8d-9842-5d05ae21b418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:47.800557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c6d7838-9b8e-4d8d-9842-5d05ae21b418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:47.800992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c6d7838-9b8e-4d8d-9842-5d05ae21b418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:47.801675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c6d7838-9b8e-4d8d-9842-5d05ae21b418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:47.802152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c6d7838-9b8e-4d8d-9842-5d05ae21b418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:47.802571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c6d7838-9b8e-4d8d-9842-5d05ae21b418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:47.804270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-77f937d5-38c2-454d-9681-9f2261f5ba8e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081231 Aug 06 12:38:47.804851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 545/938] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:47 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:47.831141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2c6d7838-9b8e-4d8d-9842-5d05ae21b418 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043813 Aug 06 12:38:47.831675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 394/939] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:38:47.848146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cd49affb-50e8-4a30-935e-675653af131d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:47.850316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cd49affb-50e8-4a30-935e-675653af131d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:47.856253 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd49affb-50e8-4a30-935e-675653af131d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:47.856754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd49affb-50e8-4a30-935e-675653af131d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:47.857181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd49affb-50e8-4a30-935e-675653af131d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:47.857853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd49affb-50e8-4a30-935e-675653af131d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:47.858299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd49affb-50e8-4a30-935e-675653af131d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:47.858963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd49affb-50e8-4a30-935e-675653af131d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:47.886899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cd49affb-50e8-4a30-935e-675653af131d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042721 Aug 06 12:38:47.887426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 546/940] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:48.824590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5382ae0e-4494-4705-af5c-4455884f156d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:48.825196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5382ae0e-4494-4705-af5c-4455884f156d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:48.831429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5382ae0e-4494-4705-af5c-4455884f156d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:48.831903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5382ae0e-4494-4705-af5c-4455884f156d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:48.832351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5382ae0e-4494-4705-af5c-4455884f156d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:48.833556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5382ae0e-4494-4705-af5c-4455884f156d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:48.834002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5382ae0e-4494-4705-af5c-4455884f156d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:48.834417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5382ae0e-4494-4705-af5c-4455884f156d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:48.842907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-35f8b487-a1d2-4978-bba5-a18dceb37aea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:48.845111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-35f8b487-a1d2-4978-bba5-a18dceb37aea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:48.852012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35f8b487-a1d2-4978-bba5-a18dceb37aea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:48.852533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35f8b487-a1d2-4978-bba5-a18dceb37aea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:48.852973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35f8b487-a1d2-4978-bba5-a18dceb37aea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:48.853664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35f8b487-a1d2-4978-bba5-a18dceb37aea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:48.854118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35f8b487-a1d2-4978-bba5-a18dceb37aea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:48.854544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35f8b487-a1d2-4978-bba5-a18dceb37aea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:48.883462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-35f8b487-a1d2-4978-bba5-a18dceb37aea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Aug 06 12:38:48.884234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 547/941] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:38:48.894782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5382ae0e-4494-4705-af5c-4455884f156d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:48.898753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c3f12c3f-633b-4045-bb88-40740983a8a3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:48.900945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c3f12c3f-633b-4045-bb88-40740983a8a3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:48.902840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5382ae0e-4494-4705-af5c-4455884f156d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082163 Aug 06 12:38:48.903774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 395/942] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:48 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:48.906701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3f12c3f-633b-4045-bb88-40740983a8a3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:48.907173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3f12c3f-633b-4045-bb88-40740983a8a3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:48.907715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3f12c3f-633b-4045-bb88-40740983a8a3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:48.908439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3f12c3f-633b-4045-bb88-40740983a8a3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:48.908878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3f12c3f-633b-4045-bb88-40740983a8a3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:48.909292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3f12c3f-633b-4045-bb88-40740983a8a3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:48.937769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c3f12c3f-633b-4045-bb88-40740983a8a3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043578 Aug 06 12:38:48.938300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 548/943] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:38:49.895054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9a0ba0c3-b1d4-4c4e-a34c-3a2d155ca8f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:49.897225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9a0ba0c3-b1d4-4c4e-a34c-3a2d155ca8f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:49.903532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a0ba0c3-b1d4-4c4e-a34c-3a2d155ca8f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:49.904013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a0ba0c3-b1d4-4c4e-a34c-3a2d155ca8f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:49.904469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a0ba0c3-b1d4-4c4e-a34c-3a2d155ca8f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:49.905151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a0ba0c3-b1d4-4c4e-a34c-3a2d155ca8f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:49.905598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a0ba0c3-b1d4-4c4e-a34c-3a2d155ca8f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:49.906014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a0ba0c3-b1d4-4c4e-a34c-3a2d155ca8f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:49.922847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eb9b156a-cc63-4e55-aebc-12b42017a568 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:49.923447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eb9b156a-cc63-4e55-aebc-12b42017a568 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:49.930546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb9b156a-cc63-4e55-aebc-12b42017a568 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:49.931028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb9b156a-cc63-4e55-aebc-12b42017a568 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:49.931461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb9b156a-cc63-4e55-aebc-12b42017a568 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:49.932152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb9b156a-cc63-4e55-aebc-12b42017a568 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:49.932635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb9b156a-cc63-4e55-aebc-12b42017a568 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:49.933061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb9b156a-cc63-4e55-aebc-12b42017a568 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:49.938253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9a0ba0c3-b1d4-4c4e-a34c-3a2d155ca8f0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047086 Aug 06 12:38:49.938809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 396/944] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:49.949518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4fbc27b6-b1af-4419-9c2b-29fedb1e1f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:49.951598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4fbc27b6-b1af-4419-9c2b-29fedb1e1f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:49.957262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbc27b6-b1af-4419-9c2b-29fedb1e1f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:49.957739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbc27b6-b1af-4419-9c2b-29fedb1e1f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:49.958170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbc27b6-b1af-4419-9c2b-29fedb1e1f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:49.958862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbc27b6-b1af-4419-9c2b-29fedb1e1f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:49.959309 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbc27b6-b1af-4419-9c2b-29fedb1e1f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:49.959725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fbc27b6-b1af-4419-9c2b-29fedb1e1f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:49.989237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4fbc27b6-b1af-4419-9c2b-29fedb1e1f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043286 Aug 06 12:38:49.990556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 397/945] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:38:49.998078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eb9b156a-cc63-4e55-aebc-12b42017a568 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:50.005699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eb9b156a-cc63-4e55-aebc-12b42017a568 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.086661 Aug 06 12:38:50.006251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 549/946] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:49 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:38:50.950504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-67d4d991-b8e0-4dcf-96e3-0fc78d00fda4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:50.952642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-67d4d991-b8e0-4dcf-96e3-0fc78d00fda4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:50.959640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67d4d991-b8e0-4dcf-96e3-0fc78d00fda4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:50.960151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67d4d991-b8e0-4dcf-96e3-0fc78d00fda4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:50.960605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67d4d991-b8e0-4dcf-96e3-0fc78d00fda4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:50.961285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67d4d991-b8e0-4dcf-96e3-0fc78d00fda4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:50.961767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67d4d991-b8e0-4dcf-96e3-0fc78d00fda4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:50.962188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67d4d991-b8e0-4dcf-96e3-0fc78d00fda4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:50.990642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-67d4d991-b8e0-4dcf-96e3-0fc78d00fda4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Aug 06 12:38:50.991184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 398/947] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:50 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:51.002080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-679eff44-d998-4b06-b43c-c514f8f7fd4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:51.004202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-679eff44-d998-4b06-b43c-c514f8f7fd4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:51.011242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-679eff44-d998-4b06-b43c-c514f8f7fd4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:51.011715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-679eff44-d998-4b06-b43c-c514f8f7fd4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:51.012142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-679eff44-d998-4b06-b43c-c514f8f7fd4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:51.012861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-679eff44-d998-4b06-b43c-c514f8f7fd4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:51.013305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-679eff44-d998-4b06-b43c-c514f8f7fd4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:51.013718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-679eff44-d998-4b06-b43c-c514f8f7fd4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:51.025654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7f49b763-7803-433b-94a2-90485041a865 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:51.026265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7f49b763-7803-433b-94a2-90485041a865 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:51.032260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f49b763-7803-433b-94a2-90485041a865 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:51.032798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f49b763-7803-433b-94a2-90485041a865 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:51.033229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f49b763-7803-433b-94a2-90485041a865 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:51.033913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f49b763-7803-433b-94a2-90485041a865 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:51.034366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f49b763-7803-433b-94a2-90485041a865 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:51.034789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f49b763-7803-433b-94a2-90485041a865 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:51.041884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-679eff44-d998-4b06-b43c-c514f8f7fd4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043784 Aug 06 12:38:51.042430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 550/948] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:51.097518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7f49b763-7803-433b-94a2-90485041a865 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:51.104979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7f49b763-7803-433b-94a2-90485041a865 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083108 Aug 06 12:38:51.105537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 399/949] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:51 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:38:52.003035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8739e558-3f9e-4298-ba92-d1b5d5faf94f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:52.005204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8739e558-3f9e-4298-ba92-d1b5d5faf94f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:52.011227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8739e558-3f9e-4298-ba92-d1b5d5faf94f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:52.011704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8739e558-3f9e-4298-ba92-d1b5d5faf94f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:52.012137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8739e558-3f9e-4298-ba92-d1b5d5faf94f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:52.012854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8739e558-3f9e-4298-ba92-d1b5d5faf94f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:52.013304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8739e558-3f9e-4298-ba92-d1b5d5faf94f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:52.013727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8739e558-3f9e-4298-ba92-d1b5d5faf94f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:52.042585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8739e558-3f9e-4298-ba92-d1b5d5faf94f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 Aug 06 12:38:52.043129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 551/950] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:52.054047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c38c4143-62f9-425a-bcfa-f6b6f0ce19d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:52.056140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c38c4143-62f9-425a-bcfa-f6b6f0ce19d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:52.062385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38c4143-62f9-425a-bcfa-f6b6f0ce19d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:52.062864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38c4143-62f9-425a-bcfa-f6b6f0ce19d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:52.063294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38c4143-62f9-425a-bcfa-f6b6f0ce19d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:52.063973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38c4143-62f9-425a-bcfa-f6b6f0ce19d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:52.064456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38c4143-62f9-425a-bcfa-f6b6f0ce19d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:52.064873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38c4143-62f9-425a-bcfa-f6b6f0ce19d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:52.093325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c38c4143-62f9-425a-bcfa-f6b6f0ce19d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043185 Aug 06 12:38:52.093869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 400/951] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:52.125806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9277bd43-2aec-40f0-a040-0a01e9f0bef0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:52.126413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9277bd43-2aec-40f0-a040-0a01e9f0bef0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:52.132846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9277bd43-2aec-40f0-a040-0a01e9f0bef0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:52.133324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9277bd43-2aec-40f0-a040-0a01e9f0bef0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:52.133756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9277bd43-2aec-40f0-a040-0a01e9f0bef0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:52.134439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9277bd43-2aec-40f0-a040-0a01e9f0bef0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:52.134889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9277bd43-2aec-40f0-a040-0a01e9f0bef0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:52.135310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9277bd43-2aec-40f0-a040-0a01e9f0bef0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:52.197911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9277bd43-2aec-40f0-a040-0a01e9f0bef0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:52.205420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9277bd43-2aec-40f0-a040-0a01e9f0bef0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083427 Aug 06 12:38:52.206007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 552/952] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:52 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:53.054808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dcd5e730-d71e-4bed-a414-13d7f1cefda9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:53.056973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dcd5e730-d71e-4bed-a414-13d7f1cefda9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:53.063259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcd5e730-d71e-4bed-a414-13d7f1cefda9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:53.063730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcd5e730-d71e-4bed-a414-13d7f1cefda9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:53.064156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcd5e730-d71e-4bed-a414-13d7f1cefda9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:53.064861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcd5e730-d71e-4bed-a414-13d7f1cefda9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:53.065302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcd5e730-d71e-4bed-a414-13d7f1cefda9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:53.065714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcd5e730-d71e-4bed-a414-13d7f1cefda9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:53.094469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dcd5e730-d71e-4bed-a414-13d7f1cefda9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043655 Aug 06 12:38:53.095008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 401/953] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:53 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:53.105458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4b65c576-d8f7-4664-ae95-cf158732148d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:53.107578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4b65c576-d8f7-4664-ae95-cf158732148d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:53.110137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=93 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:38:53.115182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b65c576-d8f7-4664-ae95-cf158732148d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:53.115654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b65c576-d8f7-4664-ae95-cf158732148d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:53.116081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b65c576-d8f7-4664-ae95-cf158732148d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:53.116787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b65c576-d8f7-4664-ae95-cf158732148d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:53.117233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b65c576-d8f7-4664-ae95-cf158732148d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:53.117648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b65c576-d8f7-4664-ae95-cf158732148d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:53.146610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4b65c576-d8f7-4664-ae95-cf158732148d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045041 Aug 06 12:38:53.147146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 553/954] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:53.226053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d2fede49-a8d9-4cac-b3ac-a55b628ba6fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:53.226654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d2fede49-a8d9-4cac-b3ac-a55b628ba6fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:53.232515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2fede49-a8d9-4cac-b3ac-a55b628ba6fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:53.232984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2fede49-a8d9-4cac-b3ac-a55b628ba6fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:53.233423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2fede49-a8d9-4cac-b3ac-a55b628ba6fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:53.234364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2fede49-a8d9-4cac-b3ac-a55b628ba6fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:53.234810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2fede49-a8d9-4cac-b3ac-a55b628ba6fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:53.235228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2fede49-a8d9-4cac-b3ac-a55b628ba6fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:53.299643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d2fede49-a8d9-4cac-b3ac-a55b628ba6fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:53.307176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d2fede49-a8d9-4cac-b3ac-a55b628ba6fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084921 Aug 06 12:38:53.307727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 402/955] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:53 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:54.106532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d717b181-d203-4c5a-b82e-75f454b41faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:54.108969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d717b181-d203-4c5a-b82e-75f454b41faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:54.115731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d717b181-d203-4c5a-b82e-75f454b41faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:54.116200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d717b181-d203-4c5a-b82e-75f454b41faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:54.116652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d717b181-d203-4c5a-b82e-75f454b41faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:54.117324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d717b181-d203-4c5a-b82e-75f454b41faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:54.117764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d717b181-d203-4c5a-b82e-75f454b41faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:54.118176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d717b181-d203-4c5a-b82e-75f454b41faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:54.146937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d717b181-d203-4c5a-b82e-75f454b41faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044344 Aug 06 12:38:54.147479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 554/956] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:54 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:54.158949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e03f9bd5-6151-4aba-8802-c8530b9b054a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:54.161722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e03f9bd5-6151-4aba-8802-c8530b9b054a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:54.168118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e03f9bd5-6151-4aba-8802-c8530b9b054a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:54.168628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e03f9bd5-6151-4aba-8802-c8530b9b054a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:54.169114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e03f9bd5-6151-4aba-8802-c8530b9b054a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:54.169842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e03f9bd5-6151-4aba-8802-c8530b9b054a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:54.170290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e03f9bd5-6151-4aba-8802-c8530b9b054a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:54.170705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e03f9bd5-6151-4aba-8802-c8530b9b054a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:54.174207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:38:54.199471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e03f9bd5-6151-4aba-8802-c8530b9b054a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044460 Aug 06 12:38:54.200015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 403/957] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:54.327751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7bd742d0-247d-4bc3-b052-5b52635c8206 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:54.328382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7bd742d0-247d-4bc3-b052-5b52635c8206 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:54.334853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd742d0-247d-4bc3-b052-5b52635c8206 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:54.335325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd742d0-247d-4bc3-b052-5b52635c8206 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:54.335755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd742d0-247d-4bc3-b052-5b52635c8206 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:54.336462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd742d0-247d-4bc3-b052-5b52635c8206 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:54.336913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd742d0-247d-4bc3-b052-5b52635c8206 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:54.337334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd742d0-247d-4bc3-b052-5b52635c8206 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:54.397912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7bd742d0-247d-4bc3-b052-5b52635c8206 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:54.405347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7bd742d0-247d-4bc3-b052-5b52635c8206 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081529 Aug 06 12:38:54.405899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 555/958] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:54 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:55.158158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-31297b93-244c-42c2-bc25-0616e324513c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:55.160268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-31297b93-244c-42c2-bc25-0616e324513c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:55.166642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31297b93-244c-42c2-bc25-0616e324513c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:55.167113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31297b93-244c-42c2-bc25-0616e324513c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:55.167569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31297b93-244c-42c2-bc25-0616e324513c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:55.168242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31297b93-244c-42c2-bc25-0616e324513c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:55.168715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31297b93-244c-42c2-bc25-0616e324513c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:55.169133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31297b93-244c-42c2-bc25-0616e324513c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:55.197873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-31297b93-244c-42c2-bc25-0616e324513c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043673 Aug 06 12:38:55.198430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 404/959] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:55 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:55.212586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3c5873d7-e5d1-4c8a-8c82-8ea5cc69c7a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:55.214827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3c5873d7-e5d1-4c8a-8c82-8ea5cc69c7a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:55.221082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c5873d7-e5d1-4c8a-8c82-8ea5cc69c7a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:55.221552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c5873d7-e5d1-4c8a-8c82-8ea5cc69c7a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:55.221977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c5873d7-e5d1-4c8a-8c82-8ea5cc69c7a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:55.222654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c5873d7-e5d1-4c8a-8c82-8ea5cc69c7a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:55.223097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c5873d7-e5d1-4c8a-8c82-8ea5cc69c7a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:55.223536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c5873d7-e5d1-4c8a-8c82-8ea5cc69c7a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:55.241225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:38:55.254090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3c5873d7-e5d1-4c8a-8c82-8ea5cc69c7a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046125 Aug 06 12:38:55.255055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 556/960] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:55.425664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac401ed0-1ea8-4a5b-9c1f-99409104517e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:55.426296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac401ed0-1ea8-4a5b-9c1f-99409104517e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:55.432691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac401ed0-1ea8-4a5b-9c1f-99409104517e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:55.433165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac401ed0-1ea8-4a5b-9c1f-99409104517e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:55.433604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac401ed0-1ea8-4a5b-9c1f-99409104517e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:55.434278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac401ed0-1ea8-4a5b-9c1f-99409104517e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:55.434724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac401ed0-1ea8-4a5b-9c1f-99409104517e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:55.435142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac401ed0-1ea8-4a5b-9c1f-99409104517e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:55.494536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ac401ed0-1ea8-4a5b-9c1f-99409104517e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:55.501877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac401ed0-1ea8-4a5b-9c1f-99409104517e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080009 Aug 06 12:38:55.502436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 405/961] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:55 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:56.210599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-73f0f86c-149a-4abc-a74f-cbd7dd6000ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:56.212742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-73f0f86c-149a-4abc-a74f-cbd7dd6000ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:56.219040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73f0f86c-149a-4abc-a74f-cbd7dd6000ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:56.219510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73f0f86c-149a-4abc-a74f-cbd7dd6000ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:56.219938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73f0f86c-149a-4abc-a74f-cbd7dd6000ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:56.220647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73f0f86c-149a-4abc-a74f-cbd7dd6000ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:56.221093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73f0f86c-149a-4abc-a74f-cbd7dd6000ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:56.221505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73f0f86c-149a-4abc-a74f-cbd7dd6000ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:56.250302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-73f0f86c-149a-4abc-a74f-cbd7dd6000ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Aug 06 12:38:56.250771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 557/962] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:56.266825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-81bfae9d-7723-41c6-911b-d6002f367a5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:56.269005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-81bfae9d-7723-41c6-911b-d6002f367a5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:56.275633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81bfae9d-7723-41c6-911b-d6002f367a5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:56.276109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81bfae9d-7723-41c6-911b-d6002f367a5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:56.276585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81bfae9d-7723-41c6-911b-d6002f367a5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:56.277265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81bfae9d-7723-41c6-911b-d6002f367a5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:56.277713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81bfae9d-7723-41c6-911b-d6002f367a5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:56.278142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81bfae9d-7723-41c6-911b-d6002f367a5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:56.307572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-81bfae9d-7723-41c6-911b-d6002f367a5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044737 Aug 06 12:38:56.308114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 406/963] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:56 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:56.522906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4a91c524-9e38-4490-b3e8-c01b6ea87f3c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:56.523434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4a91c524-9e38-4490-b3e8-c01b6ea87f3c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:56.529266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a91c524-9e38-4490-b3e8-c01b6ea87f3c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:56.529740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a91c524-9e38-4490-b3e8-c01b6ea87f3c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:56.530166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a91c524-9e38-4490-b3e8-c01b6ea87f3c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:56.530881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a91c524-9e38-4490-b3e8-c01b6ea87f3c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:56.531332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a91c524-9e38-4490-b3e8-c01b6ea87f3c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:56.531753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a91c524-9e38-4490-b3e8-c01b6ea87f3c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:56.591208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4a91c524-9e38-4490-b3e8-c01b6ea87f3c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:56.599228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4a91c524-9e38-4490-b3e8-c01b6ea87f3c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080307 Aug 06 12:38:56.599781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 558/964] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:56 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:57.263147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-38b196f9-7dbd-45a7-ac18-4edc71b58c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:57.265189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-38b196f9-7dbd-45a7-ac18-4edc71b58c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:57.271535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38b196f9-7dbd-45a7-ac18-4edc71b58c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:57.272095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38b196f9-7dbd-45a7-ac18-4edc71b58c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:57.272432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38b196f9-7dbd-45a7-ac18-4edc71b58c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:57.273103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38b196f9-7dbd-45a7-ac18-4edc71b58c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:57.273545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38b196f9-7dbd-45a7-ac18-4edc71b58c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:57.273958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38b196f9-7dbd-45a7-ac18-4edc71b58c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:57.302848 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-38b196f9-7dbd-45a7-ac18-4edc71b58c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Aug 06 12:38:57.303395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 407/965] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:57 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:57.319106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3c858c75-2985-4ca5-847b-c32ee4932eaa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:57.321282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3c858c75-2985-4ca5-847b-c32ee4932eaa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:57.327604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c858c75-2985-4ca5-847b-c32ee4932eaa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:57.328087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c858c75-2985-4ca5-847b-c32ee4932eaa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:57.328557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c858c75-2985-4ca5-847b-c32ee4932eaa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:57.329242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c858c75-2985-4ca5-847b-c32ee4932eaa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:57.329691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c858c75-2985-4ca5-847b-c32ee4932eaa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:57.330113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c858c75-2985-4ca5-847b-c32ee4932eaa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:57.359486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3c858c75-2985-4ca5-847b-c32ee4932eaa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044438 Aug 06 12:38:57.360030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 559/966] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:57.619695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7fdcef28-f8a4-44d8-a6d9-e6f28c0ede5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:57.620294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7fdcef28-f8a4-44d8-a6d9-e6f28c0ede5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:57.626167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fdcef28-f8a4-44d8-a6d9-e6f28c0ede5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:57.626640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fdcef28-f8a4-44d8-a6d9-e6f28c0ede5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:57.627070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fdcef28-f8a4-44d8-a6d9-e6f28c0ede5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:57.627753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fdcef28-f8a4-44d8-a6d9-e6f28c0ede5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:57.628204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fdcef28-f8a4-44d8-a6d9-e6f28c0ede5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:57.628649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fdcef28-f8a4-44d8-a6d9-e6f28c0ede5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:57.688913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7fdcef28-f8a4-44d8-a6d9-e6f28c0ede5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:57.696286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7fdcef28-f8a4-44d8-a6d9-e6f28c0ede5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080381 Aug 06 12:38:57.696868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 408/967] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:57 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:58.315025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d7099418-c79c-473e-baae-ad1351720b5c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:58.319533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d7099418-c79c-473e-baae-ad1351720b5c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:58.325927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7099418-c79c-473e-baae-ad1351720b5c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:58.326399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7099418-c79c-473e-baae-ad1351720b5c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:58.326826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7099418-c79c-473e-baae-ad1351720b5c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:58.327503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7099418-c79c-473e-baae-ad1351720b5c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:58.327951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7099418-c79c-473e-baae-ad1351720b5c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:58.328394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7099418-c79c-473e-baae-ad1351720b5c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:58.356894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d7099418-c79c-473e-baae-ad1351720b5c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045777 Aug 06 12:38:58.357441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 560/968] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:58.371036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c9296db4-66c2-4dcf-a7ef-8bd5e4f8dd2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:58.373168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c9296db4-66c2-4dcf-a7ef-8bd5e4f8dd2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:58.379912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9296db4-66c2-4dcf-a7ef-8bd5e4f8dd2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:58.380433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9296db4-66c2-4dcf-a7ef-8bd5e4f8dd2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:58.380871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9296db4-66c2-4dcf-a7ef-8bd5e4f8dd2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:58.381544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9296db4-66c2-4dcf-a7ef-8bd5e4f8dd2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:58.381992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9296db4-66c2-4dcf-a7ef-8bd5e4f8dd2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:58.382411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9296db4-66c2-4dcf-a7ef-8bd5e4f8dd2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:58.412252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c9296db4-66c2-4dcf-a7ef-8bd5e4f8dd2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045154 Aug 06 12:38:58.412833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 409/969] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:58.717295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2217ebce-1d03-4a6c-a819-de533db71f86 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:58.717908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2217ebce-1d03-4a6c-a819-de533db71f86 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:58.723813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2217ebce-1d03-4a6c-a819-de533db71f86 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:58.724290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2217ebce-1d03-4a6c-a819-de533db71f86 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:58.724767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2217ebce-1d03-4a6c-a819-de533db71f86 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:58.725453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2217ebce-1d03-4a6c-a819-de533db71f86 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:58.725908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2217ebce-1d03-4a6c-a819-de533db71f86 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:58.726339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2217ebce-1d03-4a6c-a819-de533db71f86 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:58.789098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2217ebce-1d03-4a6c-a819-de533db71f86 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:58.796637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2217ebce-1d03-4a6c-a819-de533db71f86 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083206 Aug 06 12:38:58.797199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 561/970] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:58 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:38:59.370000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-af3fdeea-662b-437b-874a-8a92220cc6d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:59.372120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-af3fdeea-662b-437b-874a-8a92220cc6d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:59.378397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af3fdeea-662b-437b-874a-8a92220cc6d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:59.378867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af3fdeea-662b-437b-874a-8a92220cc6d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:59.379904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af3fdeea-662b-437b-874a-8a92220cc6d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:59.380607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af3fdeea-662b-437b-874a-8a92220cc6d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:59.381052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af3fdeea-662b-437b-874a-8a92220cc6d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:59.381465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af3fdeea-662b-437b-874a-8a92220cc6d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:59.408783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-af3fdeea-662b-437b-874a-8a92220cc6d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042737 Aug 06 12:38:59.409322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 410/971] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:38:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:38:59.424499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-191671b1-f1bc-460e-9607-98813941aa03 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:59.427125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-191671b1-f1bc-460e-9607-98813941aa03 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:59.433359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-191671b1-f1bc-460e-9607-98813941aa03 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:59.433831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-191671b1-f1bc-460e-9607-98813941aa03 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:59.434257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-191671b1-f1bc-460e-9607-98813941aa03 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:59.434931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-191671b1-f1bc-460e-9607-98813941aa03 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:59.435373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-191671b1-f1bc-460e-9607-98813941aa03 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:59.435815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-191671b1-f1bc-460e-9607-98813941aa03 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:59.464132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-191671b1-f1bc-460e-9607-98813941aa03 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043679 Aug 06 12:38:59.464697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 562/972] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:38:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:38:59.816623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b510d4f6-445c-49fe-a873-6dc110fc223e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:38:59.817219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b510d4f6-445c-49fe-a873-6dc110fc223e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:38:59.823029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b510d4f6-445c-49fe-a873-6dc110fc223e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:59.823499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b510d4f6-445c-49fe-a873-6dc110fc223e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:59.823920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b510d4f6-445c-49fe-a873-6dc110fc223e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:59.824629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b510d4f6-445c-49fe-a873-6dc110fc223e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:38:59.825073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b510d4f6-445c-49fe-a873-6dc110fc223e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:38:59.825487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b510d4f6-445c-49fe-a873-6dc110fc223e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:38:59.887533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b510d4f6-445c-49fe-a873-6dc110fc223e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:38:59.894867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b510d4f6-445c-49fe-a873-6dc110fc223e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082048 Aug 06 12:38:59.895414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 411/973] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:38:59 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:00.420110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3ee2e42a-c746-4f1c-9138-c3f7d851caf6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:00.422263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3ee2e42a-c746-4f1c-9138-c3f7d851caf6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:00.428748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ee2e42a-c746-4f1c-9138-c3f7d851caf6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:00.429291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ee2e42a-c746-4f1c-9138-c3f7d851caf6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:00.429633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ee2e42a-c746-4f1c-9138-c3f7d851caf6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:00.430311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ee2e42a-c746-4f1c-9138-c3f7d851caf6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:00.430754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ee2e42a-c746-4f1c-9138-c3f7d851caf6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:00.431170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ee2e42a-c746-4f1c-9138-c3f7d851caf6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:00.459203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3ee2e42a-c746-4f1c-9138-c3f7d851caf6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043037 Aug 06 12:39:00.459757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 563/974] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:00 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:00.476736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-253feb2e-3e59-45a9-8c5a-a237ce4bff70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:00.478872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-253feb2e-3e59-45a9-8c5a-a237ce4bff70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:00.485410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-253feb2e-3e59-45a9-8c5a-a237ce4bff70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:00.485878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-253feb2e-3e59-45a9-8c5a-a237ce4bff70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:00.486300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-253feb2e-3e59-45a9-8c5a-a237ce4bff70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:00.486971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-253feb2e-3e59-45a9-8c5a-a237ce4bff70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:00.487413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-253feb2e-3e59-45a9-8c5a-a237ce4bff70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:00.487824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-253feb2e-3e59-45a9-8c5a-a237ce4bff70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:00.525632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-253feb2e-3e59-45a9-8c5a-a237ce4bff70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053243 Aug 06 12:39:00.526193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 412/975] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:00.914940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4be86bf2-92d3-4a48-9df8-2537e4f6d474 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:00.915550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4be86bf2-92d3-4a48-9df8-2537e4f6d474 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:00.921552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4be86bf2-92d3-4a48-9df8-2537e4f6d474 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:00.922025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4be86bf2-92d3-4a48-9df8-2537e4f6d474 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:00.922455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4be86bf2-92d3-4a48-9df8-2537e4f6d474 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:00.923165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4be86bf2-92d3-4a48-9df8-2537e4f6d474 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:00.923615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4be86bf2-92d3-4a48-9df8-2537e4f6d474 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:00.924035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4be86bf2-92d3-4a48-9df8-2537e4f6d474 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:00.984449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4be86bf2-92d3-4a48-9df8-2537e4f6d474 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:00.992366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4be86bf2-92d3-4a48-9df8-2537e4f6d474 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081234 Aug 06 12:39:00.992926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 564/976] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:00 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:01.470998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6a168b2-290c-4e13-97d4-4f924c7d57e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:01.473782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c6a168b2-290c-4e13-97d4-4f924c7d57e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:01.479561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a168b2-290c-4e13-97d4-4f924c7d57e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:01.480128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a168b2-290c-4e13-97d4-4f924c7d57e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:01.480488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a168b2-290c-4e13-97d4-4f924c7d57e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:01.481158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a168b2-290c-4e13-97d4-4f924c7d57e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:01.481603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a168b2-290c-4e13-97d4-4f924c7d57e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:01.482014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a168b2-290c-4e13-97d4-4f924c7d57e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:01.510568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c6a168b2-290c-4e13-97d4-4f924c7d57e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043463 Aug 06 12:39:01.511106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 413/977] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:01 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:01.537779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-793bd82d-c7bd-4735-8301-8a242fcbae0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:01.540129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-793bd82d-c7bd-4735-8301-8a242fcbae0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:01.546996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-793bd82d-c7bd-4735-8301-8a242fcbae0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:01.547481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-793bd82d-c7bd-4735-8301-8a242fcbae0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:01.547915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-793bd82d-c7bd-4735-8301-8a242fcbae0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:01.548788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-793bd82d-c7bd-4735-8301-8a242fcbae0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:01.549241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-793bd82d-c7bd-4735-8301-8a242fcbae0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:01.549665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-793bd82d-c7bd-4735-8301-8a242fcbae0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:01.577842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-793bd82d-c7bd-4735-8301-8a242fcbae0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044551 Aug 06 12:39:01.578394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 565/978] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:02.013436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3481aa84-97e5-4c61-a973-c0b28bd22b84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:02.014051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3481aa84-97e5-4c61-a973-c0b28bd22b84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:02.019864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3481aa84-97e5-4c61-a973-c0b28bd22b84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:02.020373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3481aa84-97e5-4c61-a973-c0b28bd22b84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:02.020806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3481aa84-97e5-4c61-a973-c0b28bd22b84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:02.021480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3481aa84-97e5-4c61-a973-c0b28bd22b84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:02.021930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3481aa84-97e5-4c61-a973-c0b28bd22b84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:02.022349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3481aa84-97e5-4c61-a973-c0b28bd22b84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:02.081377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3481aa84-97e5-4c61-a973-c0b28bd22b84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:02.088760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3481aa84-97e5-4c61-a973-c0b28bd22b84 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.079158 Aug 06 12:39:02.089322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 414/979] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:02 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:39:02.523131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6303cf5b-814c-483a-a185-7665bc789b1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:02.525361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6303cf5b-814c-483a-a185-7665bc789b1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:02.531234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6303cf5b-814c-483a-a185-7665bc789b1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:02.531714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6303cf5b-814c-483a-a185-7665bc789b1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:02.532148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6303cf5b-814c-483a-a185-7665bc789b1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:02.532859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6303cf5b-814c-483a-a185-7665bc789b1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:02.533310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6303cf5b-814c-483a-a185-7665bc789b1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:02.533730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6303cf5b-814c-483a-a185-7665bc789b1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:02.562570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6303cf5b-814c-483a-a185-7665bc789b1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Aug 06 12:39:02.563178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 566/980] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:02 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:02.590564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-54b55c70-a3b9-4126-ad85-edf46c2f6696 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:02.592745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-54b55c70-a3b9-4126-ad85-edf46c2f6696 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:02.599651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b55c70-a3b9-4126-ad85-edf46c2f6696 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:02.600132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b55c70-a3b9-4126-ad85-edf46c2f6696 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:02.600608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b55c70-a3b9-4126-ad85-edf46c2f6696 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:02.601295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b55c70-a3b9-4126-ad85-edf46c2f6696 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:02.601775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b55c70-a3b9-4126-ad85-edf46c2f6696 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:02.602238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54b55c70-a3b9-4126-ad85-edf46c2f6696 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:02.630966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-54b55c70-a3b9-4126-ad85-edf46c2f6696 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044293 Aug 06 12:39:02.631506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 415/981] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:02 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:03.109838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aebfad7a-8d94-4ce6-b5c2-2fe48c13fa0c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:03.110486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aebfad7a-8d94-4ce6-b5c2-2fe48c13fa0c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:03.116920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aebfad7a-8d94-4ce6-b5c2-2fe48c13fa0c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:03.117399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aebfad7a-8d94-4ce6-b5c2-2fe48c13fa0c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:03.117835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aebfad7a-8d94-4ce6-b5c2-2fe48c13fa0c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:03.118523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aebfad7a-8d94-4ce6-b5c2-2fe48c13fa0c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:03.118979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aebfad7a-8d94-4ce6-b5c2-2fe48c13fa0c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:03.119403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aebfad7a-8d94-4ce6-b5c2-2fe48c13fa0c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:03.179827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aebfad7a-8d94-4ce6-b5c2-2fe48c13fa0c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:03.187488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aebfad7a-8d94-4ce6-b5c2-2fe48c13fa0c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081948 Aug 06 12:39:03.188042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 567/982] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:03 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:03.573758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-21b0ed27-fc45-4502-bef2-6fe51bf78cef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:03.575891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-21b0ed27-fc45-4502-bef2-6fe51bf78cef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:03.581742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b0ed27-fc45-4502-bef2-6fe51bf78cef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:03.582840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b0ed27-fc45-4502-bef2-6fe51bf78cef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:03.583262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b0ed27-fc45-4502-bef2-6fe51bf78cef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:03.583930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b0ed27-fc45-4502-bef2-6fe51bf78cef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:03.584401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b0ed27-fc45-4502-bef2-6fe51bf78cef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:03.584815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b0ed27-fc45-4502-bef2-6fe51bf78cef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:03.613344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-21b0ed27-fc45-4502-bef2-6fe51bf78cef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043539 Aug 06 12:39:03.613925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 416/983] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:03 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:03.647303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dcdd406f-3bbe-4370-b85a-90c8d56774cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:03.649465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dcdd406f-3bbe-4370-b85a-90c8d56774cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:03.655263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcdd406f-3bbe-4370-b85a-90c8d56774cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:03.655745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcdd406f-3bbe-4370-b85a-90c8d56774cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:03.656189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcdd406f-3bbe-4370-b85a-90c8d56774cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:03.656901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcdd406f-3bbe-4370-b85a-90c8d56774cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:03.657354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcdd406f-3bbe-4370-b85a-90c8d56774cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:03.657779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcdd406f-3bbe-4370-b85a-90c8d56774cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:03.687250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dcdd406f-3bbe-4370-b85a-90c8d56774cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044490 Aug 06 12:39:03.687966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 568/984] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:04.209120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5f44c1e9-e121-445f-b260-c0689cba9a59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:04.209680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5f44c1e9-e121-445f-b260-c0689cba9a59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:04.215640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f44c1e9-e121-445f-b260-c0689cba9a59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:04.216126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f44c1e9-e121-445f-b260-c0689cba9a59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:04.216587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f44c1e9-e121-445f-b260-c0689cba9a59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:04.217271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f44c1e9-e121-445f-b260-c0689cba9a59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:04.217722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f44c1e9-e121-445f-b260-c0689cba9a59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:04.218141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f44c1e9-e121-445f-b260-c0689cba9a59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:04.279675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5f44c1e9-e121-445f-b260-c0689cba9a59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:04.287281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5f44c1e9-e121-445f-b260-c0689cba9a59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082864 Aug 06 12:39:04.287839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 417/985] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:04 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:04.625425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dcb67dfc-3264-414d-82e2-f8cd81ed559c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:04.627559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dcb67dfc-3264-414d-82e2-f8cd81ed559c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:04.634510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcb67dfc-3264-414d-82e2-f8cd81ed559c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:04.634994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcb67dfc-3264-414d-82e2-f8cd81ed559c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:04.635418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcb67dfc-3264-414d-82e2-f8cd81ed559c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:04.636099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcb67dfc-3264-414d-82e2-f8cd81ed559c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:04.636575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcb67dfc-3264-414d-82e2-f8cd81ed559c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:04.636995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcb67dfc-3264-414d-82e2-f8cd81ed559c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:04.664462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dcb67dfc-3264-414d-82e2-f8cd81ed559c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042988 Aug 06 12:39:04.665082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 569/986] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:04.699281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b43963be-9d9a-44f7-b87a-ab24877ba29e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:04.701461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b43963be-9d9a-44f7-b87a-ab24877ba29e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:04.707724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b43963be-9d9a-44f7-b87a-ab24877ba29e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:04.708206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b43963be-9d9a-44f7-b87a-ab24877ba29e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:04.708674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b43963be-9d9a-44f7-b87a-ab24877ba29e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:04.709359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b43963be-9d9a-44f7-b87a-ab24877ba29e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:04.709812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b43963be-9d9a-44f7-b87a-ab24877ba29e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:04.710231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b43963be-9d9a-44f7-b87a-ab24877ba29e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:04.739477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b43963be-9d9a-44f7-b87a-ab24877ba29e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044088 Aug 06 12:39:04.740020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 418/987] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:05.307298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d4635a08-93fa-479e-9bc2-4c42fd10449a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:05.307916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d4635a08-93fa-479e-9bc2-4c42fd10449a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:05.313877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4635a08-93fa-479e-9bc2-4c42fd10449a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:05.314356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4635a08-93fa-479e-9bc2-4c42fd10449a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:05.314787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4635a08-93fa-479e-9bc2-4c42fd10449a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:05.315472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4635a08-93fa-479e-9bc2-4c42fd10449a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:05.315922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4635a08-93fa-479e-9bc2-4c42fd10449a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:05.316368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4635a08-93fa-479e-9bc2-4c42fd10449a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:05.376531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d4635a08-93fa-479e-9bc2-4c42fd10449a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:05.383880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d4635a08-93fa-479e-9bc2-4c42fd10449a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080685 Aug 06 12:39:05.384464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 570/988] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:05 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:05.676584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f2087fc9-4ff2-49b3-871b-bc6176662989 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:05.678733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f2087fc9-4ff2-49b3-871b-bc6176662989 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:05.684547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2087fc9-4ff2-49b3-871b-bc6176662989 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:05.685017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2087fc9-4ff2-49b3-871b-bc6176662989 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:05.685442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2087fc9-4ff2-49b3-871b-bc6176662989 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:05.686113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2087fc9-4ff2-49b3-871b-bc6176662989 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:05.686555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2087fc9-4ff2-49b3-871b-bc6176662989 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:05.686965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2087fc9-4ff2-49b3-871b-bc6176662989 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:05.711769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:05.716243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f2087fc9-4ff2-49b3-871b-bc6176662989 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Aug 06 12:39:05.716809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 419/989] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:05 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:05.751159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cb818c30-a884-44f4-a61f-1cf8a9c3f077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:05.753307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cb818c30-a884-44f4-a61f-1cf8a9c3f077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:05.760079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb818c30-a884-44f4-a61f-1cf8a9c3f077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:05.760582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb818c30-a884-44f4-a61f-1cf8a9c3f077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:05.761008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb818c30-a884-44f4-a61f-1cf8a9c3f077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:05.761685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb818c30-a884-44f4-a61f-1cf8a9c3f077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:05.762127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb818c30-a884-44f4-a61f-1cf8a9c3f077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:05.762540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb818c30-a884-44f4-a61f-1cf8a9c3f077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:05.791019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cb818c30-a884-44f4-a61f-1cf8a9c3f077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043806 Aug 06 12:39:05.791554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 571/990] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:06.404781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d5460612-d1cc-463d-8893-e5f9e5c7eba5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:06.405380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d5460612-d1cc-463d-8893-e5f9e5c7eba5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:06.411793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d5460612-d1cc-463d-8893-e5f9e5c7eba5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:06.412262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d5460612-d1cc-463d-8893-e5f9e5c7eba5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:06.412712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d5460612-d1cc-463d-8893-e5f9e5c7eba5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:06.413386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d5460612-d1cc-463d-8893-e5f9e5c7eba5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:06.413830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d5460612-d1cc-463d-8893-e5f9e5c7eba5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:06.414244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d5460612-d1cc-463d-8893-e5f9e5c7eba5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:06.475645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d5460612-d1cc-463d-8893-e5f9e5c7eba5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:06.483117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d5460612-d1cc-463d-8893-e5f9e5c7eba5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082537 Aug 06 12:39:06.483933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 420/991] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:06 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:06.729139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-edb5351f-3479-4562-9ab9-d006390ef87a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:06.731277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-edb5351f-3479-4562-9ab9-d006390ef87a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:06.737729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edb5351f-3479-4562-9ab9-d006390ef87a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:06.738212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edb5351f-3479-4562-9ab9-d006390ef87a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:06.738645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edb5351f-3479-4562-9ab9-d006390ef87a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:06.739355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edb5351f-3479-4562-9ab9-d006390ef87a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:06.739802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edb5351f-3479-4562-9ab9-d006390ef87a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:06.740225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-edb5351f-3479-4562-9ab9-d006390ef87a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:06.767979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-edb5351f-3479-4562-9ab9-d006390ef87a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042910 Aug 06 12:39:06.768698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 572/992] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:06 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:06.803086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-91bc855c-a089-4ceb-afc3-bf28842c580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:06.805215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-91bc855c-a089-4ceb-afc3-bf28842c580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:06.811427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91bc855c-a089-4ceb-afc3-bf28842c580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:06.811900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91bc855c-a089-4ceb-afc3-bf28842c580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:06.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91bc855c-a089-4ceb-afc3-bf28842c580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:06.813021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91bc855c-a089-4ceb-afc3-bf28842c580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:06.813460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91bc855c-a089-4ceb-afc3-bf28842c580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:06.813874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91bc855c-a089-4ceb-afc3-bf28842c580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:06.842510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-91bc855c-a089-4ceb-afc3-bf28842c580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043355 Aug 06 12:39:06.843057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 421/993] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:06 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:07.503570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3f15f6b-9b7e-413e-a8ca-4876c1f23dd0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:07.504838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d3f15f6b-9b7e-413e-a8ca-4876c1f23dd0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:07.510825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f15f6b-9b7e-413e-a8ca-4876c1f23dd0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:07.511299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f15f6b-9b7e-413e-a8ca-4876c1f23dd0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:07.511728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f15f6b-9b7e-413e-a8ca-4876c1f23dd0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:07.512429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f15f6b-9b7e-413e-a8ca-4876c1f23dd0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:07.512883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f15f6b-9b7e-413e-a8ca-4876c1f23dd0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:07.513305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f15f6b-9b7e-413e-a8ca-4876c1f23dd0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:07.517211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:07.576218 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d3f15f6b-9b7e-413e-a8ca-4876c1f23dd0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:07.583582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3f15f6b-9b7e-413e-a8ca-4876c1f23dd0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083857 Aug 06 12:39:07.584134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 573/994] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:07 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:07.780526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-20a5fd83-4b4d-4142-9d32-b449579da24a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:07.782559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-20a5fd83-4b4d-4142-9d32-b449579da24a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:07.788480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20a5fd83-4b4d-4142-9d32-b449579da24a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:07.788961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20a5fd83-4b4d-4142-9d32-b449579da24a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:07.789392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20a5fd83-4b4d-4142-9d32-b449579da24a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:07.790072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20a5fd83-4b4d-4142-9d32-b449579da24a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:07.790520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20a5fd83-4b4d-4142-9d32-b449579da24a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:07.790939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20a5fd83-4b4d-4142-9d32-b449579da24a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:07.820015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-20a5fd83-4b4d-4142-9d32-b449579da24a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043401 Aug 06 12:39:07.820708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 422/995] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:07 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:07.854915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-40fc7832-f063-4729-b50d-fe1074ff8777 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:07.857047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-40fc7832-f063-4729-b50d-fe1074ff8777 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:07.864094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40fc7832-f063-4729-b50d-fe1074ff8777 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:07.864603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40fc7832-f063-4729-b50d-fe1074ff8777 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:07.865029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40fc7832-f063-4729-b50d-fe1074ff8777 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:07.865708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40fc7832-f063-4729-b50d-fe1074ff8777 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:07.866152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40fc7832-f063-4729-b50d-fe1074ff8777 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:07.866589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40fc7832-f063-4729-b50d-fe1074ff8777 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:07.894000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-40fc7832-f063-4729-b50d-fe1074ff8777 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042981 Aug 06 12:39:07.894534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 574/996] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:07 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:39:08.603480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-48a6fb9a-31be-49e0-8a39-fe257d4992be tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:08.604080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-48a6fb9a-31be-49e0-8a39-fe257d4992be tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:08.610237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48a6fb9a-31be-49e0-8a39-fe257d4992be tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:08.610712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48a6fb9a-31be-49e0-8a39-fe257d4992be tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:08.611141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48a6fb9a-31be-49e0-8a39-fe257d4992be tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:08.611819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48a6fb9a-31be-49e0-8a39-fe257d4992be tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:08.612267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48a6fb9a-31be-49e0-8a39-fe257d4992be tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:08.612709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48a6fb9a-31be-49e0-8a39-fe257d4992be tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:08.674475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-48a6fb9a-31be-49e0-8a39-fe257d4992be tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:08.681776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-48a6fb9a-31be-49e0-8a39-fe257d4992be tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082159 Aug 06 12:39:08.682327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 423/997] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:08 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:08.831159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3bdf7831-d042-49d4-949b-512edbb035af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:08.834066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3bdf7831-d042-49d4-949b-512edbb035af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:08.839907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdf7831-d042-49d4-949b-512edbb035af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:08.840417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdf7831-d042-49d4-949b-512edbb035af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:08.840844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdf7831-d042-49d4-949b-512edbb035af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:08.841517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdf7831-d042-49d4-949b-512edbb035af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:08.841959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdf7831-d042-49d4-949b-512edbb035af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:08.842375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bdf7831-d042-49d4-949b-512edbb035af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:08.870779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3bdf7831-d042-49d4-949b-512edbb035af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043599 Aug 06 12:39:08.871369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 575/998] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:08 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:08.905638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-516a3c38-227b-4ace-925d-04120d4143d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:08.907736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-516a3c38-227b-4ace-925d-04120d4143d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:08.914053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-516a3c38-227b-4ace-925d-04120d4143d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:08.914532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-516a3c38-227b-4ace-925d-04120d4143d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:08.914963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-516a3c38-227b-4ace-925d-04120d4143d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:08.915642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-516a3c38-227b-4ace-925d-04120d4143d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:08.916088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-516a3c38-227b-4ace-925d-04120d4143d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:08.916539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-516a3c38-227b-4ace-925d-04120d4143d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:08.944929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-516a3c38-227b-4ace-925d-04120d4143d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043167 Aug 06 12:39:08.945411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 424/999] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:08 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:09.702607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-14e02bec-e88e-40d5-add4-6d11167e828d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:09.703214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-14e02bec-e88e-40d5-add4-6d11167e828d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:09.709719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e02bec-e88e-40d5-add4-6d11167e828d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:09.710203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e02bec-e88e-40d5-add4-6d11167e828d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:09.710635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e02bec-e88e-40d5-add4-6d11167e828d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:09.711310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e02bec-e88e-40d5-add4-6d11167e828d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:09.711786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e02bec-e88e-40d5-add4-6d11167e828d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:09.712206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e02bec-e88e-40d5-add4-6d11167e828d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:09.772323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-14e02bec-e88e-40d5-add4-6d11167e828d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:09.779765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-14e02bec-e88e-40d5-add4-6d11167e828d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081058 Aug 06 12:39:09.780321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 576/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:09 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:09.882790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4155c757-a071-4a42-b93a-35e3812ad20b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:09.884926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4155c757-a071-4a42-b93a-35e3812ad20b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:09.890732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4155c757-a071-4a42-b93a-35e3812ad20b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:09.891200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4155c757-a071-4a42-b93a-35e3812ad20b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:09.891625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4155c757-a071-4a42-b93a-35e3812ad20b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:09.892291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4155c757-a071-4a42-b93a-35e3812ad20b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:09.892756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4155c757-a071-4a42-b93a-35e3812ad20b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:09.893168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4155c757-a071-4a42-b93a-35e3812ad20b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:09.922080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4155c757-a071-4a42-b93a-35e3812ad20b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043192 Aug 06 12:39:09.922645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 425/1001] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:09 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:09.956432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4addaf2a-d438-4b0a-8371-399b83bf8ec2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:09.959055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4addaf2a-d438-4b0a-8371-399b83bf8ec2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:09.965320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4addaf2a-d438-4b0a-8371-399b83bf8ec2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:09.965794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4addaf2a-d438-4b0a-8371-399b83bf8ec2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:09.966223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4addaf2a-d438-4b0a-8371-399b83bf8ec2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:09.966900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4addaf2a-d438-4b0a-8371-399b83bf8ec2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:09.967345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4addaf2a-d438-4b0a-8371-399b83bf8ec2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:09.967763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4addaf2a-d438-4b0a-8371-399b83bf8ec2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:09.998151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4addaf2a-d438-4b0a-8371-399b83bf8ec2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045732 Aug 06 12:39:09.998723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 577/1002] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:39:10.800595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-64b73863-3245-4f61-99a2-3476771d8f6b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:10.801728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-64b73863-3245-4f61-99a2-3476771d8f6b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:10.807553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64b73863-3245-4f61-99a2-3476771d8f6b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:10.808033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64b73863-3245-4f61-99a2-3476771d8f6b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:10.808505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64b73863-3245-4f61-99a2-3476771d8f6b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:10.809181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64b73863-3245-4f61-99a2-3476771d8f6b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:10.809629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64b73863-3245-4f61-99a2-3476771d8f6b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:10.810049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64b73863-3245-4f61-99a2-3476771d8f6b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:10.872266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-64b73863-3245-4f61-99a2-3476771d8f6b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:10.883243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-64b73863-3245-4f61-99a2-3476771d8f6b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.086502 Aug 06 12:39:10.883802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 426/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:10 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:10.934232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19c93edb-c3fe-43a6-a525-8fa6e9d528ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:10.936443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19c93edb-c3fe-43a6-a525-8fa6e9d528ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:10.942263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c93edb-c3fe-43a6-a525-8fa6e9d528ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:10.942762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c93edb-c3fe-43a6-a525-8fa6e9d528ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:10.943187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c93edb-c3fe-43a6-a525-8fa6e9d528ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:10.943860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c93edb-c3fe-43a6-a525-8fa6e9d528ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:10.944323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c93edb-c3fe-43a6-a525-8fa6e9d528ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:10.944749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c93edb-c3fe-43a6-a525-8fa6e9d528ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:10.973120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19c93edb-c3fe-43a6-a525-8fa6e9d528ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 Aug 06 12:39:10.973705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 578/1004] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:10 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:11.010730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4f6b802-2d7e-4587-ad8b-8fc38eba8f86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:11.012847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c4f6b802-2d7e-4587-ad8b-8fc38eba8f86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:11.019088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4f6b802-2d7e-4587-ad8b-8fc38eba8f86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:11.019565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4f6b802-2d7e-4587-ad8b-8fc38eba8f86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:11.019992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4f6b802-2d7e-4587-ad8b-8fc38eba8f86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:11.020707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4f6b802-2d7e-4587-ad8b-8fc38eba8f86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:11.021151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4f6b802-2d7e-4587-ad8b-8fc38eba8f86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:11.021566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4f6b802-2d7e-4587-ad8b-8fc38eba8f86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:11.050021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c4f6b802-2d7e-4587-ad8b-8fc38eba8f86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043251 Aug 06 12:39:11.050570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 427/1005] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:11 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:39:11.906230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c3363078-a40b-4a09-a457-83eb19aea7d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:11.908294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c3363078-a40b-4a09-a457-83eb19aea7d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:11.913246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3363078-a40b-4a09-a457-83eb19aea7d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:11.913713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3363078-a40b-4a09-a457-83eb19aea7d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:11.914147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3363078-a40b-4a09-a457-83eb19aea7d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:11.914984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3363078-a40b-4a09-a457-83eb19aea7d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:11.915444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3363078-a40b-4a09-a457-83eb19aea7d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:11.915868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3363078-a40b-4a09-a457-83eb19aea7d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:11.976204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c3363078-a40b-4a09-a457-83eb19aea7d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:11.983959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c3363078-a40b-4a09-a457-83eb19aea7d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081591 Aug 06 12:39:11.984547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 579/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:11 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:11.985487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fb5745bc-6c9d-4f00-b9eb-15c57939a417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:11.987614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fb5745bc-6c9d-4f00-b9eb-15c57939a417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:11.998123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb5745bc-6c9d-4f00-b9eb-15c57939a417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:11.998606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb5745bc-6c9d-4f00-b9eb-15c57939a417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:11.999034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb5745bc-6c9d-4f00-b9eb-15c57939a417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:11.999888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb5745bc-6c9d-4f00-b9eb-15c57939a417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:12.000345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb5745bc-6c9d-4f00-b9eb-15c57939a417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:12.000763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb5745bc-6c9d-4f00-b9eb-15c57939a417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:12.030501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fb5745bc-6c9d-4f00-b9eb-15c57939a417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049119 Aug 06 12:39:12.031371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 428/1007] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:11 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:39:12.062939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0143b12c-a4d4-409a-a493-97a00fa65fe5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:12.065417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0143b12c-a4d4-409a-a493-97a00fa65fe5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:12.073309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0143b12c-a4d4-409a-a493-97a00fa65fe5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:12.073790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0143b12c-a4d4-409a-a493-97a00fa65fe5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:12.074223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0143b12c-a4d4-409a-a493-97a00fa65fe5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:12.075107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0143b12c-a4d4-409a-a493-97a00fa65fe5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:12.075635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0143b12c-a4d4-409a-a493-97a00fa65fe5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:12.076060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0143b12c-a4d4-409a-a493-97a00fa65fe5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:12.105875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0143b12c-a4d4-409a-a493-97a00fa65fe5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046913 Aug 06 12:39:12.106441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 580/1008] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:12 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:13.007180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-53f0e2d2-4c17-477f-85d9-ca88e5f5dfc9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:13.007778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-53f0e2d2-4c17-477f-85d9-ca88e5f5dfc9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:13.009660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=84 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:13.014856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53f0e2d2-4c17-477f-85d9-ca88e5f5dfc9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:13.015326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53f0e2d2-4c17-477f-85d9-ca88e5f5dfc9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:13.015757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53f0e2d2-4c17-477f-85d9-ca88e5f5dfc9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:13.016466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53f0e2d2-4c17-477f-85d9-ca88e5f5dfc9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:13.016915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53f0e2d2-4c17-477f-85d9-ca88e5f5dfc9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:13.017329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53f0e2d2-4c17-477f-85d9-ca88e5f5dfc9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:13.042803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4509e50-37f7-47ab-af60-c1aa96c701ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:13.044968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4509e50-37f7-47ab-af60-c1aa96c701ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:13.051287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4509e50-37f7-47ab-af60-c1aa96c701ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:13.051761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4509e50-37f7-47ab-af60-c1aa96c701ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:13.052189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4509e50-37f7-47ab-af60-c1aa96c701ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:13.052903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4509e50-37f7-47ab-af60-c1aa96c701ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:13.053351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4509e50-37f7-47ab-af60-c1aa96c701ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:13.053766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4509e50-37f7-47ab-af60-c1aa96c701ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:13.078959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-53f0e2d2-4c17-477f-85d9-ca88e5f5dfc9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:13.082959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4509e50-37f7-47ab-af60-c1aa96c701ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 Aug 06 12:39:13.083745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 581/1009] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:13 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:39:13.086756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-53f0e2d2-4c17-477f-85d9-ca88e5f5dfc9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083353 Aug 06 12:39:13.087441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 429/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:13 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:13.118017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-92f4e1bc-57eb-4227-87bf-d17859c11319 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:13.120165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-92f4e1bc-57eb-4227-87bf-d17859c11319 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:13.125937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92f4e1bc-57eb-4227-87bf-d17859c11319 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:13.126404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92f4e1bc-57eb-4227-87bf-d17859c11319 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:13.126829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92f4e1bc-57eb-4227-87bf-d17859c11319 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:13.127500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92f4e1bc-57eb-4227-87bf-d17859c11319 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:13.127941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92f4e1bc-57eb-4227-87bf-d17859c11319 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:13.128381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92f4e1bc-57eb-4227-87bf-d17859c11319 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:13.160172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-92f4e1bc-57eb-4227-87bf-d17859c11319 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045798 Aug 06 12:39:13.160763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 582/1011] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:13 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:39:14.095202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5a145042-2043-40fd-8d18-f8bce28476cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:14.097279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5a145042-2043-40fd-8d18-f8bce28476cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:14.104044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a145042-2043-40fd-8d18-f8bce28476cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:14.104551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a145042-2043-40fd-8d18-f8bce28476cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:14.104982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a145042-2043-40fd-8d18-f8bce28476cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:14.105659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a145042-2043-40fd-8d18-f8bce28476cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:14.106099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a145042-2043-40fd-8d18-f8bce28476cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:14.106512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a145042-2043-40fd-8d18-f8bce28476cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:14.106894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e95a74f-30fe-4591-957c-120ffd519979 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:14.107644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1e95a74f-30fe-4591-957c-120ffd519979 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:14.114814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e95a74f-30fe-4591-957c-120ffd519979 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:14.115290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e95a74f-30fe-4591-957c-120ffd519979 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:14.115720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e95a74f-30fe-4591-957c-120ffd519979 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:14.116437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e95a74f-30fe-4591-957c-120ffd519979 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:14.116916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e95a74f-30fe-4591-957c-120ffd519979 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:14.117368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e95a74f-30fe-4591-957c-120ffd519979 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:14.135820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5a145042-2043-40fd-8d18-f8bce28476cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044543 Aug 06 12:39:14.136411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 430/1012] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:14 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:14.172472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2b197abf-2a30-45b5-9ae0-4e8bcf27fc47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:14.174608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2b197abf-2a30-45b5-9ae0-4e8bcf27fc47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:14.179849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1e95a74f-30fe-4591-957c-120ffd519979 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:14.181106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b197abf-2a30-45b5-9ae0-4e8bcf27fc47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:14.181761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b197abf-2a30-45b5-9ae0-4e8bcf27fc47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:14.182069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b197abf-2a30-45b5-9ae0-4e8bcf27fc47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:14.182745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b197abf-2a30-45b5-9ae0-4e8bcf27fc47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:14.183191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b197abf-2a30-45b5-9ae0-4e8bcf27fc47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:14.183598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b197abf-2a30-45b5-9ae0-4e8bcf27fc47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:14.187334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1e95a74f-30fe-4591-957c-120ffd519979 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084357 Aug 06 12:39:14.187898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 583/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:14 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:39:14.214171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2b197abf-2a30-45b5-9ae0-4e8bcf27fc47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045703 Aug 06 12:39:14.214749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 431/1014] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:39:15.147654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c8af8adf-6be9-4852-ba28-dfe01c83bdce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:15.149896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c8af8adf-6be9-4852-ba28-dfe01c83bdce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:15.156212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8af8adf-6be9-4852-ba28-dfe01c83bdce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:15.156723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8af8adf-6be9-4852-ba28-dfe01c83bdce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:15.157157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8af8adf-6be9-4852-ba28-dfe01c83bdce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:15.157843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8af8adf-6be9-4852-ba28-dfe01c83bdce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:15.158294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8af8adf-6be9-4852-ba28-dfe01c83bdce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:15.158719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8af8adf-6be9-4852-ba28-dfe01c83bdce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:15.186799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c8af8adf-6be9-4852-ba28-dfe01c83bdce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043599 Aug 06 12:39:15.187341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 584/1015] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:15 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:15.207078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d1e00146-4150-4ec7-8a52-49ae9696ef35 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:15.208193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d1e00146-4150-4ec7-8a52-49ae9696ef35 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:15.214506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1e00146-4150-4ec7-8a52-49ae9696ef35 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:15.214989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1e00146-4150-4ec7-8a52-49ae9696ef35 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:15.215417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1e00146-4150-4ec7-8a52-49ae9696ef35 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:15.216090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1e00146-4150-4ec7-8a52-49ae9696ef35 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:15.216564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1e00146-4150-4ec7-8a52-49ae9696ef35 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:15.216988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1e00146-4150-4ec7-8a52-49ae9696ef35 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:15.226174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9d5b93e2-4983-4470-a4be-972c4cad7061 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:15.228315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9d5b93e2-4983-4470-a4be-972c4cad7061 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:15.234325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d5b93e2-4983-4470-a4be-972c4cad7061 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:15.234835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d5b93e2-4983-4470-a4be-972c4cad7061 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:15.235277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d5b93e2-4983-4470-a4be-972c4cad7061 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:15.235988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d5b93e2-4983-4470-a4be-972c4cad7061 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:15.236463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d5b93e2-4983-4470-a4be-972c4cad7061 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:15.236887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d5b93e2-4983-4470-a4be-972c4cad7061 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:15.265751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9d5b93e2-4983-4470-a4be-972c4cad7061 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043793 Aug 06 12:39:15.266234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 585/1016] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:15 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:39:15.278322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d1e00146-4150-4ec7-8a52-49ae9696ef35 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:15.286487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d1e00146-4150-4ec7-8a52-49ae9696ef35 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082508 Aug 06 12:39:15.287033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 432/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:15 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:39:16.199301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-780f9465-e81e-495f-8366-6854697fd728 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:16.201450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-780f9465-e81e-495f-8366-6854697fd728 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:16.208433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-780f9465-e81e-495f-8366-6854697fd728 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:16.208909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-780f9465-e81e-495f-8366-6854697fd728 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:16.209335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-780f9465-e81e-495f-8366-6854697fd728 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:16.210014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-780f9465-e81e-495f-8366-6854697fd728 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:16.210477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-780f9465-e81e-495f-8366-6854697fd728 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:16.210874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-780f9465-e81e-495f-8366-6854697fd728 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:16.238822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-780f9465-e81e-495f-8366-6854697fd728 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043517 Aug 06 12:39:16.239370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 586/1018] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:16 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:16.277614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d68b5e34-80f1-40ef-9475-79e029197c23 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:16.279640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d68b5e34-80f1-40ef-9475-79e029197c23 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:16.285657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d68b5e34-80f1-40ef-9475-79e029197c23 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:16.286130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d68b5e34-80f1-40ef-9475-79e029197c23 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:16.286558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d68b5e34-80f1-40ef-9475-79e029197c23 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:16.287223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d68b5e34-80f1-40ef-9475-79e029197c23 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:16.287666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d68b5e34-80f1-40ef-9475-79e029197c23 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:16.288079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d68b5e34-80f1-40ef-9475-79e029197c23 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:16.306690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9a12f9a9-3cd5-483c-a75f-2df64ea33512 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:16.307320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9a12f9a9-3cd5-483c-a75f-2df64ea33512 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:16.313419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a12f9a9-3cd5-483c-a75f-2df64ea33512 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:16.313898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a12f9a9-3cd5-483c-a75f-2df64ea33512 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:16.314333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a12f9a9-3cd5-483c-a75f-2df64ea33512 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:16.315018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a12f9a9-3cd5-483c-a75f-2df64ea33512 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:16.315466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a12f9a9-3cd5-483c-a75f-2df64ea33512 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:16.315886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a12f9a9-3cd5-483c-a75f-2df64ea33512 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:16.315985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d68b5e34-80f1-40ef-9475-79e029197c23 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042253 Aug 06 12:39:16.316537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 433/1019] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:16.378871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9a12f9a9-3cd5-483c-a75f-2df64ea33512 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:16.386824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9a12f9a9-3cd5-483c-a75f-2df64ea33512 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083944 Aug 06 12:39:16.387387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 587/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:16 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:39:17.250443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-88a92e72-85b6-4239-8ab7-0e2cacba7179 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:17.252590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-88a92e72-85b6-4239-8ab7-0e2cacba7179 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:17.259152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88a92e72-85b6-4239-8ab7-0e2cacba7179 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:17.259622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88a92e72-85b6-4239-8ab7-0e2cacba7179 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:17.260048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88a92e72-85b6-4239-8ab7-0e2cacba7179 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:17.260839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88a92e72-85b6-4239-8ab7-0e2cacba7179 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:17.261289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88a92e72-85b6-4239-8ab7-0e2cacba7179 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:17.261729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88a92e72-85b6-4239-8ab7-0e2cacba7179 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:17.289836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-88a92e72-85b6-4239-8ab7-0e2cacba7179 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043421 Aug 06 12:39:17.290463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 434/1021] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:17 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:17.328694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e4d8b5e2-b6d7-425f-b8b3-e725ceed6336 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:17.330810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e4d8b5e2-b6d7-425f-b8b3-e725ceed6336 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:17.337662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d8b5e2-b6d7-425f-b8b3-e725ceed6336 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:17.338135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d8b5e2-b6d7-425f-b8b3-e725ceed6336 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:17.338561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d8b5e2-b6d7-425f-b8b3-e725ceed6336 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:17.339237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d8b5e2-b6d7-425f-b8b3-e725ceed6336 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:17.339680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d8b5e2-b6d7-425f-b8b3-e725ceed6336 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:17.340110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d8b5e2-b6d7-425f-b8b3-e725ceed6336 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:17.368678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e4d8b5e2-b6d7-425f-b8b3-e725ceed6336 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043929 Aug 06 12:39:17.369223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 588/1022] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:17 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:39:17.407420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4349bb82-b1a4-4c4b-829c-d926b6622d74 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:17.408021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4349bb82-b1a4-4c4b-829c-d926b6622d74 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:17.414625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4349bb82-b1a4-4c4b-829c-d926b6622d74 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:17.415097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4349bb82-b1a4-4c4b-829c-d926b6622d74 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:17.415522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4349bb82-b1a4-4c4b-829c-d926b6622d74 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:17.416198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4349bb82-b1a4-4c4b-829c-d926b6622d74 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:17.416665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4349bb82-b1a4-4c4b-829c-d926b6622d74 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:17.417078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4349bb82-b1a4-4c4b-829c-d926b6622d74 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:17.480062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4349bb82-b1a4-4c4b-829c-d926b6622d74 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:17.487613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4349bb82-b1a4-4c4b-829c-d926b6622d74 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084018 Aug 06 12:39:17.488169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 435/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:17 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:18.302641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-101f8ed0-98c4-49b5-b7eb-614e5f00df44 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:18.304821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-101f8ed0-98c4-49b5-b7eb-614e5f00df44 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:18.310824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101f8ed0-98c4-49b5-b7eb-614e5f00df44 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:18.311299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101f8ed0-98c4-49b5-b7eb-614e5f00df44 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:18.311731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101f8ed0-98c4-49b5-b7eb-614e5f00df44 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:18.312447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101f8ed0-98c4-49b5-b7eb-614e5f00df44 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:18.312894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101f8ed0-98c4-49b5-b7eb-614e5f00df44 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:18.313405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101f8ed0-98c4-49b5-b7eb-614e5f00df44 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:18.338965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:18.344087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-101f8ed0-98c4-49b5-b7eb-614e5f00df44 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045996 Aug 06 12:39:18.344676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 589/1024] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:18 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:18.380745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dbe74778-a470-49de-a060-207d55e5103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:18.382833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dbe74778-a470-49de-a060-207d55e5103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:18.389238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbe74778-a470-49de-a060-207d55e5103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:18.389710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbe74778-a470-49de-a060-207d55e5103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:18.390135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbe74778-a470-49de-a060-207d55e5103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:18.390801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbe74778-a470-49de-a060-207d55e5103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:18.391243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbe74778-a470-49de-a060-207d55e5103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:18.391653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbe74778-a470-49de-a060-207d55e5103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:18.407606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:18.424174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dbe74778-a470-49de-a060-207d55e5103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047310 Aug 06 12:39:18.424747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 436/1025] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:18.507443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-21c33b1e-489a-456f-8a6b-e2ad3a54f352 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:18.508044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-21c33b1e-489a-456f-8a6b-e2ad3a54f352 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:18.514040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21c33b1e-489a-456f-8a6b-e2ad3a54f352 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:18.514512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21c33b1e-489a-456f-8a6b-e2ad3a54f352 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:18.514941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21c33b1e-489a-456f-8a6b-e2ad3a54f352 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:18.515611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21c33b1e-489a-456f-8a6b-e2ad3a54f352 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:18.516055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21c33b1e-489a-456f-8a6b-e2ad3a54f352 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:18.516510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21c33b1e-489a-456f-8a6b-e2ad3a54f352 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:18.577485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-21c33b1e-489a-456f-8a6b-e2ad3a54f352 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:18.584874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-21c33b1e-489a-456f-8a6b-e2ad3a54f352 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081740 Aug 06 12:39:18.585423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 590/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:18 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:19.356760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-43205c0c-9622-42f2-a6d4-069132a32031 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:19.359138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-43205c0c-9622-42f2-a6d4-069132a32031 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:19.365127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43205c0c-9622-42f2-a6d4-069132a32031 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:19.366973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43205c0c-9622-42f2-a6d4-069132a32031 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:19.366973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43205c0c-9622-42f2-a6d4-069132a32031 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:19.366973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43205c0c-9622-42f2-a6d4-069132a32031 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:19.367294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43205c0c-9622-42f2-a6d4-069132a32031 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:19.367833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43205c0c-9622-42f2-a6d4-069132a32031 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:19.398336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-43205c0c-9622-42f2-a6d4-069132a32031 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Aug 06 12:39:19.399030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 437/1027] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:19 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:19.437078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0ba9e986-6987-4432-9603-59a862d24879 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:19.439194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0ba9e986-6987-4432-9603-59a862d24879 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:19.445548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ba9e986-6987-4432-9603-59a862d24879 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:19.446018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ba9e986-6987-4432-9603-59a862d24879 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:19.446444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ba9e986-6987-4432-9603-59a862d24879 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:19.447118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ba9e986-6987-4432-9603-59a862d24879 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:19.447563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ba9e986-6987-4432-9603-59a862d24879 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:19.447981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ba9e986-6987-4432-9603-59a862d24879 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:19.479955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0ba9e986-6987-4432-9603-59a862d24879 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046868 Aug 06 12:39:19.480539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 591/1028] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:19.605086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3a2dc880-c1bf-4294-9dd1-4f05da32483e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:19.605683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3a2dc880-c1bf-4294-9dd1-4f05da32483e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:19.612142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a2dc880-c1bf-4294-9dd1-4f05da32483e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:19.612584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a2dc880-c1bf-4294-9dd1-4f05da32483e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:19.613013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a2dc880-c1bf-4294-9dd1-4f05da32483e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:19.613705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a2dc880-c1bf-4294-9dd1-4f05da32483e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:19.614151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a2dc880-c1bf-4294-9dd1-4f05da32483e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:19.614605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a2dc880-c1bf-4294-9dd1-4f05da32483e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:19.676246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3a2dc880-c1bf-4294-9dd1-4f05da32483e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:19.683705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3a2dc880-c1bf-4294-9dd1-4f05da32483e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082490 Aug 06 12:39:19.684256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 438/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:19 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:20.411212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e5e7a0e2-d097-4aac-bb71-b39135fa6aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:20.413405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e5e7a0e2-d097-4aac-bb71-b39135fa6aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:20.419334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5e7a0e2-d097-4aac-bb71-b39135fa6aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:20.419816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5e7a0e2-d097-4aac-bb71-b39135fa6aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:20.420246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5e7a0e2-d097-4aac-bb71-b39135fa6aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:20.420960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5e7a0e2-d097-4aac-bb71-b39135fa6aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:20.421409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5e7a0e2-d097-4aac-bb71-b39135fa6aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:20.421829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5e7a0e2-d097-4aac-bb71-b39135fa6aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:20.454210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e5e7a0e2-d097-4aac-bb71-b39135fa6aaf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047513 Aug 06 12:39:20.454830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 592/1030] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:20 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:20.492587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ca948c5d-3d70-42ee-a4d7-c9c0c5bae1fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:20.494742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ca948c5d-3d70-42ee-a4d7-c9c0c5bae1fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:20.501003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca948c5d-3d70-42ee-a4d7-c9c0c5bae1fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:20.501479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca948c5d-3d70-42ee-a4d7-c9c0c5bae1fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:20.501902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca948c5d-3d70-42ee-a4d7-c9c0c5bae1fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:20.502575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca948c5d-3d70-42ee-a4d7-c9c0c5bae1fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:20.503016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca948c5d-3d70-42ee-a4d7-c9c0c5bae1fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:20.503428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca948c5d-3d70-42ee-a4d7-c9c0c5bae1fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:20.534079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ca948c5d-3d70-42ee-a4d7-c9c0c5bae1fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045463 Aug 06 12:39:20.534824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 439/1031] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:20.703042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9bbef935-d0be-479e-bf6d-eb42a756fa05 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:20.703667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9bbef935-d0be-479e-bf6d-eb42a756fa05 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:20.710425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bbef935-d0be-479e-bf6d-eb42a756fa05 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:20.710887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bbef935-d0be-479e-bf6d-eb42a756fa05 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:20.711314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bbef935-d0be-479e-bf6d-eb42a756fa05 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:20.712102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bbef935-d0be-479e-bf6d-eb42a756fa05 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:20.712571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bbef935-d0be-479e-bf6d-eb42a756fa05 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:20.712993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bbef935-d0be-479e-bf6d-eb42a756fa05 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:20.774758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9bbef935-d0be-479e-bf6d-eb42a756fa05 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:20.782261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9bbef935-d0be-479e-bf6d-eb42a756fa05 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083133 Aug 06 12:39:20.782813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 593/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:20 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:21.467239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b443e176-3689-4524-9362-f2d74df07c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:21.469869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b443e176-3689-4524-9362-f2d74df07c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:21.476471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b443e176-3689-4524-9362-f2d74df07c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:21.476980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b443e176-3689-4524-9362-f2d74df07c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:21.477434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b443e176-3689-4524-9362-f2d74df07c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:21.478127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b443e176-3689-4524-9362-f2d74df07c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:21.478578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b443e176-3689-4524-9362-f2d74df07c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:21.478999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b443e176-3689-4524-9362-f2d74df07c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:21.508264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b443e176-3689-4524-9362-f2d74df07c94 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Aug 06 12:39:21.508865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 440/1033] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:21 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:21.547135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-18e35d44-5d44-4018-8906-1400c32508a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:21.549416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-18e35d44-5d44-4018-8906-1400c32508a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:21.556415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18e35d44-5d44-4018-8906-1400c32508a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:21.556888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18e35d44-5d44-4018-8906-1400c32508a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:21.557314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18e35d44-5d44-4018-8906-1400c32508a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:21.557988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18e35d44-5d44-4018-8906-1400c32508a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:21.558430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18e35d44-5d44-4018-8906-1400c32508a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:21.558849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18e35d44-5d44-4018-8906-1400c32508a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:21.586277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-18e35d44-5d44-4018-8906-1400c32508a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043277 Aug 06 12:39:21.586816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 594/1034] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:21 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:39:21.802768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-95a433df-cec3-46ba-8d56-065845976b59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:21.803410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-95a433df-cec3-46ba-8d56-065845976b59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:21.809312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a433df-cec3-46ba-8d56-065845976b59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:21.809797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a433df-cec3-46ba-8d56-065845976b59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:21.810231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a433df-cec3-46ba-8d56-065845976b59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:21.810971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a433df-cec3-46ba-8d56-065845976b59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:21.811464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a433df-cec3-46ba-8d56-065845976b59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:21.811907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a433df-cec3-46ba-8d56-065845976b59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:21.875993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-95a433df-cec3-46ba-8d56-065845976b59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:21.883444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-95a433df-cec3-46ba-8d56-065845976b59 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085004 Aug 06 12:39:21.884002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 441/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:21 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:22.519731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7669989-1cdf-4032-8f59-3019ecab1b13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:22.521924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7669989-1cdf-4032-8f59-3019ecab1b13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:22.527814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7669989-1cdf-4032-8f59-3019ecab1b13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:22.528291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7669989-1cdf-4032-8f59-3019ecab1b13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:22.528753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7669989-1cdf-4032-8f59-3019ecab1b13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:22.529439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7669989-1cdf-4032-8f59-3019ecab1b13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:22.529888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7669989-1cdf-4032-8f59-3019ecab1b13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:22.530317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7669989-1cdf-4032-8f59-3019ecab1b13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:22.558393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7669989-1cdf-4032-8f59-3019ecab1b13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042634 Aug 06 12:39:22.559017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 595/1036] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:22 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:22.598318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-60834a2d-603f-4a30-a453-d2cec8d2c4f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:22.600470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-60834a2d-603f-4a30-a453-d2cec8d2c4f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:22.606656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60834a2d-603f-4a30-a453-d2cec8d2c4f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:22.607123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60834a2d-603f-4a30-a453-d2cec8d2c4f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:22.607545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60834a2d-603f-4a30-a453-d2cec8d2c4f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:22.608510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60834a2d-603f-4a30-a453-d2cec8d2c4f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:22.608955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60834a2d-603f-4a30-a453-d2cec8d2c4f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:22.609369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60834a2d-603f-4a30-a453-d2cec8d2c4f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:22.637859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-60834a2d-603f-4a30-a453-d2cec8d2c4f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043479 Aug 06 12:39:22.638383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 442/1037] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:22.903362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19416ed4-667e-48a9-9581-0690f68ebbaa tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:22.903997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19416ed4-667e-48a9-9581-0690f68ebbaa tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:22.909870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19416ed4-667e-48a9-9581-0690f68ebbaa tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:22.910347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19416ed4-667e-48a9-9581-0690f68ebbaa tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:22.910786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19416ed4-667e-48a9-9581-0690f68ebbaa tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:22.911988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19416ed4-667e-48a9-9581-0690f68ebbaa tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:22.912475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19416ed4-667e-48a9-9581-0690f68ebbaa tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:22.912901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19416ed4-667e-48a9-9581-0690f68ebbaa tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:22.973155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-19416ed4-667e-48a9-9581-0690f68ebbaa tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:22.980573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19416ed4-667e-48a9-9581-0690f68ebbaa tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081008 Aug 06 12:39:22.981137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 596/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:22 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:23.570897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-95d2b697-6d2a-4ddb-a50a-484eaeebc315 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:23.573013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-95d2b697-6d2a-4ddb-a50a-484eaeebc315 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:23.578783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d2b697-6d2a-4ddb-a50a-484eaeebc315 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:23.579254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d2b697-6d2a-4ddb-a50a-484eaeebc315 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:23.579677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d2b697-6d2a-4ddb-a50a-484eaeebc315 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:23.580366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d2b697-6d2a-4ddb-a50a-484eaeebc315 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:23.580811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d2b697-6d2a-4ddb-a50a-484eaeebc315 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:23.581228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d2b697-6d2a-4ddb-a50a-484eaeebc315 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:23.609947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-95d2b697-6d2a-4ddb-a50a-484eaeebc315 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043293 Aug 06 12:39:23.610529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 443/1039] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:23.649957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aaa5b682-a2e1-4ddb-b1b0-15d5c6e9aa6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:23.652088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aaa5b682-a2e1-4ddb-b1b0-15d5c6e9aa6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:23.654432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=88 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:23.659562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaa5b682-a2e1-4ddb-b1b0-15d5c6e9aa6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:23.660037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaa5b682-a2e1-4ddb-b1b0-15d5c6e9aa6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:23.660491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaa5b682-a2e1-4ddb-b1b0-15d5c6e9aa6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:23.661699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaa5b682-a2e1-4ddb-b1b0-15d5c6e9aa6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:23.662147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaa5b682-a2e1-4ddb-b1b0-15d5c6e9aa6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:23.662566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaa5b682-a2e1-4ddb-b1b0-15d5c6e9aa6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:23.691140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aaa5b682-a2e1-4ddb-b1b0-15d5c6e9aa6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045168 Aug 06 12:39:23.691689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 597/1040] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:24.000874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7600d3a2-ebe8-4675-9544-78884ff51717 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:24.001477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7600d3a2-ebe8-4675-9544-78884ff51717 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:24.007318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7600d3a2-ebe8-4675-9544-78884ff51717 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:24.007795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7600d3a2-ebe8-4675-9544-78884ff51717 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:24.008223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7600d3a2-ebe8-4675-9544-78884ff51717 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:24.008932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7600d3a2-ebe8-4675-9544-78884ff51717 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:24.009379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7600d3a2-ebe8-4675-9544-78884ff51717 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:24.009796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7600d3a2-ebe8-4675-9544-78884ff51717 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:24.072057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7600d3a2-ebe8-4675-9544-78884ff51717 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:24.079656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7600d3a2-ebe8-4675-9544-78884ff51717 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082522 Aug 06 12:39:24.080256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 444/1041] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:23 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:24.622746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8459ff2b-fba9-448c-ade1-7c7cf49768bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:24.624955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8459ff2b-fba9-448c-ade1-7c7cf49768bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:24.630838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8459ff2b-fba9-448c-ade1-7c7cf49768bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:24.631315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8459ff2b-fba9-448c-ade1-7c7cf49768bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:24.631746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8459ff2b-fba9-448c-ade1-7c7cf49768bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:24.632449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8459ff2b-fba9-448c-ade1-7c7cf49768bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:24.632900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8459ff2b-fba9-448c-ade1-7c7cf49768bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:24.633320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8459ff2b-fba9-448c-ade1-7c7cf49768bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:24.661633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8459ff2b-fba9-448c-ade1-7c7cf49768bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042388 Aug 06 12:39:24.662253 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 598/1042] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:24.703170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f1c12dc4-d210-4346-af69-26095b0da8b8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:24.705293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f1c12dc4-d210-4346-af69-26095b0da8b8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:24.712073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c12dc4-d210-4346-af69-26095b0da8b8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:24.712582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c12dc4-d210-4346-af69-26095b0da8b8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:24.713013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c12dc4-d210-4346-af69-26095b0da8b8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:24.713697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c12dc4-d210-4346-af69-26095b0da8b8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:24.714142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c12dc4-d210-4346-af69-26095b0da8b8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:24.714559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c12dc4-d210-4346-af69-26095b0da8b8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:24.744331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f1c12dc4-d210-4346-af69-26095b0da8b8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044973 Aug 06 12:39:24.744892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 445/1043] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:25.100219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-63dfab85-fadd-4412-990e-89e341ba69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:25.100846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-63dfab85-fadd-4412-990e-89e341ba69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:25.106912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63dfab85-fadd-4412-990e-89e341ba69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:25.107425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63dfab85-fadd-4412-990e-89e341ba69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:25.107860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63dfab85-fadd-4412-990e-89e341ba69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:25.108842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63dfab85-fadd-4412-990e-89e341ba69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:25.109293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63dfab85-fadd-4412-990e-89e341ba69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:25.109713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63dfab85-fadd-4412-990e-89e341ba69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:25.174226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-63dfab85-fadd-4412-990e-89e341ba69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:25.181644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-63dfab85-fadd-4412-990e-89e341ba69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085292 Aug 06 12:39:25.182193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 599/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:25 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:25.673678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-608911d0-93b7-4797-9212-d1c08e2797c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:25.675779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-608911d0-93b7-4797-9212-d1c08e2797c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:25.682215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-608911d0-93b7-4797-9212-d1c08e2797c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:25.682691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-608911d0-93b7-4797-9212-d1c08e2797c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:25.683115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-608911d0-93b7-4797-9212-d1c08e2797c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:25.683790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-608911d0-93b7-4797-9212-d1c08e2797c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:25.684266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-608911d0-93b7-4797-9212-d1c08e2797c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:25.684707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-608911d0-93b7-4797-9212-d1c08e2797c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:25.713138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-608911d0-93b7-4797-9212-d1c08e2797c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Aug 06 12:39:25.713766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 446/1045] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:25 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:25.757194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ba1a6b44-1f72-45f5-85a4-cf78d3d9a5a8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:25.759337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ba1a6b44-1f72-45f5-85a4-cf78d3d9a5a8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:25.765637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba1a6b44-1f72-45f5-85a4-cf78d3d9a5a8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:25.766110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba1a6b44-1f72-45f5-85a4-cf78d3d9a5a8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:25.766537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba1a6b44-1f72-45f5-85a4-cf78d3d9a5a8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:25.767214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba1a6b44-1f72-45f5-85a4-cf78d3d9a5a8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:25.767660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba1a6b44-1f72-45f5-85a4-cf78d3d9a5a8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:25.768078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba1a6b44-1f72-45f5-85a4-cf78d3d9a5a8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:25.797220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ba1a6b44-1f72-45f5-85a4-cf78d3d9a5a8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044680 Aug 06 12:39:25.797766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 600/1046] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:26.202402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b4484831-9a3b-4b8b-bd78-cb8e8e9ccd1a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:26.202997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b4484831-9a3b-4b8b-bd78-cb8e8e9ccd1a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:26.209534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4484831-9a3b-4b8b-bd78-cb8e8e9ccd1a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:26.210011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4484831-9a3b-4b8b-bd78-cb8e8e9ccd1a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:26.210436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4484831-9a3b-4b8b-bd78-cb8e8e9ccd1a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:26.211142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4484831-9a3b-4b8b-bd78-cb8e8e9ccd1a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:26.211585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4484831-9a3b-4b8b-bd78-cb8e8e9ccd1a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:26.212028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4484831-9a3b-4b8b-bd78-cb8e8e9ccd1a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:26.274483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b4484831-9a3b-4b8b-bd78-cb8e8e9ccd1a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:26.281760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b4484831-9a3b-4b8b-bd78-cb8e8e9ccd1a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083253 Aug 06 12:39:26.282305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 447/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:26 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:26.725321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e22452e-3641-4ff6-84c1-905ec5b212d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:26.727455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1e22452e-3641-4ff6-84c1-905ec5b212d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:26.733699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e22452e-3641-4ff6-84c1-905ec5b212d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:26.734180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e22452e-3641-4ff6-84c1-905ec5b212d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:26.734613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e22452e-3641-4ff6-84c1-905ec5b212d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:26.735328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e22452e-3641-4ff6-84c1-905ec5b212d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:26.735777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e22452e-3641-4ff6-84c1-905ec5b212d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:26.736196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e22452e-3641-4ff6-84c1-905ec5b212d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:26.765820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1e22452e-3641-4ff6-84c1-905ec5b212d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Aug 06 12:39:26.766467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 601/1048] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:39:26.809298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1f38e766-dc48-473f-9ae0-1f3996f5982b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:26.811391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f38e766-dc48-473f-9ae0-1f3996f5982b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:26.818229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f38e766-dc48-473f-9ae0-1f3996f5982b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:26.818699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f38e766-dc48-473f-9ae0-1f3996f5982b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:26.819124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f38e766-dc48-473f-9ae0-1f3996f5982b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:26.819813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f38e766-dc48-473f-9ae0-1f3996f5982b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:26.820247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f38e766-dc48-473f-9ae0-1f3996f5982b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:26.820689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f38e766-dc48-473f-9ae0-1f3996f5982b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:26.849927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1f38e766-dc48-473f-9ae0-1f3996f5982b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044580 Aug 06 12:39:26.850470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 448/1049] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:27.303046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2bb1deb1-21a9-438e-acec-44598de8816d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:27.303652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2bb1deb1-21a9-438e-acec-44598de8816d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:27.309582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb1deb1-21a9-438e-acec-44598de8816d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:27.310057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb1deb1-21a9-438e-acec-44598de8816d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:27.310486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb1deb1-21a9-438e-acec-44598de8816d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:27.311168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb1deb1-21a9-438e-acec-44598de8816d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:27.311615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb1deb1-21a9-438e-acec-44598de8816d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:27.312037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb1deb1-21a9-438e-acec-44598de8816d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:27.373879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2bb1deb1-21a9-438e-acec-44598de8816d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:27.381250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2bb1deb1-21a9-438e-acec-44598de8816d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082146 Aug 06 12:39:27.381796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 602/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:27 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:27.778649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9f04e4eb-dfcd-4b11-8f8f-6f112fd91f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:27.780684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9f04e4eb-dfcd-4b11-8f8f-6f112fd91f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:27.786702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f04e4eb-dfcd-4b11-8f8f-6f112fd91f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:27.787174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f04e4eb-dfcd-4b11-8f8f-6f112fd91f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:27.787604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f04e4eb-dfcd-4b11-8f8f-6f112fd91f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:27.788271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f04e4eb-dfcd-4b11-8f8f-6f112fd91f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:27.788739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f04e4eb-dfcd-4b11-8f8f-6f112fd91f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:27.789153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f04e4eb-dfcd-4b11-8f8f-6f112fd91f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:27.818133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9f04e4eb-dfcd-4b11-8f8f-6f112fd91f0c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042824 Aug 06 12:39:27.818765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 449/1051] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:27 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:27.862659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e2b09ff-fb2c-4aba-bec6-1bbbc894a559 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:27.865338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e2b09ff-fb2c-4aba-bec6-1bbbc894a559 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:27.871573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e2b09ff-fb2c-4aba-bec6-1bbbc894a559 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:27.872045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e2b09ff-fb2c-4aba-bec6-1bbbc894a559 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:27.872508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e2b09ff-fb2c-4aba-bec6-1bbbc894a559 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:27.873190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e2b09ff-fb2c-4aba-bec6-1bbbc894a559 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:27.873633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e2b09ff-fb2c-4aba-bec6-1bbbc894a559 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:27.874046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e2b09ff-fb2c-4aba-bec6-1bbbc894a559 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:27.902549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e2b09ff-fb2c-4aba-bec6-1bbbc894a559 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044160 Aug 06 12:39:27.903087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 603/1052] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:28.401244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-137a102b-3b6b-4290-8531-a902a55d6228 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:28.401844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-137a102b-3b6b-4290-8531-a902a55d6228 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:28.407732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-137a102b-3b6b-4290-8531-a902a55d6228 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:28.408210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-137a102b-3b6b-4290-8531-a902a55d6228 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:28.408673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-137a102b-3b6b-4290-8531-a902a55d6228 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:28.409374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-137a102b-3b6b-4290-8531-a902a55d6228 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:28.409814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-137a102b-3b6b-4290-8531-a902a55d6228 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:28.410238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-137a102b-3b6b-4290-8531-a902a55d6228 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:28.471138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-137a102b-3b6b-4290-8531-a902a55d6228 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:28.480738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-137a102b-3b6b-4290-8531-a902a55d6228 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083179 Aug 06 12:39:28.481304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 450/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:28 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:39:28.829899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a7c9e2b3-de35-4dd5-8e6e-c9b79314361a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:28.832062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a7c9e2b3-de35-4dd5-8e6e-c9b79314361a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:28.838086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7c9e2b3-de35-4dd5-8e6e-c9b79314361a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:28.838562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7c9e2b3-de35-4dd5-8e6e-c9b79314361a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:28.838991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7c9e2b3-de35-4dd5-8e6e-c9b79314361a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:28.839667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7c9e2b3-de35-4dd5-8e6e-c9b79314361a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:28.840112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7c9e2b3-de35-4dd5-8e6e-c9b79314361a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:28.840565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7c9e2b3-de35-4dd5-8e6e-c9b79314361a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:28.870146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a7c9e2b3-de35-4dd5-8e6e-c9b79314361a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044188 Aug 06 12:39:28.870779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 604/1054] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:28 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:28.914300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d45bd8c9-2792-4599-98af-d87ac6020e8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:28.916432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d45bd8c9-2792-4599-98af-d87ac6020e8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:28.922665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45bd8c9-2792-4599-98af-d87ac6020e8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:28.923145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45bd8c9-2792-4599-98af-d87ac6020e8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:28.923575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45bd8c9-2792-4599-98af-d87ac6020e8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:28.924255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45bd8c9-2792-4599-98af-d87ac6020e8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:28.924728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45bd8c9-2792-4599-98af-d87ac6020e8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:28.925149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45bd8c9-2792-4599-98af-d87ac6020e8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:28.953294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d45bd8c9-2792-4599-98af-d87ac6020e8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042970 Aug 06 12:39:28.953840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 451/1055] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:29.501557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e44407e3-a3f9-4042-9366-97bd9d5583b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:29.502159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e44407e3-a3f9-4042-9366-97bd9d5583b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:29.508754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44407e3-a3f9-4042-9366-97bd9d5583b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:29.509221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44407e3-a3f9-4042-9366-97bd9d5583b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:29.509649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44407e3-a3f9-4042-9366-97bd9d5583b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:29.510318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44407e3-a3f9-4042-9366-97bd9d5583b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:29.510760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44407e3-a3f9-4042-9366-97bd9d5583b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:29.511176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44407e3-a3f9-4042-9366-97bd9d5583b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:29.570995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e44407e3-a3f9-4042-9366-97bd9d5583b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:29.578365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e44407e3-a3f9-4042-9366-97bd9d5583b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080585 Aug 06 12:39:29.578859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 605/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:29 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:29.883404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ae049d88-001e-4b0f-a6eb-71a125a94e79 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:29.885759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ae049d88-001e-4b0f-a6eb-71a125a94e79 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:29.891536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae049d88-001e-4b0f-a6eb-71a125a94e79 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:29.892004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae049d88-001e-4b0f-a6eb-71a125a94e79 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:29.892472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae049d88-001e-4b0f-a6eb-71a125a94e79 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:29.893146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae049d88-001e-4b0f-a6eb-71a125a94e79 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:29.893595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae049d88-001e-4b0f-a6eb-71a125a94e79 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:29.894009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae049d88-001e-4b0f-a6eb-71a125a94e79 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:29.922454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ae049d88-001e-4b0f-a6eb-71a125a94e79 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043573 Aug 06 12:39:29.923067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 452/1057] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:29 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:29.966132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-58bb0be4-b7bc-4778-9f10-1b65c07b9638 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:29.968265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-58bb0be4-b7bc-4778-9f10-1b65c07b9638 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:29.974526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58bb0be4-b7bc-4778-9f10-1b65c07b9638 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:29.974998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58bb0be4-b7bc-4778-9f10-1b65c07b9638 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:29.975426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58bb0be4-b7bc-4778-9f10-1b65c07b9638 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:29.976103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58bb0be4-b7bc-4778-9f10-1b65c07b9638 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:29.976577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58bb0be4-b7bc-4778-9f10-1b65c07b9638 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:29.976995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58bb0be4-b7bc-4778-9f10-1b65c07b9638 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:29.993862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:30.008136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-58bb0be4-b7bc-4778-9f10-1b65c07b9638 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045943 Aug 06 12:39:30.008720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 606/1058] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:30.599494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aa4ee4c9-a8bf-45e6-87e0-1767e1aef5cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:30.600098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aa4ee4c9-a8bf-45e6-87e0-1767e1aef5cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:30.606019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa4ee4c9-a8bf-45e6-87e0-1767e1aef5cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:30.606528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa4ee4c9-a8bf-45e6-87e0-1767e1aef5cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:30.606956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa4ee4c9-a8bf-45e6-87e0-1767e1aef5cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:30.607640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa4ee4c9-a8bf-45e6-87e0-1767e1aef5cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:30.608376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa4ee4c9-a8bf-45e6-87e0-1767e1aef5cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:30.608798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa4ee4c9-a8bf-45e6-87e0-1767e1aef5cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:30.612604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:30.668702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aa4ee4c9-a8bf-45e6-87e0-1767e1aef5cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:30.675973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aa4ee4c9-a8bf-45e6-87e0-1767e1aef5cc tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080760 Aug 06 12:39:30.677181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 453/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:30 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:30.935022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-66dc7f5d-5624-4157-83b3-ac87ecf30b54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:30.937211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-66dc7f5d-5624-4157-83b3-ac87ecf30b54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:30.943700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66dc7f5d-5624-4157-83b3-ac87ecf30b54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:30.944170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66dc7f5d-5624-4157-83b3-ac87ecf30b54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:30.944629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66dc7f5d-5624-4157-83b3-ac87ecf30b54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:30.945305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66dc7f5d-5624-4157-83b3-ac87ecf30b54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:30.945749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66dc7f5d-5624-4157-83b3-ac87ecf30b54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:30.946162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66dc7f5d-5624-4157-83b3-ac87ecf30b54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:30.974388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-66dc7f5d-5624-4157-83b3-ac87ecf30b54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043317 Aug 06 12:39:30.975002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 607/1060] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:30 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:31.020319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-22a3264e-0c9d-40ad-a052-0851237e6f1f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:31.022451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-22a3264e-0c9d-40ad-a052-0851237e6f1f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:31.028972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22a3264e-0c9d-40ad-a052-0851237e6f1f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:31.029462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22a3264e-0c9d-40ad-a052-0851237e6f1f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:31.029901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22a3264e-0c9d-40ad-a052-0851237e6f1f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:31.030595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22a3264e-0c9d-40ad-a052-0851237e6f1f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:31.031052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22a3264e-0c9d-40ad-a052-0851237e6f1f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:31.031795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22a3264e-0c9d-40ad-a052-0851237e6f1f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:31.060977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-22a3264e-0c9d-40ad-a052-0851237e6f1f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044611 Aug 06 12:39:31.061557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 454/1061] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:31.697645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-46b63c2b-a41b-4693-8472-132b0fe71621 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:31.698254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-46b63c2b-a41b-4693-8472-132b0fe71621 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:31.704121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46b63c2b-a41b-4693-8472-132b0fe71621 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:31.704632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46b63c2b-a41b-4693-8472-132b0fe71621 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:31.705067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46b63c2b-a41b-4693-8472-132b0fe71621 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:31.705752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46b63c2b-a41b-4693-8472-132b0fe71621 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:31.706202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46b63c2b-a41b-4693-8472-132b0fe71621 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:31.706623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46b63c2b-a41b-4693-8472-132b0fe71621 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:31.767654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-46b63c2b-a41b-4693-8472-132b0fe71621 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:31.775191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-46b63c2b-a41b-4693-8472-132b0fe71621 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082109 Aug 06 12:39:31.775742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 608/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:31 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:31.986689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5b621356-27fa-47a0-8e28-ea7d199c1896 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:31.988871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5b621356-27fa-47a0-8e28-ea7d199c1896 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:31.994778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b621356-27fa-47a0-8e28-ea7d199c1896 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:31.995255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b621356-27fa-47a0-8e28-ea7d199c1896 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:31.995680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b621356-27fa-47a0-8e28-ea7d199c1896 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:31.996460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b621356-27fa-47a0-8e28-ea7d199c1896 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:31.996849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b621356-27fa-47a0-8e28-ea7d199c1896 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:31.997261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b621356-27fa-47a0-8e28-ea7d199c1896 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:32.026186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5b621356-27fa-47a0-8e28-ea7d199c1896 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Aug 06 12:39:32.026748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 455/1063] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:31 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:32.073963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90383f43-9ec0-409d-9847-e0bffa52fd1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:32.076084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90383f43-9ec0-409d-9847-e0bffa52fd1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:32.082375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90383f43-9ec0-409d-9847-e0bffa52fd1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:32.084550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90383f43-9ec0-409d-9847-e0bffa52fd1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:32.084550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90383f43-9ec0-409d-9847-e0bffa52fd1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:32.084550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90383f43-9ec0-409d-9847-e0bffa52fd1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:32.085364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90383f43-9ec0-409d-9847-e0bffa52fd1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:32.086073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90383f43-9ec0-409d-9847-e0bffa52fd1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:32.117075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90383f43-9ec0-409d-9847-e0bffa52fd1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047322 Aug 06 12:39:32.117628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 609/1064] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:32.794864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac680f09-b178-4dc8-8bf2-eb560592ba12 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:32.795462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac680f09-b178-4dc8-8bf2-eb560592ba12 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:32.802370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac680f09-b178-4dc8-8bf2-eb560592ba12 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:32.802842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac680f09-b178-4dc8-8bf2-eb560592ba12 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:32.803266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac680f09-b178-4dc8-8bf2-eb560592ba12 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:32.803944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac680f09-b178-4dc8-8bf2-eb560592ba12 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:32.804425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac680f09-b178-4dc8-8bf2-eb560592ba12 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:32.804845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac680f09-b178-4dc8-8bf2-eb560592ba12 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:32.867083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ac680f09-b178-4dc8-8bf2-eb560592ba12 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:32.874470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac680f09-b178-4dc8-8bf2-eb560592ba12 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083433 Aug 06 12:39:32.875028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 456/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:32 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:33.038112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c115fe53-ff6f-4e76-a6bb-77e924994013 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:33.040244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c115fe53-ff6f-4e76-a6bb-77e924994013 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:33.046288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c115fe53-ff6f-4e76-a6bb-77e924994013 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:33.046761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c115fe53-ff6f-4e76-a6bb-77e924994013 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:33.047188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c115fe53-ff6f-4e76-a6bb-77e924994013 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:33.047861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c115fe53-ff6f-4e76-a6bb-77e924994013 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:33.048317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c115fe53-ff6f-4e76-a6bb-77e924994013 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:33.048748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c115fe53-ff6f-4e76-a6bb-77e924994013 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:33.077557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c115fe53-ff6f-4e76-a6bb-77e924994013 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043378 Aug 06 12:39:33.078150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 610/1066] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:33.130661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d963ae32-ea99-407e-a342-81d5eac6dbc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:33.132835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d963ae32-ea99-407e-a342-81d5eac6dbc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:33.138740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d963ae32-ea99-407e-a342-81d5eac6dbc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:33.139220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d963ae32-ea99-407e-a342-81d5eac6dbc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:33.139656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d963ae32-ea99-407e-a342-81d5eac6dbc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:33.140364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d963ae32-ea99-407e-a342-81d5eac6dbc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:33.140819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d963ae32-ea99-407e-a342-81d5eac6dbc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:33.141242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d963ae32-ea99-407e-a342-81d5eac6dbc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:33.169449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d963ae32-ea99-407e-a342-81d5eac6dbc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043334 Aug 06 12:39:33.170037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 457/1067] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:33.894945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eb5c5ee0-3d62-4f8e-a8cf-4e3c6d13af23 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:33.895559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eb5c5ee0-3d62-4f8e-a8cf-4e3c6d13af23 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:33.901556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5c5ee0-3d62-4f8e-a8cf-4e3c6d13af23 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:33.902034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5c5ee0-3d62-4f8e-a8cf-4e3c6d13af23 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:33.902470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5c5ee0-3d62-4f8e-a8cf-4e3c6d13af23 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:33.903155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5c5ee0-3d62-4f8e-a8cf-4e3c6d13af23 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:33.903610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5c5ee0-3d62-4f8e-a8cf-4e3c6d13af23 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:33.904036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5c5ee0-3d62-4f8e-a8cf-4e3c6d13af23 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:33.967598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eb5c5ee0-3d62-4f8e-a8cf-4e3c6d13af23 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:33.975117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eb5c5ee0-3d62-4f8e-a8cf-4e3c6d13af23 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084073 Aug 06 12:39:33.975677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 611/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:33 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:34.088893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a201ec15-1eaf-4057-80e5-dea9e746b6c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:34.090961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a201ec15-1eaf-4057-80e5-dea9e746b6c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:34.097333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a201ec15-1eaf-4057-80e5-dea9e746b6c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:34.097806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a201ec15-1eaf-4057-80e5-dea9e746b6c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:34.098733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a201ec15-1eaf-4057-80e5-dea9e746b6c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:34.099411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a201ec15-1eaf-4057-80e5-dea9e746b6c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:34.099855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a201ec15-1eaf-4057-80e5-dea9e746b6c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:34.100489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a201ec15-1eaf-4057-80e5-dea9e746b6c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:34.134486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a201ec15-1eaf-4057-80e5-dea9e746b6c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049491 Aug 06 12:39:34.135114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 458/1069] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:34 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:34.182397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c3ab12bd-4b8e-481c-90eb-0f450e9f7a55 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:34.184587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c3ab12bd-4b8e-481c-90eb-0f450e9f7a55 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:34.190886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3ab12bd-4b8e-481c-90eb-0f450e9f7a55 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:34.191354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3ab12bd-4b8e-481c-90eb-0f450e9f7a55 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:34.191830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3ab12bd-4b8e-481c-90eb-0f450e9f7a55 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:34.192535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3ab12bd-4b8e-481c-90eb-0f450e9f7a55 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:34.192974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3ab12bd-4b8e-481c-90eb-0f450e9f7a55 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:34.193392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3ab12bd-4b8e-481c-90eb-0f450e9f7a55 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:34.220874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c3ab12bd-4b8e-481c-90eb-0f450e9f7a55 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042406 Aug 06 12:39:34.221411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 612/1070] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:34.995678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ce0ba6bb-59d2-4988-9507-450155e343bd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:34.996437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ce0ba6bb-59d2-4988-9507-450155e343bd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:35.002492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0ba6bb-59d2-4988-9507-450155e343bd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:35.002973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0ba6bb-59d2-4988-9507-450155e343bd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:35.003405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0ba6bb-59d2-4988-9507-450155e343bd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:35.004098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0ba6bb-59d2-4988-9507-450155e343bd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:35.004576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0ba6bb-59d2-4988-9507-450155e343bd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:35.005000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0ba6bb-59d2-4988-9507-450155e343bd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:35.069398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ce0ba6bb-59d2-4988-9507-450155e343bd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:35.076775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ce0ba6bb-59d2-4988-9507-450155e343bd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085055 Aug 06 12:39:35.077330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 459/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:34 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:35.147159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19962059-3ff6-4408-a0c8-cf7087ba253d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:35.149382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19962059-3ff6-4408-a0c8-cf7087ba253d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:35.155222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19962059-3ff6-4408-a0c8-cf7087ba253d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:35.155703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19962059-3ff6-4408-a0c8-cf7087ba253d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:35.156132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19962059-3ff6-4408-a0c8-cf7087ba253d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:35.156854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19962059-3ff6-4408-a0c8-cf7087ba253d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:35.157307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19962059-3ff6-4408-a0c8-cf7087ba253d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:35.157728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19962059-3ff6-4408-a0c8-cf7087ba253d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:35.186047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19962059-3ff6-4408-a0c8-cf7087ba253d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043346 Aug 06 12:39:35.186649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 613/1072] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:35 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:35.234345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3fd52615-1a10-4784-8970-b386f9fde586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:35.236505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3fd52615-1a10-4784-8970-b386f9fde586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:35.243796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fd52615-1a10-4784-8970-b386f9fde586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:35.244264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fd52615-1a10-4784-8970-b386f9fde586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:35.244721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fd52615-1a10-4784-8970-b386f9fde586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:35.245390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fd52615-1a10-4784-8970-b386f9fde586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:35.245878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fd52615-1a10-4784-8970-b386f9fde586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:35.246243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fd52615-1a10-4784-8970-b386f9fde586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:35.275357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3fd52615-1a10-4784-8970-b386f9fde586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045194 Aug 06 12:39:35.275893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 460/1073] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:36.097887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ac253969-8240-4c00-9f4a-4c36eb6cab81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:36.098716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ac253969-8240-4c00-9f4a-4c36eb6cab81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:36.107707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac253969-8240-4c00-9f4a-4c36eb6cab81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:36.108482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac253969-8240-4c00-9f4a-4c36eb6cab81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:36.108917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac253969-8240-4c00-9f4a-4c36eb6cab81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:36.109629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac253969-8240-4c00-9f4a-4c36eb6cab81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:36.110079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac253969-8240-4c00-9f4a-4c36eb6cab81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:36.110503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac253969-8240-4c00-9f4a-4c36eb6cab81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:36.173482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ac253969-8240-4c00-9f4a-4c36eb6cab81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:36.181428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ac253969-8240-4c00-9f4a-4c36eb6cab81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.087517 Aug 06 12:39:36.181983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 614/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:36 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:36.197635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-edbc88e8-c51f-4cf4-86b6-df4ba5434641 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:36.199728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-edbc88e8-c51f-4cf4-86b6-df4ba5434641 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:36.205399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbc88e8-c51f-4cf4-86b6-df4ba5434641 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:36.205870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbc88e8-c51f-4cf4-86b6-df4ba5434641 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:36.206293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbc88e8-c51f-4cf4-86b6-df4ba5434641 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:36.206964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbc88e8-c51f-4cf4-86b6-df4ba5434641 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:36.207410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbc88e8-c51f-4cf4-86b6-df4ba5434641 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:36.207821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbc88e8-c51f-4cf4-86b6-df4ba5434641 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:36.235422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-edbc88e8-c51f-4cf4-86b6-df4ba5434641 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041735 Aug 06 12:39:36.236016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 461/1075] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:36 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:36.288149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6c36f84f-abc1-4f3f-9432-5dafeda64530 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:36.290310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6c36f84f-abc1-4f3f-9432-5dafeda64530 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:36.296207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36f84f-abc1-4f3f-9432-5dafeda64530 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:36.296719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36f84f-abc1-4f3f-9432-5dafeda64530 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:36.297155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36f84f-abc1-4f3f-9432-5dafeda64530 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:36.297837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36f84f-abc1-4f3f-9432-5dafeda64530 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:36.298295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36f84f-abc1-4f3f-9432-5dafeda64530 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:36.298717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36f84f-abc1-4f3f-9432-5dafeda64530 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:36.326853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6c36f84f-abc1-4f3f-9432-5dafeda64530 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043322 Aug 06 12:39:36.327384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 615/1076] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:37.202173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b30138d4-4693-4288-aa2e-cb2131e3a930 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:37.202772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b30138d4-4693-4288-aa2e-cb2131e3a930 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:37.209151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b30138d4-4693-4288-aa2e-cb2131e3a930 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:37.209629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b30138d4-4693-4288-aa2e-cb2131e3a930 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:37.210056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b30138d4-4693-4288-aa2e-cb2131e3a930 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:37.210732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b30138d4-4693-4288-aa2e-cb2131e3a930 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:37.211180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b30138d4-4693-4288-aa2e-cb2131e3a930 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:37.211598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b30138d4-4693-4288-aa2e-cb2131e3a930 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:37.247039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9292d7d7-5e0a-42f9-bc67-edba35a86867 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:37.249325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9292d7d7-5e0a-42f9-bc67-edba35a86867 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:37.255829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9292d7d7-5e0a-42f9-bc67-edba35a86867 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:37.256392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9292d7d7-5e0a-42f9-bc67-edba35a86867 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:37.256883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9292d7d7-5e0a-42f9-bc67-edba35a86867 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:37.257648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9292d7d7-5e0a-42f9-bc67-edba35a86867 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:37.258153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9292d7d7-5e0a-42f9-bc67-edba35a86867 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:37.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9292d7d7-5e0a-42f9-bc67-edba35a86867 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:37.271925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b30138d4-4693-4288-aa2e-cb2131e3a930 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:37.279316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b30138d4-4693-4288-aa2e-cb2131e3a930 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080975 Aug 06 12:39:37.279873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 462/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:37 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:37.288573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9292d7d7-5e0a-42f9-bc67-edba35a86867 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Aug 06 12:39:37.289366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 616/1078] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:39:37.339071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d8bccd96-4e85-446e-9f60-940636773919 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:37.341223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d8bccd96-4e85-446e-9f60-940636773919 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:37.347055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8bccd96-4e85-446e-9f60-940636773919 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:37.347525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8bccd96-4e85-446e-9f60-940636773919 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:37.348538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8bccd96-4e85-446e-9f60-940636773919 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:37.349192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8bccd96-4e85-446e-9f60-940636773919 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:37.349660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8bccd96-4e85-446e-9f60-940636773919 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:37.350071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8bccd96-4e85-446e-9f60-940636773919 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:37.378491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d8bccd96-4e85-446e-9f60-940636773919 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043419 Aug 06 12:39:37.379035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 463/1079] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:38.300835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aaf4c6a0-88c6-443e-8729-a7f927d45bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:38.303483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aaf4c6a0-88c6-443e-8729-a7f927d45bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:38.303837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-22f8c5ce-289b-48b3-b351-913ca906e42a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:38.304492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-22f8c5ce-289b-48b3-b351-913ca906e42a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:38.309918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaf4c6a0-88c6-443e-8729-a7f927d45bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:38.310397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaf4c6a0-88c6-443e-8729-a7f927d45bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:38.310740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22f8c5ce-289b-48b3-b351-913ca906e42a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:38.310901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaf4c6a0-88c6-443e-8729-a7f927d45bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:38.311213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22f8c5ce-289b-48b3-b351-913ca906e42a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:38.311511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaf4c6a0-88c6-443e-8729-a7f927d45bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:38.311636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22f8c5ce-289b-48b3-b351-913ca906e42a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:38.311961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaf4c6a0-88c6-443e-8729-a7f927d45bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:38.312320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22f8c5ce-289b-48b3-b351-913ca906e42a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:38.312421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaf4c6a0-88c6-443e-8729-a7f927d45bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:38.312783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22f8c5ce-289b-48b3-b351-913ca906e42a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:38.313196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22f8c5ce-289b-48b3-b351-913ca906e42a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:38.341367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aaf4c6a0-88c6-443e-8729-a7f927d45bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Aug 06 12:39:38.341926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 617/1080] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:38.373249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-22f8c5ce-289b-48b3-b351-913ca906e42a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:38.381277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-22f8c5ce-289b-48b3-b351-913ca906e42a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081741 Aug 06 12:39:38.381822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 464/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:38 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:39:38.390629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b16f53db-581d-45fe-bdbb-ae73eff1358b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:38.392848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b16f53db-581d-45fe-bdbb-ae73eff1358b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:38.398723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b16f53db-581d-45fe-bdbb-ae73eff1358b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:38.399201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b16f53db-581d-45fe-bdbb-ae73eff1358b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:38.399631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b16f53db-581d-45fe-bdbb-ae73eff1358b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:38.400320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b16f53db-581d-45fe-bdbb-ae73eff1358b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:38.400786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b16f53db-581d-45fe-bdbb-ae73eff1358b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:38.401207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b16f53db-581d-45fe-bdbb-ae73eff1358b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:38.430069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b16f53db-581d-45fe-bdbb-ae73eff1358b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043320 Aug 06 12:39:38.430623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 618/1082] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:39:39.353685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0e7118eb-ce56-47b9-885a-8cc8b717de43 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:39.355804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0e7118eb-ce56-47b9-885a-8cc8b717de43 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:39.362433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e7118eb-ce56-47b9-885a-8cc8b717de43 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:39.362906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e7118eb-ce56-47b9-885a-8cc8b717de43 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:39.363336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e7118eb-ce56-47b9-885a-8cc8b717de43 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:39.364010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e7118eb-ce56-47b9-885a-8cc8b717de43 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:39.364493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e7118eb-ce56-47b9-885a-8cc8b717de43 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:39.364911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e7118eb-ce56-47b9-885a-8cc8b717de43 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:39.393211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0e7118eb-ce56-47b9-885a-8cc8b717de43 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043503 Aug 06 12:39:39.393749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 465/1083] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:39 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:39.401858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d65fd83-dc5d-4aed-a2d9-14d140329d54 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:39.402466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1d65fd83-dc5d-4aed-a2d9-14d140329d54 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:39.408833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65fd83-dc5d-4aed-a2d9-14d140329d54 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:39.409304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65fd83-dc5d-4aed-a2d9-14d140329d54 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:39.409729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65fd83-dc5d-4aed-a2d9-14d140329d54 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:39.410402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65fd83-dc5d-4aed-a2d9-14d140329d54 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:39.410847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65fd83-dc5d-4aed-a2d9-14d140329d54 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:39.411261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65fd83-dc5d-4aed-a2d9-14d140329d54 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:39.442788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fa9fb0a0-8b14-4177-aa1a-7ed634e34e63 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:39.444955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fa9fb0a0-8b14-4177-aa1a-7ed634e34e63 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:39.450936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa9fb0a0-8b14-4177-aa1a-7ed634e34e63 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:39.451414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa9fb0a0-8b14-4177-aa1a-7ed634e34e63 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:39.451847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa9fb0a0-8b14-4177-aa1a-7ed634e34e63 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:39.452562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa9fb0a0-8b14-4177-aa1a-7ed634e34e63 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:39.453013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa9fb0a0-8b14-4177-aa1a-7ed634e34e63 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:39.453451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa9fb0a0-8b14-4177-aa1a-7ed634e34e63 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:39.471330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1d65fd83-dc5d-4aed-a2d9-14d140329d54 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:39.478780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1d65fd83-dc5d-4aed-a2d9-14d140329d54 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080783 Aug 06 12:39:39.479375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 619/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:39 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:39.482711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fa9fb0a0-8b14-4177-aa1a-7ed634e34e63 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044384 Aug 06 12:39:39.483538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 466/1085] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:39:40.406046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fb89edc9-f55c-42de-a81b-3308c9780fd1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:40.408254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fb89edc9-f55c-42de-a81b-3308c9780fd1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:40.414677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb89edc9-f55c-42de-a81b-3308c9780fd1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:40.415161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb89edc9-f55c-42de-a81b-3308c9780fd1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:40.415599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb89edc9-f55c-42de-a81b-3308c9780fd1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:40.416289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb89edc9-f55c-42de-a81b-3308c9780fd1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:40.416768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb89edc9-f55c-42de-a81b-3308c9780fd1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:40.417194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fb89edc9-f55c-42de-a81b-3308c9780fd1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:40.446027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fb89edc9-f55c-42de-a81b-3308c9780fd1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Aug 06 12:39:40.446594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 620/1086] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:40 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:40.495467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-19c3b5db-fd0e-4236-8398-d8937fb40998 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:40.497632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-19c3b5db-fd0e-4236-8398-d8937fb40998 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:40.498358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b7c54d1c-4db3-4af6-a373-5615c7beb623 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:40.498958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b7c54d1c-4db3-4af6-a373-5615c7beb623 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:40.503627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19c3b5db-fd0e-4236-8398-d8937fb40998 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:40.504102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19c3b5db-fd0e-4236-8398-d8937fb40998 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:40.504589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19c3b5db-fd0e-4236-8398-d8937fb40998 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:40.505325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c54d1c-4db3-4af6-a373-5615c7beb623 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:40.505818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19c3b5db-fd0e-4236-8398-d8937fb40998 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:40.505917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c54d1c-4db3-4af6-a373-5615c7beb623 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:40.506274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19c3b5db-fd0e-4236-8398-d8937fb40998 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:40.506697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19c3b5db-fd0e-4236-8398-d8937fb40998 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:40.509962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c54d1c-4db3-4af6-a373-5615c7beb623 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:40.510709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c54d1c-4db3-4af6-a373-5615c7beb623 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:40.511231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c54d1c-4db3-4af6-a373-5615c7beb623 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:40.511757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7c54d1c-4db3-4af6-a373-5615c7beb623 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:40.535941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-19c3b5db-fd0e-4236-8398-d8937fb40998 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044339 Aug 06 12:39:40.536530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 467/1087] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:40.572613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b7c54d1c-4db3-4af6-a373-5615c7beb623 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:40.579931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b7c54d1c-4db3-4af6-a373-5615c7beb623 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085158 Aug 06 12:39:40.580516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 621/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:40 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:39:41.458117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d313d985-09f5-47f1-a463-d27c631e7f47 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:41.460616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d313d985-09f5-47f1-a463-d27c631e7f47 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:41.466420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313d985-09f5-47f1-a463-d27c631e7f47 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:41.466894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313d985-09f5-47f1-a463-d27c631e7f47 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:41.467319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313d985-09f5-47f1-a463-d27c631e7f47 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:41.467997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313d985-09f5-47f1-a463-d27c631e7f47 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:41.468466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313d985-09f5-47f1-a463-d27c631e7f47 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:41.468883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313d985-09f5-47f1-a463-d27c631e7f47 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:41.497088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d313d985-09f5-47f1-a463-d27c631e7f47 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042954 Aug 06 12:39:41.497647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 468/1089] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:41 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:41.548187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5d7cb780-dee6-4b0e-8dde-44ad2f7860e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:41.550365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5d7cb780-dee6-4b0e-8dde-44ad2f7860e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:41.557295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d7cb780-dee6-4b0e-8dde-44ad2f7860e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:41.557768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d7cb780-dee6-4b0e-8dde-44ad2f7860e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:41.558203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d7cb780-dee6-4b0e-8dde-44ad2f7860e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:41.558877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d7cb780-dee6-4b0e-8dde-44ad2f7860e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:41.559319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d7cb780-dee6-4b0e-8dde-44ad2f7860e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:41.559764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d7cb780-dee6-4b0e-8dde-44ad2f7860e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:41.587600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5d7cb780-dee6-4b0e-8dde-44ad2f7860e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043297 Aug 06 12:39:41.588129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 622/1090] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:41.600197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f02f2abc-49e9-4ea9-8539-4bf4dcf8cda9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:41.600839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f02f2abc-49e9-4ea9-8539-4bf4dcf8cda9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:41.607110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f02f2abc-49e9-4ea9-8539-4bf4dcf8cda9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:41.607586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f02f2abc-49e9-4ea9-8539-4bf4dcf8cda9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:41.608279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f02f2abc-49e9-4ea9-8539-4bf4dcf8cda9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:41.608991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f02f2abc-49e9-4ea9-8539-4bf4dcf8cda9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:41.609439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f02f2abc-49e9-4ea9-8539-4bf4dcf8cda9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:41.609860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f02f2abc-49e9-4ea9-8539-4bf4dcf8cda9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:41.678355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f02f2abc-49e9-4ea9-8539-4bf4dcf8cda9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:41.681686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:41.686617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f02f2abc-49e9-4ea9-8539-4bf4dcf8cda9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.090653 Aug 06 12:39:41.687177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 469/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:41 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:42.509676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e96a0d04-483d-4c40-94e9-5051bd234172 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:42.511858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e96a0d04-483d-4c40-94e9-5051bd234172 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:42.517856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e96a0d04-483d-4c40-94e9-5051bd234172 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:42.518344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e96a0d04-483d-4c40-94e9-5051bd234172 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:42.518772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e96a0d04-483d-4c40-94e9-5051bd234172 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:42.519451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e96a0d04-483d-4c40-94e9-5051bd234172 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:42.519895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e96a0d04-483d-4c40-94e9-5051bd234172 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:42.520320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e96a0d04-483d-4c40-94e9-5051bd234172 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:42.524458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:42.548877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e96a0d04-483d-4c40-94e9-5051bd234172 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Aug 06 12:39:42.549491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 623/1092] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:42 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:42.599774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e523a07b-dc7c-4038-97d9-227eb6964268 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:42.601892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e523a07b-dc7c-4038-97d9-227eb6964268 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:42.608712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e523a07b-dc7c-4038-97d9-227eb6964268 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:42.609189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e523a07b-dc7c-4038-97d9-227eb6964268 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:42.609616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e523a07b-dc7c-4038-97d9-227eb6964268 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:42.610323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e523a07b-dc7c-4038-97d9-227eb6964268 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:42.610770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e523a07b-dc7c-4038-97d9-227eb6964268 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:42.611186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e523a07b-dc7c-4038-97d9-227eb6964268 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:42.639546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e523a07b-dc7c-4038-97d9-227eb6964268 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043745 Aug 06 12:39:42.640086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 470/1093] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:42.706640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-95a50a8c-c9e6-4ad7-8e0c-15150fde1692 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:42.707242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-95a50a8c-c9e6-4ad7-8e0c-15150fde1692 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:42.713512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95a50a8c-c9e6-4ad7-8e0c-15150fde1692 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:42.713985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95a50a8c-c9e6-4ad7-8e0c-15150fde1692 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:42.714419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95a50a8c-c9e6-4ad7-8e0c-15150fde1692 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:42.715097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95a50a8c-c9e6-4ad7-8e0c-15150fde1692 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:42.715543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95a50a8c-c9e6-4ad7-8e0c-15150fde1692 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:42.715964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95a50a8c-c9e6-4ad7-8e0c-15150fde1692 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:42.779736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-95a50a8c-c9e6-4ad7-8e0c-15150fde1692 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:42.787122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-95a50a8c-c9e6-4ad7-8e0c-15150fde1692 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084318 Aug 06 12:39:42.787680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 624/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:42 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:43.561010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dc61d107-df8c-4945-aae4-10dc53b0151c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:43.563216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dc61d107-df8c-4945-aae4-10dc53b0151c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:43.565183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=84 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:43.570316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc61d107-df8c-4945-aae4-10dc53b0151c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:43.570789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc61d107-df8c-4945-aae4-10dc53b0151c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:43.571211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc61d107-df8c-4945-aae4-10dc53b0151c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:43.571879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc61d107-df8c-4945-aae4-10dc53b0151c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:43.572366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc61d107-df8c-4945-aae4-10dc53b0151c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:43.572808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc61d107-df8c-4945-aae4-10dc53b0151c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:43.602552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dc61d107-df8c-4945-aae4-10dc53b0151c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045392 Aug 06 12:39:43.603230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 471/1095] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:43.652034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9f33d12f-283e-47f7-bfc1-8cb4b58ea52d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:43.654184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9f33d12f-283e-47f7-bfc1-8cb4b58ea52d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:43.660141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f33d12f-283e-47f7-bfc1-8cb4b58ea52d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:43.660652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f33d12f-283e-47f7-bfc1-8cb4b58ea52d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:43.661083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f33d12f-283e-47f7-bfc1-8cb4b58ea52d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:43.662414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f33d12f-283e-47f7-bfc1-8cb4b58ea52d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:43.662866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f33d12f-283e-47f7-bfc1-8cb4b58ea52d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:43.663283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f33d12f-283e-47f7-bfc1-8cb4b58ea52d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:43.690761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9f33d12f-283e-47f7-bfc1-8cb4b58ea52d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042716 Aug 06 12:39:43.691294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 625/1096] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:43.806709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9fbb431f-f098-42c2-adc4-87fbd2fbc0d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:43.807315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9fbb431f-f098-42c2-adc4-87fbd2fbc0d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:43.813660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9fbb431f-f098-42c2-adc4-87fbd2fbc0d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:43.814078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9fbb431f-f098-42c2-adc4-87fbd2fbc0d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:43.814515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9fbb431f-f098-42c2-adc4-87fbd2fbc0d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:43.815191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9fbb431f-f098-42c2-adc4-87fbd2fbc0d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:43.815641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9fbb431f-f098-42c2-adc4-87fbd2fbc0d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:43.816063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9fbb431f-f098-42c2-adc4-87fbd2fbc0d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:43.879053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9fbb431f-f098-42c2-adc4-87fbd2fbc0d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:43.886912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9fbb431f-f098-42c2-adc4-87fbd2fbc0d9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083952 Aug 06 12:39:43.887469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 472/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:43 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:44.616111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b0ee95c0-10f5-4de2-9839-b885de690577 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:44.618846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b0ee95c0-10f5-4de2-9839-b885de690577 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:44.625178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b0ee95c0-10f5-4de2-9839-b885de690577 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:44.625655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b0ee95c0-10f5-4de2-9839-b885de690577 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:44.626087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b0ee95c0-10f5-4de2-9839-b885de690577 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:44.626765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b0ee95c0-10f5-4de2-9839-b885de690577 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:44.627216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b0ee95c0-10f5-4de2-9839-b885de690577 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:44.627635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b0ee95c0-10f5-4de2-9839-b885de690577 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:44.656396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b0ee95c0-10f5-4de2-9839-b885de690577 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 Aug 06 12:39:44.656984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 626/1098] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:44.702902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1629dd5d-d47a-48c5-bac3-4937cc34b86b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:44.705068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1629dd5d-d47a-48c5-bac3-4937cc34b86b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:44.710988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1629dd5d-d47a-48c5-bac3-4937cc34b86b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:44.711464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1629dd5d-d47a-48c5-bac3-4937cc34b86b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:44.711893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1629dd5d-d47a-48c5-bac3-4937cc34b86b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:44.712599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1629dd5d-d47a-48c5-bac3-4937cc34b86b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:44.713045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1629dd5d-d47a-48c5-bac3-4937cc34b86b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:44.713463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1629dd5d-d47a-48c5-bac3-4937cc34b86b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:44.742956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1629dd5d-d47a-48c5-bac3-4937cc34b86b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043970 Aug 06 12:39:44.743505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 473/1099] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:44.907714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-75b13773-5b5f-40dd-a7c0-d1e98489c4eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:44.908238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-75b13773-5b5f-40dd-a7c0-d1e98489c4eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:44.914798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75b13773-5b5f-40dd-a7c0-d1e98489c4eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:44.915272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75b13773-5b5f-40dd-a7c0-d1e98489c4eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:44.915705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75b13773-5b5f-40dd-a7c0-d1e98489c4eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:44.916414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75b13773-5b5f-40dd-a7c0-d1e98489c4eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:44.916870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75b13773-5b5f-40dd-a7c0-d1e98489c4eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:44.917288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75b13773-5b5f-40dd-a7c0-d1e98489c4eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:44.979500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-75b13773-5b5f-40dd-a7c0-d1e98489c4eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:44.987186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-75b13773-5b5f-40dd-a7c0-d1e98489c4eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083447 Aug 06 12:39:44.987739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 627/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:44 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:45.669228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-21ad47cb-5824-464f-9aac-9835d859e93e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:45.671359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-21ad47cb-5824-464f-9aac-9835d859e93e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:45.677317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21ad47cb-5824-464f-9aac-9835d859e93e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:45.677796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21ad47cb-5824-464f-9aac-9835d859e93e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:45.678229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21ad47cb-5824-464f-9aac-9835d859e93e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:45.678908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21ad47cb-5824-464f-9aac-9835d859e93e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:45.679361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21ad47cb-5824-464f-9aac-9835d859e93e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:45.679782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21ad47cb-5824-464f-9aac-9835d859e93e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:45.707738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-21ad47cb-5824-464f-9aac-9835d859e93e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042649 Aug 06 12:39:45.708334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 474/1101] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:45.755046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-18471044-8eaf-4eb7-bb2b-db59dcf2ecbc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:45.757211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-18471044-8eaf-4eb7-bb2b-db59dcf2ecbc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:45.763663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18471044-8eaf-4eb7-bb2b-db59dcf2ecbc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:45.764146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18471044-8eaf-4eb7-bb2b-db59dcf2ecbc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:45.764624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18471044-8eaf-4eb7-bb2b-db59dcf2ecbc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:45.765320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18471044-8eaf-4eb7-bb2b-db59dcf2ecbc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:45.765775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18471044-8eaf-4eb7-bb2b-db59dcf2ecbc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:45.766199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18471044-8eaf-4eb7-bb2b-db59dcf2ecbc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:45.795614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-18471044-8eaf-4eb7-bb2b-db59dcf2ecbc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044524 Aug 06 12:39:45.796162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 628/1102] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:46.006779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-53c23e36-6fb7-4ae3-b71a-ff63d97b34eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:46.007912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-53c23e36-6fb7-4ae3-b71a-ff63d97b34eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:46.013734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c23e36-6fb7-4ae3-b71a-ff63d97b34eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:46.014204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c23e36-6fb7-4ae3-b71a-ff63d97b34eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:46.014626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c23e36-6fb7-4ae3-b71a-ff63d97b34eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:46.015297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c23e36-6fb7-4ae3-b71a-ff63d97b34eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:46.015740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c23e36-6fb7-4ae3-b71a-ff63d97b34eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:46.016152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c23e36-6fb7-4ae3-b71a-ff63d97b34eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:46.075624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-53c23e36-6fb7-4ae3-b71a-ff63d97b34eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:46.083012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-53c23e36-6fb7-4ae3-b71a-ff63d97b34eb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080038 Aug 06 12:39:46.083563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 475/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:46 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:46.720805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f87927de-2a2b-4302-b5aa-50448ee001a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:46.722963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f87927de-2a2b-4302-b5aa-50448ee001a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:46.729335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87927de-2a2b-4302-b5aa-50448ee001a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:46.729806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87927de-2a2b-4302-b5aa-50448ee001a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:46.730231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87927de-2a2b-4302-b5aa-50448ee001a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:46.730909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87927de-2a2b-4302-b5aa-50448ee001a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:46.731352 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87927de-2a2b-4302-b5aa-50448ee001a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:46.731767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87927de-2a2b-4302-b5aa-50448ee001a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:46.760704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f87927de-2a2b-4302-b5aa-50448ee001a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043891 Aug 06 12:39:46.761346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 629/1104] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:46.808058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a947dc1-2e6c-4ee7-9a73-14df6dbf296c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:46.810255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0a947dc1-2e6c-4ee7-9a73-14df6dbf296c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:46.816578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a947dc1-2e6c-4ee7-9a73-14df6dbf296c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:46.817051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a947dc1-2e6c-4ee7-9a73-14df6dbf296c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:46.817504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a947dc1-2e6c-4ee7-9a73-14df6dbf296c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:46.818180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a947dc1-2e6c-4ee7-9a73-14df6dbf296c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:46.818647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a947dc1-2e6c-4ee7-9a73-14df6dbf296c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:46.819063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a947dc1-2e6c-4ee7-9a73-14df6dbf296c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:46.846778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0a947dc1-2e6c-4ee7-9a73-14df6dbf296c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043254 Aug 06 12:39:46.847314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 476/1105] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:47.104286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-22089246-25d8-4e47-b88f-07be67b3499a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:47.104897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-22089246-25d8-4e47-b88f-07be67b3499a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:47.111441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22089246-25d8-4e47-b88f-07be67b3499a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:47.111911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22089246-25d8-4e47-b88f-07be67b3499a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:47.112371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22089246-25d8-4e47-b88f-07be67b3499a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:47.113184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22089246-25d8-4e47-b88f-07be67b3499a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:47.113630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22089246-25d8-4e47-b88f-07be67b3499a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:47.114045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22089246-25d8-4e47-b88f-07be67b3499a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:47.174814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-22089246-25d8-4e47-b88f-07be67b3499a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:47.182169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-22089246-25d8-4e47-b88f-07be67b3499a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082401 Aug 06 12:39:47.182714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 630/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:47 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:47.773525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8a8084cb-b9d1-419c-abdf-4af928b03f93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:47.775649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8a8084cb-b9d1-419c-abdf-4af928b03f93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:47.781483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a8084cb-b9d1-419c-abdf-4af928b03f93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:47.781956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a8084cb-b9d1-419c-abdf-4af928b03f93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:47.782378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a8084cb-b9d1-419c-abdf-4af928b03f93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:47.783050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a8084cb-b9d1-419c-abdf-4af928b03f93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:47.783491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a8084cb-b9d1-419c-abdf-4af928b03f93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:47.783902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a8084cb-b9d1-419c-abdf-4af928b03f93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:47.811295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8a8084cb-b9d1-419c-abdf-4af928b03f93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042370 Aug 06 12:39:47.811916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 477/1107] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:47.859307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-59394f2c-76c9-4f1a-888a-3a5a255f6a17 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:47.861474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-59394f2c-76c9-4f1a-888a-3a5a255f6a17 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:47.868066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59394f2c-76c9-4f1a-888a-3a5a255f6a17 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:47.868577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59394f2c-76c9-4f1a-888a-3a5a255f6a17 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:47.869035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59394f2c-76c9-4f1a-888a-3a5a255f6a17 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:47.869713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59394f2c-76c9-4f1a-888a-3a5a255f6a17 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:47.870163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59394f2c-76c9-4f1a-888a-3a5a255f6a17 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:47.870582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59394f2c-76c9-4f1a-888a-3a5a255f6a17 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:47.899130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-59394f2c-76c9-4f1a-888a-3a5a255f6a17 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044073 Aug 06 12:39:47.899664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 631/1108] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:48.202089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5a6ced68-38b2-4f84-b709-090c8390bee4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:48.202689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5a6ced68-38b2-4f84-b709-090c8390bee4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:48.209156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a6ced68-38b2-4f84-b709-090c8390bee4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:48.209634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a6ced68-38b2-4f84-b709-090c8390bee4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:48.210062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a6ced68-38b2-4f84-b709-090c8390bee4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:48.210770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a6ced68-38b2-4f84-b709-090c8390bee4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:48.211217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a6ced68-38b2-4f84-b709-090c8390bee4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:48.211637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a6ced68-38b2-4f84-b709-090c8390bee4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:48.273101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5a6ced68-38b2-4f84-b709-090c8390bee4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:48.280629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5a6ced68-38b2-4f84-b709-090c8390bee4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082346 Aug 06 12:39:48.281178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 478/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:48 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:48.823198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c14aefe-a575-484b-9f10-ee79a3a7506f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:48.825392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c14aefe-a575-484b-9f10-ee79a3a7506f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:48.831760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c14aefe-a575-484b-9f10-ee79a3a7506f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:48.832240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c14aefe-a575-484b-9f10-ee79a3a7506f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:48.832704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c14aefe-a575-484b-9f10-ee79a3a7506f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:48.833384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c14aefe-a575-484b-9f10-ee79a3a7506f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:48.833838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c14aefe-a575-484b-9f10-ee79a3a7506f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:48.834258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c14aefe-a575-484b-9f10-ee79a3a7506f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:48.863538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c14aefe-a575-484b-9f10-ee79a3a7506f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 Aug 06 12:39:48.864146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 632/1110] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:48.911358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-043094f2-a45a-4969-9c55-570a0c06c9f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:48.914132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-043094f2-a45a-4969-9c55-570a0c06c9f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:48.920034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-043094f2-a45a-4969-9c55-570a0c06c9f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:48.920541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-043094f2-a45a-4969-9c55-570a0c06c9f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:48.920986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-043094f2-a45a-4969-9c55-570a0c06c9f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:48.921654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-043094f2-a45a-4969-9c55-570a0c06c9f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:48.922110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-043094f2-a45a-4969-9c55-570a0c06c9f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:48.922519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-043094f2-a45a-4969-9c55-570a0c06c9f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:48.950208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-043094f2-a45a-4969-9c55-570a0c06c9f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042750 Aug 06 12:39:48.950743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 479/1111] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:49.301856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-23700e83-cf13-4772-bd93-bcb626c56676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:49.302462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-23700e83-cf13-4772-bd93-bcb626c56676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:49.308398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23700e83-cf13-4772-bd93-bcb626c56676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:49.308876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23700e83-cf13-4772-bd93-bcb626c56676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:49.309298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23700e83-cf13-4772-bd93-bcb626c56676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:49.309969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23700e83-cf13-4772-bd93-bcb626c56676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:49.310414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23700e83-cf13-4772-bd93-bcb626c56676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:49.310828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23700e83-cf13-4772-bd93-bcb626c56676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:49.371021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-23700e83-cf13-4772-bd93-bcb626c56676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:49.378302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-23700e83-cf13-4772-bd93-bcb626c56676 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080380 Aug 06 12:39:49.378852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 633/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:49 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:49.875657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a3f87ec7-7fa6-4445-84ba-2ba59d8cc0f8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:49.877831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a3f87ec7-7fa6-4445-84ba-2ba59d8cc0f8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:49.885106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3f87ec7-7fa6-4445-84ba-2ba59d8cc0f8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:49.885581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3f87ec7-7fa6-4445-84ba-2ba59d8cc0f8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:49.886007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3f87ec7-7fa6-4445-84ba-2ba59d8cc0f8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:49.886685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3f87ec7-7fa6-4445-84ba-2ba59d8cc0f8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:49.887138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3f87ec7-7fa6-4445-84ba-2ba59d8cc0f8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:49.887560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3f87ec7-7fa6-4445-84ba-2ba59d8cc0f8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:49.915239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a3f87ec7-7fa6-4445-84ba-2ba59d8cc0f8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Aug 06 12:39:49.915856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 480/1113] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:49.961956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3c0230e2-eff4-4feb-9331-0e43a7a6b476 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:49.964071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3c0230e2-eff4-4feb-9331-0e43a7a6b476 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:49.970537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c0230e2-eff4-4feb-9331-0e43a7a6b476 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:49.971007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c0230e2-eff4-4feb-9331-0e43a7a6b476 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:49.971434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c0230e2-eff4-4feb-9331-0e43a7a6b476 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:49.972112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c0230e2-eff4-4feb-9331-0e43a7a6b476 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:49.972587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c0230e2-eff4-4feb-9331-0e43a7a6b476 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:49.973004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c0230e2-eff4-4feb-9331-0e43a7a6b476 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:50.003435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3c0230e2-eff4-4feb-9331-0e43a7a6b476 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045392 Aug 06 12:39:50.003995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 634/1114] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:50.398858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4b326eff-4d0f-4711-9864-b6a9d49a0ebf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:50.399452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4b326eff-4d0f-4711-9864-b6a9d49a0ebf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:50.405261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b326eff-4d0f-4711-9864-b6a9d49a0ebf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:50.405731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b326eff-4d0f-4711-9864-b6a9d49a0ebf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:50.406155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b326eff-4d0f-4711-9864-b6a9d49a0ebf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:50.406822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b326eff-4d0f-4711-9864-b6a9d49a0ebf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:50.407266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b326eff-4d0f-4711-9864-b6a9d49a0ebf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:50.407679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b326eff-4d0f-4711-9864-b6a9d49a0ebf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:50.466736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4b326eff-4d0f-4711-9864-b6a9d49a0ebf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:50.473974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4b326eff-4d0f-4711-9864-b6a9d49a0ebf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.078927 Aug 06 12:39:50.474517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 481/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:50 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:50.927458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9ce19aaa-7f36-4f52-9bea-1a780bce956b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:50.929626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9ce19aaa-7f36-4f52-9bea-1a780bce956b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:50.935446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ce19aaa-7f36-4f52-9bea-1a780bce956b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:50.935953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ce19aaa-7f36-4f52-9bea-1a780bce956b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:50.936402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ce19aaa-7f36-4f52-9bea-1a780bce956b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:50.937081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ce19aaa-7f36-4f52-9bea-1a780bce956b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:50.937527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ce19aaa-7f36-4f52-9bea-1a780bce956b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:50.937952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ce19aaa-7f36-4f52-9bea-1a780bce956b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:50.966572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9ce19aaa-7f36-4f52-9bea-1a780bce956b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Aug 06 12:39:50.967830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 635/1116] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:50 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:51.015709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9eb2db4e-0bee-44a5-bc2b-1882bd37190a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:51.017931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9eb2db4e-0bee-44a5-bc2b-1882bd37190a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:51.024216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb2db4e-0bee-44a5-bc2b-1882bd37190a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:51.024728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb2db4e-0bee-44a5-bc2b-1882bd37190a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:51.025162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb2db4e-0bee-44a5-bc2b-1882bd37190a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:51.025851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb2db4e-0bee-44a5-bc2b-1882bd37190a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:51.026303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb2db4e-0bee-44a5-bc2b-1882bd37190a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:51.026730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb2db4e-0bee-44a5-bc2b-1882bd37190a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:51.055094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9eb2db4e-0bee-44a5-bc2b-1882bd37190a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043952 Aug 06 12:39:51.055633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 482/1117] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:51.494776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3b1e49e1-4774-4b75-95db-ba2907868bde tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:51.495383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3b1e49e1-4774-4b75-95db-ba2907868bde tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:51.501696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b1e49e1-4774-4b75-95db-ba2907868bde tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:51.502167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b1e49e1-4774-4b75-95db-ba2907868bde tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:51.502595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b1e49e1-4774-4b75-95db-ba2907868bde tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:51.503267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b1e49e1-4774-4b75-95db-ba2907868bde tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:51.503713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b1e49e1-4774-4b75-95db-ba2907868bde tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:51.504129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b1e49e1-4774-4b75-95db-ba2907868bde tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:51.566372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b1e49e1-4774-4b75-95db-ba2907868bde tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:51.573882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3b1e49e1-4774-4b75-95db-ba2907868bde tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082906 Aug 06 12:39:51.574435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 636/1118] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:51 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:51.979089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-86199cad-d69e-4ddc-b041-7e94137867ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:51.981270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-86199cad-d69e-4ddc-b041-7e94137867ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:51.987983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86199cad-d69e-4ddc-b041-7e94137867ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:51.988494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86199cad-d69e-4ddc-b041-7e94137867ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:51.988921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86199cad-d69e-4ddc-b041-7e94137867ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:51.989589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86199cad-d69e-4ddc-b041-7e94137867ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:51.990039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86199cad-d69e-4ddc-b041-7e94137867ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:51.990454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86199cad-d69e-4ddc-b041-7e94137867ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:52.018773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-86199cad-d69e-4ddc-b041-7e94137867ac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043549 Aug 06 12:39:52.019308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 483/1119] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:52.067145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f89cfc63-51e9-4a7a-a1c5-3fb689b7dfa0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:52.069340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f89cfc63-51e9-4a7a-a1c5-3fb689b7dfa0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:52.075100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f89cfc63-51e9-4a7a-a1c5-3fb689b7dfa0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:52.075578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f89cfc63-51e9-4a7a-a1c5-3fb689b7dfa0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:52.076007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f89cfc63-51e9-4a7a-a1c5-3fb689b7dfa0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:52.076710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f89cfc63-51e9-4a7a-a1c5-3fb689b7dfa0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:52.077160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f89cfc63-51e9-4a7a-a1c5-3fb689b7dfa0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:52.077578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f89cfc63-51e9-4a7a-a1c5-3fb689b7dfa0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:52.105376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f89cfc63-51e9-4a7a-a1c5-3fb689b7dfa0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042132 Aug 06 12:39:52.105914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 637/1120] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:52.593902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0cbd2bb8-bdaa-459e-a8bc-914e1e74ba70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:52.594504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0cbd2bb8-bdaa-459e-a8bc-914e1e74ba70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:52.600772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cbd2bb8-bdaa-459e-a8bc-914e1e74ba70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:52.601243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cbd2bb8-bdaa-459e-a8bc-914e1e74ba70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:52.601672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cbd2bb8-bdaa-459e-a8bc-914e1e74ba70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:52.602347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cbd2bb8-bdaa-459e-a8bc-914e1e74ba70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:52.602795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cbd2bb8-bdaa-459e-a8bc-914e1e74ba70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:52.603214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cbd2bb8-bdaa-459e-a8bc-914e1e74ba70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:52.666462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0cbd2bb8-bdaa-459e-a8bc-914e1e74ba70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:52.674413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0cbd2bb8-bdaa-459e-a8bc-914e1e74ba70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084438 Aug 06 12:39:52.674960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 484/1121] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:52 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:53.031523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6d2ba42d-69aa-4486-a199-895b5d053381 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:53.033727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6d2ba42d-69aa-4486-a199-895b5d053381 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:53.040082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d2ba42d-69aa-4486-a199-895b5d053381 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:53.040585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d2ba42d-69aa-4486-a199-895b5d053381 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:53.041018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d2ba42d-69aa-4486-a199-895b5d053381 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:53.041696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d2ba42d-69aa-4486-a199-895b5d053381 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:53.042147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d2ba42d-69aa-4486-a199-895b5d053381 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:53.042568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d2ba42d-69aa-4486-a199-895b5d053381 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:53.070273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6d2ba42d-69aa-4486-a199-895b5d053381 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043351 Aug 06 12:39:53.070865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 638/1122] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:53 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:53.118360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4d0362a-60f5-4cb6-ab49-f4cb2f96b082 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:53.120506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d4d0362a-60f5-4cb6-ab49-f4cb2f96b082 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:53.126264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4d0362a-60f5-4cb6-ab49-f4cb2f96b082 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:53.126724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4d0362a-60f5-4cb6-ab49-f4cb2f96b082 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:53.127146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4d0362a-60f5-4cb6-ab49-f4cb2f96b082 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:53.127874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4d0362a-60f5-4cb6-ab49-f4cb2f96b082 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:53.128258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4d0362a-60f5-4cb6-ab49-f4cb2f96b082 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:53.128694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4d0362a-60f5-4cb6-ab49-f4cb2f96b082 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:53.157067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d4d0362a-60f5-4cb6-ab49-f4cb2f96b082 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042589 Aug 06 12:39:53.157627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 485/1123] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:53.694464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f70648ad-efc6-4dbf-bb15-d49090fdf802 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:53.695072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f70648ad-efc6-4dbf-bb15-d49090fdf802 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:53.696978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=84 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:53.702576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f70648ad-efc6-4dbf-bb15-d49090fdf802 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:53.703054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f70648ad-efc6-4dbf-bb15-d49090fdf802 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:53.703497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f70648ad-efc6-4dbf-bb15-d49090fdf802 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:53.704326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f70648ad-efc6-4dbf-bb15-d49090fdf802 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:53.704808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f70648ad-efc6-4dbf-bb15-d49090fdf802 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:53.705235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f70648ad-efc6-4dbf-bb15-d49090fdf802 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:53.766005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f70648ad-efc6-4dbf-bb15-d49090fdf802 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:53.769402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:53.774290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f70648ad-efc6-4dbf-bb15-d49090fdf802 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083667 Aug 06 12:39:53.774847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 639/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:53 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:54.082844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4d62766c-c543-48a4-8c8d-61ac79cbece6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:54.085032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4d62766c-c543-48a4-8c8d-61ac79cbece6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:54.091308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d62766c-c543-48a4-8c8d-61ac79cbece6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:54.091789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d62766c-c543-48a4-8c8d-61ac79cbece6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:54.092220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d62766c-c543-48a4-8c8d-61ac79cbece6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:54.092934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d62766c-c543-48a4-8c8d-61ac79cbece6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:54.093997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d62766c-c543-48a4-8c8d-61ac79cbece6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:54.094421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d62766c-c543-48a4-8c8d-61ac79cbece6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:54.110629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:39:54.123363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4d62766c-c543-48a4-8c8d-61ac79cbece6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Aug 06 12:39:54.123963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 486/1125] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:54 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:54.169497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b2fdadfd-8830-42be-8513-9566c5be97d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:54.171638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b2fdadfd-8830-42be-8513-9566c5be97d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:54.178251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fdadfd-8830-42be-8513-9566c5be97d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:54.178733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fdadfd-8830-42be-8513-9566c5be97d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:54.179171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fdadfd-8830-42be-8513-9566c5be97d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:54.179861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fdadfd-8830-42be-8513-9566c5be97d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:54.180330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fdadfd-8830-42be-8513-9566c5be97d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:54.180765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2fdadfd-8830-42be-8513-9566c5be97d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:54.210013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b2fdadfd-8830-42be-8513-9566c5be97d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044460 Aug 06 12:39:54.210556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 640/1126] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:54.794903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1df1615e-23fd-48a5-a7bb-cb2107993415 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:54.795502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1df1615e-23fd-48a5-a7bb-cb2107993415 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:54.802081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1df1615e-23fd-48a5-a7bb-cb2107993415 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:54.802548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1df1615e-23fd-48a5-a7bb-cb2107993415 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:54.803009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1df1615e-23fd-48a5-a7bb-cb2107993415 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:54.803687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1df1615e-23fd-48a5-a7bb-cb2107993415 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:54.804202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1df1615e-23fd-48a5-a7bb-cb2107993415 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:54.804610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1df1615e-23fd-48a5-a7bb-cb2107993415 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:54.866032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1df1615e-23fd-48a5-a7bb-cb2107993415 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:54.873406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1df1615e-23fd-48a5-a7bb-cb2107993415 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082324 Aug 06 12:39:54.873958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 487/1127] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:54 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:55.137439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ed1a597-fc72-4ee7-9417-ff931d0d4fa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:55.139596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ed1a597-fc72-4ee7-9417-ff931d0d4fa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:55.145473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ed1a597-fc72-4ee7-9417-ff931d0d4fa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:55.145942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ed1a597-fc72-4ee7-9417-ff931d0d4fa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:55.146368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ed1a597-fc72-4ee7-9417-ff931d0d4fa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:55.147047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ed1a597-fc72-4ee7-9417-ff931d0d4fa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:55.147490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ed1a597-fc72-4ee7-9417-ff931d0d4fa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:55.147910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ed1a597-fc72-4ee7-9417-ff931d0d4fa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:55.177108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ed1a597-fc72-4ee7-9417-ff931d0d4fa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Aug 06 12:39:55.177680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 641/1128] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:55 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:55.222810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0d379f5d-2156-4e8e-887a-818e13949264 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:55.224954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0d379f5d-2156-4e8e-887a-818e13949264 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:55.231186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d379f5d-2156-4e8e-887a-818e13949264 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:55.231663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d379f5d-2156-4e8e-887a-818e13949264 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:55.232121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d379f5d-2156-4e8e-887a-818e13949264 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:55.233086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d379f5d-2156-4e8e-887a-818e13949264 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:55.233532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d379f5d-2156-4e8e-887a-818e13949264 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:55.234777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d379f5d-2156-4e8e-887a-818e13949264 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:55.266408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0d379f5d-2156-4e8e-887a-818e13949264 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047988 Aug 06 12:39:55.266876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 488/1129] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:55.894564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f43322e2-92a0-4a16-8781-20c1a564852e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:55.895166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f43322e2-92a0-4a16-8781-20c1a564852e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:55.901061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43322e2-92a0-4a16-8781-20c1a564852e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:55.901531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43322e2-92a0-4a16-8781-20c1a564852e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:55.901957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43322e2-92a0-4a16-8781-20c1a564852e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:55.902634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43322e2-92a0-4a16-8781-20c1a564852e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:55.903080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43322e2-92a0-4a16-8781-20c1a564852e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:55.903495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f43322e2-92a0-4a16-8781-20c1a564852e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:55.962780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f43322e2-92a0-4a16-8781-20c1a564852e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:55.970151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f43322e2-92a0-4a16-8781-20c1a564852e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080067 Aug 06 12:39:55.970705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 642/1130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:55 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:56.189338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5c26f405-844c-4491-899b-92177df19b42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:56.191402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5c26f405-844c-4491-899b-92177df19b42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:56.197280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c26f405-844c-4491-899b-92177df19b42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:56.197752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c26f405-844c-4491-899b-92177df19b42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:56.198173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c26f405-844c-4491-899b-92177df19b42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:56.198841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c26f405-844c-4491-899b-92177df19b42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:56.199285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c26f405-844c-4491-899b-92177df19b42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:56.199693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c26f405-844c-4491-899b-92177df19b42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:56.228727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5c26f405-844c-4491-899b-92177df19b42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Aug 06 12:39:56.229371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 489/1131] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:56.278579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dd9f7b31-0a87-4675-b1e5-2b0b46647a7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:56.280761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dd9f7b31-0a87-4675-b1e5-2b0b46647a7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:56.287073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd9f7b31-0a87-4675-b1e5-2b0b46647a7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:56.287553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd9f7b31-0a87-4675-b1e5-2b0b46647a7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:56.288006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd9f7b31-0a87-4675-b1e5-2b0b46647a7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:56.288721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd9f7b31-0a87-4675-b1e5-2b0b46647a7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:56.289172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd9f7b31-0a87-4675-b1e5-2b0b46647a7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:56.289613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd9f7b31-0a87-4675-b1e5-2b0b46647a7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:56.319097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dd9f7b31-0a87-4675-b1e5-2b0b46647a7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044440 Aug 06 12:39:56.319642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 643/1132] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:56 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:56.990736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-77401fc2-6571-4684-8d3e-38c934c47028 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:56.991353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-77401fc2-6571-4684-8d3e-38c934c47028 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:56.997769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77401fc2-6571-4684-8d3e-38c934c47028 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:56.998176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77401fc2-6571-4684-8d3e-38c934c47028 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:56.998600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77401fc2-6571-4684-8d3e-38c934c47028 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:56.999274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77401fc2-6571-4684-8d3e-38c934c47028 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:57.000275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77401fc2-6571-4684-8d3e-38c934c47028 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:57.000717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77401fc2-6571-4684-8d3e-38c934c47028 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:57.060369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-77401fc2-6571-4684-8d3e-38c934c47028 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:57.068439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-77401fc2-6571-4684-8d3e-38c934c47028 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081529 Aug 06 12:39:57.068986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 490/1133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:56 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:57.241334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-75612b80-72b7-4d17-8eb1-0af22a6ac74e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:57.243489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-75612b80-72b7-4d17-8eb1-0af22a6ac74e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:57.249514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75612b80-72b7-4d17-8eb1-0af22a6ac74e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:57.249928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75612b80-72b7-4d17-8eb1-0af22a6ac74e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:57.250351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75612b80-72b7-4d17-8eb1-0af22a6ac74e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:57.251021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75612b80-72b7-4d17-8eb1-0af22a6ac74e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:57.251467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75612b80-72b7-4d17-8eb1-0af22a6ac74e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:57.251879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75612b80-72b7-4d17-8eb1-0af22a6ac74e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:57.279609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-75612b80-72b7-4d17-8eb1-0af22a6ac74e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042257 Aug 06 12:39:57.280212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 644/1134] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:57 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:57.330965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dc4e371b-55d9-4f94-9439-3f6c45810a16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:57.333093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dc4e371b-55d9-4f94-9439-3f6c45810a16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:57.339055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc4e371b-55d9-4f94-9439-3f6c45810a16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:57.339541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc4e371b-55d9-4f94-9439-3f6c45810a16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:57.339975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc4e371b-55d9-4f94-9439-3f6c45810a16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:57.340704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc4e371b-55d9-4f94-9439-3f6c45810a16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:57.341159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc4e371b-55d9-4f94-9439-3f6c45810a16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:57.341583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc4e371b-55d9-4f94-9439-3f6c45810a16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:57.370819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dc4e371b-55d9-4f94-9439-3f6c45810a16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043761 Aug 06 12:39:57.371357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 491/1135] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:58.088108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4db8b1f7-7484-4a06-a491-cfa1c90603c5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:58.088717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4db8b1f7-7484-4a06-a491-cfa1c90603c5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:58.095056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4db8b1f7-7484-4a06-a491-cfa1c90603c5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:58.095529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4db8b1f7-7484-4a06-a491-cfa1c90603c5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:58.095953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4db8b1f7-7484-4a06-a491-cfa1c90603c5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:58.096657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4db8b1f7-7484-4a06-a491-cfa1c90603c5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:58.097103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4db8b1f7-7484-4a06-a491-cfa1c90603c5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:58.097519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4db8b1f7-7484-4a06-a491-cfa1c90603c5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:58.158849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4db8b1f7-7484-4a06-a491-cfa1c90603c5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:58.166659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4db8b1f7-7484-4a06-a491-cfa1c90603c5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082443 Aug 06 12:39:58.167221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 645/1136] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:58 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:58.292050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7c046bd3-e542-4bd7-ae5d-519158507f53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:58.294220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7c046bd3-e542-4bd7-ae5d-519158507f53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:58.301098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c046bd3-e542-4bd7-ae5d-519158507f53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:58.301575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c046bd3-e542-4bd7-ae5d-519158507f53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:58.302003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c046bd3-e542-4bd7-ae5d-519158507f53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:58.302679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c046bd3-e542-4bd7-ae5d-519158507f53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:58.303128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c046bd3-e542-4bd7-ae5d-519158507f53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:58.303541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c046bd3-e542-4bd7-ae5d-519158507f53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:58.331795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7c046bd3-e542-4bd7-ae5d-519158507f53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Aug 06 12:39:58.332381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 492/1137] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:58.382950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9cb60964-151d-4ef0-99a3-31b143a21c42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:58.385096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9cb60964-151d-4ef0-99a3-31b143a21c42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:58.390866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cb60964-151d-4ef0-99a3-31b143a21c42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:58.391334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cb60964-151d-4ef0-99a3-31b143a21c42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:58.391757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cb60964-151d-4ef0-99a3-31b143a21c42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:58.392461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cb60964-151d-4ef0-99a3-31b143a21c42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:58.392901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cb60964-151d-4ef0-99a3-31b143a21c42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:58.393313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cb60964-151d-4ef0-99a3-31b143a21c42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:58.420888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9cb60964-151d-4ef0-99a3-31b143a21c42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041932 Aug 06 12:39:58.422108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 646/1138] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:39:59.192654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c417554a-7700-4a8b-8b79-8986811423a7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:59.194024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c417554a-7700-4a8b-8b79-8986811423a7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:59.201020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c417554a-7700-4a8b-8b79-8986811423a7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:59.201499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c417554a-7700-4a8b-8b79-8986811423a7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:59.201927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c417554a-7700-4a8b-8b79-8986811423a7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:59.203234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c417554a-7700-4a8b-8b79-8986811423a7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:59.203710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c417554a-7700-4a8b-8b79-8986811423a7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:59.204349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c417554a-7700-4a8b-8b79-8986811423a7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:59.270728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c417554a-7700-4a8b-8b79-8986811423a7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:39:59.278128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c417554a-7700-4a8b-8b79-8986811423a7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.094748 Aug 06 12:39:59.278675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 493/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:39:59 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:39:59.344347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b6f81f67-029e-47a0-b750-83d1c3a08cc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:59.346590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b6f81f67-029e-47a0-b750-83d1c3a08cc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:59.352970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6f81f67-029e-47a0-b750-83d1c3a08cc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:59.353455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6f81f67-029e-47a0-b750-83d1c3a08cc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:59.353895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6f81f67-029e-47a0-b750-83d1c3a08cc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:59.354582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6f81f67-029e-47a0-b750-83d1c3a08cc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:59.355034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6f81f67-029e-47a0-b750-83d1c3a08cc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:59.355459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6f81f67-029e-47a0-b750-83d1c3a08cc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:59.384087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b6f81f67-029e-47a0-b750-83d1c3a08cc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044321 Aug 06 12:39:59.384701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 647/1140] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:39:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:39:59.432779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1c47cf6f-519a-463a-8b9f-dea61e010f6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:39:59.434922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1c47cf6f-519a-463a-8b9f-dea61e010f6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:39:59.441152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c47cf6f-519a-463a-8b9f-dea61e010f6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:59.441626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c47cf6f-519a-463a-8b9f-dea61e010f6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:59.442053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c47cf6f-519a-463a-8b9f-dea61e010f6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:59.442739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c47cf6f-519a-463a-8b9f-dea61e010f6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:39:59.443161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c47cf6f-519a-463a-8b9f-dea61e010f6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:39:59.443572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c47cf6f-519a-463a-8b9f-dea61e010f6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:39:59.471594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1c47cf6f-519a-463a-8b9f-dea61e010f6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042677 Aug 06 12:39:59.472127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 494/1141] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:39:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:00.298971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d44308d-7500-42d1-a0b9-3e2df572a754 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:00.299573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1d44308d-7500-42d1-a0b9-3e2df572a754 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:00.306210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d44308d-7500-42d1-a0b9-3e2df572a754 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:00.306677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d44308d-7500-42d1-a0b9-3e2df572a754 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:00.307100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d44308d-7500-42d1-a0b9-3e2df572a754 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:00.307775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d44308d-7500-42d1-a0b9-3e2df572a754 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:00.308220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d44308d-7500-42d1-a0b9-3e2df572a754 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:00.308662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d44308d-7500-42d1-a0b9-3e2df572a754 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:00.370574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1d44308d-7500-42d1-a0b9-3e2df572a754 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:00.377936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1d44308d-7500-42d1-a0b9-3e2df572a754 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082873 Aug 06 12:40:00.378489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 648/1142] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:00 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:00.396067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-41eb08f6-87b9-491c-9312-8556fb792c7a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:00.398267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-41eb08f6-87b9-491c-9312-8556fb792c7a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:00.404049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41eb08f6-87b9-491c-9312-8556fb792c7a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:00.404566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41eb08f6-87b9-491c-9312-8556fb792c7a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:00.404996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41eb08f6-87b9-491c-9312-8556fb792c7a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:00.406180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41eb08f6-87b9-491c-9312-8556fb792c7a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:00.406635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41eb08f6-87b9-491c-9312-8556fb792c7a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:00.407050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41eb08f6-87b9-491c-9312-8556fb792c7a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:00.435079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-41eb08f6-87b9-491c-9312-8556fb792c7a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042926 Aug 06 12:40:00.435662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 495/1143] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:00 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:00.485002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8bfaceb-777e-4b0e-ab67-ef80bdb5fe88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:00.485967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8bfaceb-777e-4b0e-ab67-ef80bdb5fe88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:00.491861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8bfaceb-777e-4b0e-ab67-ef80bdb5fe88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:00.492364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8bfaceb-777e-4b0e-ab67-ef80bdb5fe88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:00.492795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8bfaceb-777e-4b0e-ab67-ef80bdb5fe88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:00.493476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8bfaceb-777e-4b0e-ab67-ef80bdb5fe88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:00.493946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8bfaceb-777e-4b0e-ab67-ef80bdb5fe88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:00.494361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8bfaceb-777e-4b0e-ab67-ef80bdb5fe88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:00.524577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8bfaceb-777e-4b0e-ab67-ef80bdb5fe88 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045507 Aug 06 12:40:00.525204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 649/1144] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:01.397929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6440d504-bb64-43fa-a020-c0aacab1003b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:01.398535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6440d504-bb64-43fa-a020-c0aacab1003b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:01.404851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6440d504-bb64-43fa-a020-c0aacab1003b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:01.405328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6440d504-bb64-43fa-a020-c0aacab1003b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:01.405756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6440d504-bb64-43fa-a020-c0aacab1003b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:01.406433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6440d504-bb64-43fa-a020-c0aacab1003b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:01.406879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6440d504-bb64-43fa-a020-c0aacab1003b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:01.407298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6440d504-bb64-43fa-a020-c0aacab1003b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:01.447065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c7c4a051-7567-4c6b-8268-ee3dbf621c54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:01.449301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c7c4a051-7567-4c6b-8268-ee3dbf621c54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:01.455650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7c4a051-7567-4c6b-8268-ee3dbf621c54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:01.456135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7c4a051-7567-4c6b-8268-ee3dbf621c54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:01.456606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7c4a051-7567-4c6b-8268-ee3dbf621c54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:01.457301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7c4a051-7567-4c6b-8268-ee3dbf621c54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:01.457757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7c4a051-7567-4c6b-8268-ee3dbf621c54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:01.458187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7c4a051-7567-4c6b-8268-ee3dbf621c54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:01.470861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6440d504-bb64-43fa-a020-c0aacab1003b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:01.478278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6440d504-bb64-43fa-a020-c0aacab1003b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084160 Aug 06 12:40:01.478863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 496/1145] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:01 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:01.488025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c7c4a051-7567-4c6b-8268-ee3dbf621c54 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044908 Aug 06 12:40:01.488617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 650/1146] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:01 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:40:01.536128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a61715bd-4649-4401-a1c4-927cad267738 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:01.538381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a61715bd-4649-4401-a1c4-927cad267738 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:01.544225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61715bd-4649-4401-a1c4-927cad267738 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:01.544735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61715bd-4649-4401-a1c4-927cad267738 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:01.545164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61715bd-4649-4401-a1c4-927cad267738 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:01.545846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61715bd-4649-4401-a1c4-927cad267738 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:01.546784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61715bd-4649-4401-a1c4-927cad267738 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:01.547203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61715bd-4649-4401-a1c4-927cad267738 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:01.576453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a61715bd-4649-4401-a1c4-927cad267738 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044106 Aug 06 12:40:01.577213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 497/1147] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:02.499663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-580d4f87-21d8-4047-8502-0a64c6cdee62 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:02.500323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-580d4f87-21d8-4047-8502-0a64c6cdee62 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:02.500677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-298a1001-ab8b-4537-ac56-42cd51f2413a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:02.502795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-298a1001-ab8b-4537-ac56-42cd51f2413a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:02.507401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-580d4f87-21d8-4047-8502-0a64c6cdee62 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:02.508099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-580d4f87-21d8-4047-8502-0a64c6cdee62 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:02.508826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-580d4f87-21d8-4047-8502-0a64c6cdee62 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:02.509377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298a1001-ab8b-4537-ac56-42cd51f2413a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:02.509791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-580d4f87-21d8-4047-8502-0a64c6cdee62 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:02.509957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298a1001-ab8b-4537-ac56-42cd51f2413a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:02.510272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298a1001-ab8b-4537-ac56-42cd51f2413a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:02.510564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-580d4f87-21d8-4047-8502-0a64c6cdee62 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:02.510993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298a1001-ab8b-4537-ac56-42cd51f2413a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:02.511216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-580d4f87-21d8-4047-8502-0a64c6cdee62 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:02.511437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298a1001-ab8b-4537-ac56-42cd51f2413a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:02.511854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298a1001-ab8b-4537-ac56-42cd51f2413a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:02.545949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-298a1001-ab8b-4537-ac56-42cd51f2413a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049662 Aug 06 12:40:02.546517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 498/1148] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:02 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:40:02.574519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-580d4f87-21d8-4047-8502-0a64c6cdee62 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:02.582714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-580d4f87-21d8-4047-8502-0a64c6cdee62 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.087383 Aug 06 12:40:02.583269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 651/1149] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:02 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:02.589028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9127eabf-4ee6-4f04-8215-5ec3369572dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:02.591155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9127eabf-4ee6-4f04-8215-5ec3369572dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:02.597013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9127eabf-4ee6-4f04-8215-5ec3369572dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:02.597490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9127eabf-4ee6-4f04-8215-5ec3369572dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:02.597919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9127eabf-4ee6-4f04-8215-5ec3369572dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:02.598597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9127eabf-4ee6-4f04-8215-5ec3369572dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:02.599042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9127eabf-4ee6-4f04-8215-5ec3369572dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:02.599459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9127eabf-4ee6-4f04-8215-5ec3369572dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:02.628758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9127eabf-4ee6-4f04-8215-5ec3369572dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043623 Aug 06 12:40:02.629296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 499/1150] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:02 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:03.558420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bbba3095-f7c8-4f55-97fc-718711037e22 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:03.560591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bbba3095-f7c8-4f55-97fc-718711037e22 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:03.567226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbba3095-f7c8-4f55-97fc-718711037e22 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:03.567710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbba3095-f7c8-4f55-97fc-718711037e22 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:03.568149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbba3095-f7c8-4f55-97fc-718711037e22 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:03.568862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbba3095-f7c8-4f55-97fc-718711037e22 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:03.569318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbba3095-f7c8-4f55-97fc-718711037e22 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:03.569745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbba3095-f7c8-4f55-97fc-718711037e22 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:03.597617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bbba3095-f7c8-4f55-97fc-718711037e22 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043218 Aug 06 12:40:03.598175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 652/1151] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:03 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:03.602831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-310b6e27-85e8-427a-a989-bc74c13689e4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:03.603435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-310b6e27-85e8-427a-a989-bc74c13689e4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:03.610435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310b6e27-85e8-427a-a989-bc74c13689e4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:03.610908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310b6e27-85e8-427a-a989-bc74c13689e4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:03.611337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310b6e27-85e8-427a-a989-bc74c13689e4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:03.612011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310b6e27-85e8-427a-a989-bc74c13689e4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:03.612495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310b6e27-85e8-427a-a989-bc74c13689e4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:03.612915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310b6e27-85e8-427a-a989-bc74c13689e4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:03.640765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16c45b39-8725-44de-a9d7-b4f9a17bf6bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:03.642911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16c45b39-8725-44de-a9d7-b4f9a17bf6bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:03.648842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16c45b39-8725-44de-a9d7-b4f9a17bf6bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:03.649328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16c45b39-8725-44de-a9d7-b4f9a17bf6bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:03.649862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16c45b39-8725-44de-a9d7-b4f9a17bf6bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:03.650566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16c45b39-8725-44de-a9d7-b4f9a17bf6bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:03.651021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16c45b39-8725-44de-a9d7-b4f9a17bf6bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:03.651445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16c45b39-8725-44de-a9d7-b4f9a17bf6bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:03.673206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-310b6e27-85e8-427a-a989-bc74c13689e4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:03.680790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-310b6e27-85e8-427a-a989-bc74c13689e4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081792 Aug 06 12:40:03.681051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16c45b39-8725-44de-a9d7-b4f9a17bf6bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044093 Aug 06 12:40:03.681354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 500/1152] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:03 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:03.681860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 653/1153] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:40:04.609822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6e5d7a8f-50df-444c-b952-85f9bc144cbd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:04.611959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6e5d7a8f-50df-444c-b952-85f9bc144cbd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:04.618283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e5d7a8f-50df-444c-b952-85f9bc144cbd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:04.618763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e5d7a8f-50df-444c-b952-85f9bc144cbd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:04.619191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e5d7a8f-50df-444c-b952-85f9bc144cbd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:04.619869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e5d7a8f-50df-444c-b952-85f9bc144cbd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:04.620340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e5d7a8f-50df-444c-b952-85f9bc144cbd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:04.620828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e5d7a8f-50df-444c-b952-85f9bc144cbd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:04.649721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6e5d7a8f-50df-444c-b952-85f9bc144cbd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Aug 06 12:40:04.650244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 501/1154] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:04.693526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-70108a02-1fba-42e8-97f6-35be9f7cca5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:04.695744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-70108a02-1fba-42e8-97f6-35be9f7cca5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:04.701440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2849d5d4-9582-4a17-8b10-47ea2582b861 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:04.702122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70108a02-1fba-42e8-97f6-35be9f7cca5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:04.702796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2849d5d4-9582-4a17-8b10-47ea2582b861 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:04.703108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70108a02-1fba-42e8-97f6-35be9f7cca5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:04.703533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70108a02-1fba-42e8-97f6-35be9f7cca5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:04.704211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70108a02-1fba-42e8-97f6-35be9f7cca5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:04.704684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70108a02-1fba-42e8-97f6-35be9f7cca5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:04.705098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70108a02-1fba-42e8-97f6-35be9f7cca5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:04.708592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2849d5d4-9582-4a17-8b10-47ea2582b861 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:04.709074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2849d5d4-9582-4a17-8b10-47ea2582b861 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:04.709509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2849d5d4-9582-4a17-8b10-47ea2582b861 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:04.710189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2849d5d4-9582-4a17-8b10-47ea2582b861 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:04.710638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2849d5d4-9582-4a17-8b10-47ea2582b861 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:04.711055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2849d5d4-9582-4a17-8b10-47ea2582b861 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:04.734096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-70108a02-1fba-42e8-97f6-35be9f7cca5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044409 Aug 06 12:40:04.734637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 654/1155] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:04.773090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2849d5d4-9582-4a17-8b10-47ea2582b861 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:04.780880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2849d5d4-9582-4a17-8b10-47ea2582b861 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083013 Aug 06 12:40:04.781647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 502/1156] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:04 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:05.662400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-72fe51f1-7c3e-4bfc-b08f-0bcd571e30ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:05.664522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-72fe51f1-7c3e-4bfc-b08f-0bcd571e30ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:05.670409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72fe51f1-7c3e-4bfc-b08f-0bcd571e30ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:05.671496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72fe51f1-7c3e-4bfc-b08f-0bcd571e30ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:05.671934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72fe51f1-7c3e-4bfc-b08f-0bcd571e30ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:05.672658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72fe51f1-7c3e-4bfc-b08f-0bcd571e30ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:05.673115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72fe51f1-7c3e-4bfc-b08f-0bcd571e30ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:05.673545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72fe51f1-7c3e-4bfc-b08f-0bcd571e30ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:05.703199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-72fe51f1-7c3e-4bfc-b08f-0bcd571e30ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044838 Aug 06 12:40:05.703933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 655/1157] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:05 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:05.746287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-999d8def-5b97-4cc6-a6bc-a7859f29afcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:05.748466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-999d8def-5b97-4cc6-a6bc-a7859f29afcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:05.754818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-999d8def-5b97-4cc6-a6bc-a7859f29afcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:05.755295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-999d8def-5b97-4cc6-a6bc-a7859f29afcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:05.755741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-999d8def-5b97-4cc6-a6bc-a7859f29afcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:05.756424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-999d8def-5b97-4cc6-a6bc-a7859f29afcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:05.756877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-999d8def-5b97-4cc6-a6bc-a7859f29afcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:05.757296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-999d8def-5b97-4cc6-a6bc-a7859f29afcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:05.760811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:05.786520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-999d8def-5b97-4cc6-a6bc-a7859f29afcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044220 Aug 06 12:40:05.787066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 503/1158] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:05.801011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-35954a8d-979d-4284-872e-a57263ba5b7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:05.801626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-35954a8d-979d-4284-872e-a57263ba5b7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:05.807534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35954a8d-979d-4284-872e-a57263ba5b7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:05.808014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35954a8d-979d-4284-872e-a57263ba5b7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:05.808495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35954a8d-979d-4284-872e-a57263ba5b7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:05.809190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35954a8d-979d-4284-872e-a57263ba5b7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:05.809645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35954a8d-979d-4284-872e-a57263ba5b7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:05.810066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35954a8d-979d-4284-872e-a57263ba5b7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:05.828077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:05.941072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-35954a8d-979d-4284-872e-a57263ba5b7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:05.948514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-35954a8d-979d-4284-872e-a57263ba5b7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.151244 Aug 06 12:40:05.949073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 656/1159] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:05 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:06.715287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bd0f1fa4-643b-4567-a397-f4e4588f81ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:06.717479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bd0f1fa4-643b-4567-a397-f4e4588f81ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:06.723307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd0f1fa4-643b-4567-a397-f4e4588f81ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:06.723782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd0f1fa4-643b-4567-a397-f4e4588f81ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:06.724211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd0f1fa4-643b-4567-a397-f4e4588f81ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:06.724913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd0f1fa4-643b-4567-a397-f4e4588f81ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:06.725361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd0f1fa4-643b-4567-a397-f4e4588f81ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:06.725778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd0f1fa4-643b-4567-a397-f4e4588f81ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:06.755458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bd0f1fa4-643b-4567-a397-f4e4588f81ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044170 Aug 06 12:40:06.756166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 504/1160] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:06 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:06.798795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-101e58de-58e7-43fb-8b03-ec2abeef49d6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:06.801036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-101e58de-58e7-43fb-8b03-ec2abeef49d6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:06.807362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101e58de-58e7-43fb-8b03-ec2abeef49d6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:06.807837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101e58de-58e7-43fb-8b03-ec2abeef49d6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:06.808270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101e58de-58e7-43fb-8b03-ec2abeef49d6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:06.808981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101e58de-58e7-43fb-8b03-ec2abeef49d6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:06.809429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101e58de-58e7-43fb-8b03-ec2abeef49d6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:06.809846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-101e58de-58e7-43fb-8b03-ec2abeef49d6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:06.838450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-101e58de-58e7-43fb-8b03-ec2abeef49d6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044081 Aug 06 12:40:06.838999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 657/1161] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:06 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:06.969817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c34e8ffd-b5a7-43d8-b257-81f207d1943f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:06.970675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c34e8ffd-b5a7-43d8-b257-81f207d1943f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:06.976501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34e8ffd-b5a7-43d8-b257-81f207d1943f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:06.976988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34e8ffd-b5a7-43d8-b257-81f207d1943f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:06.977417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34e8ffd-b5a7-43d8-b257-81f207d1943f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:06.978097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34e8ffd-b5a7-43d8-b257-81f207d1943f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:06.978544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34e8ffd-b5a7-43d8-b257-81f207d1943f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:06.978962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34e8ffd-b5a7-43d8-b257-81f207d1943f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:07.082136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c34e8ffd-b5a7-43d8-b257-81f207d1943f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:07.095232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c34e8ffd-b5a7-43d8-b257-81f207d1943f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.129804 Aug 06 12:40:07.095792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 505/1162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:06 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:07.767306 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-69b0074f-577d-4045-b40c-0e2ff783d974 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:07.769502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-69b0074f-577d-4045-b40c-0e2ff783d974 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:07.775438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69b0074f-577d-4045-b40c-0e2ff783d974 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:07.775911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69b0074f-577d-4045-b40c-0e2ff783d974 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:07.776365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69b0074f-577d-4045-b40c-0e2ff783d974 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:07.777039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69b0074f-577d-4045-b40c-0e2ff783d974 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:07.777482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69b0074f-577d-4045-b40c-0e2ff783d974 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:07.777899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69b0074f-577d-4045-b40c-0e2ff783d974 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:07.807685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-69b0074f-577d-4045-b40c-0e2ff783d974 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Aug 06 12:40:07.808356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 658/1163] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:07 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:40:07.850619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0832f6cc-5baf-45a7-88fe-98b152b0d53c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:07.852761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0832f6cc-5baf-45a7-88fe-98b152b0d53c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:07.859923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0832f6cc-5baf-45a7-88fe-98b152b0d53c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:07.860431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0832f6cc-5baf-45a7-88fe-98b152b0d53c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:07.860863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0832f6cc-5baf-45a7-88fe-98b152b0d53c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:07.861544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0832f6cc-5baf-45a7-88fe-98b152b0d53c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:07.861991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0832f6cc-5baf-45a7-88fe-98b152b0d53c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:07.862410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0832f6cc-5baf-45a7-88fe-98b152b0d53c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:07.897319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0832f6cc-5baf-45a7-88fe-98b152b0d53c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050584 Aug 06 12:40:07.897884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 506/1164] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:07 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:08.116070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-669efe8a-fd66-4fc4-811d-2034d1265a70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:08.116696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-669efe8a-fd66-4fc4-811d-2034d1265a70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:08.122777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-669efe8a-fd66-4fc4-811d-2034d1265a70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:08.123255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-669efe8a-fd66-4fc4-811d-2034d1265a70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:08.123688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-669efe8a-fd66-4fc4-811d-2034d1265a70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:08.124410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-669efe8a-fd66-4fc4-811d-2034d1265a70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:08.124863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-669efe8a-fd66-4fc4-811d-2034d1265a70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:08.125282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-669efe8a-fd66-4fc4-811d-2034d1265a70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:08.185751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-669efe8a-fd66-4fc4-811d-2034d1265a70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:08.201208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-669efe8a-fd66-4fc4-811d-2034d1265a70 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.089326 Aug 06 12:40:08.201782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 659/1165] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:08 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:08.819111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e5d7a659-7d11-4452-953b-e18753c0f32a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:08.821255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e5d7a659-7d11-4452-953b-e18753c0f32a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:08.827340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d7a659-7d11-4452-953b-e18753c0f32a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:08.827821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d7a659-7d11-4452-953b-e18753c0f32a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:08.828250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d7a659-7d11-4452-953b-e18753c0f32a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:08.828962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d7a659-7d11-4452-953b-e18753c0f32a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:08.829408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d7a659-7d11-4452-953b-e18753c0f32a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:08.829824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5d7a659-7d11-4452-953b-e18753c0f32a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:08.858235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e5d7a659-7d11-4452-953b-e18753c0f32a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Aug 06 12:40:08.859353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 507/1166] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:08 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:08.909586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-afa5b56f-a98a-46a0-afc9-1c097b8f2bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:08.911722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-afa5b56f-a98a-46a0-afc9-1c097b8f2bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:08.918098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afa5b56f-a98a-46a0-afc9-1c097b8f2bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:08.918578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afa5b56f-a98a-46a0-afc9-1c097b8f2bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:08.919014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afa5b56f-a98a-46a0-afc9-1c097b8f2bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:08.919706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afa5b56f-a98a-46a0-afc9-1c097b8f2bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:08.920159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afa5b56f-a98a-46a0-afc9-1c097b8f2bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:08.920608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afa5b56f-a98a-46a0-afc9-1c097b8f2bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:08.950416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-afa5b56f-a98a-46a0-afc9-1c097b8f2bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044822 Aug 06 12:40:08.950962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 660/1167] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:08 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:09.221886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5e0afba8-ca22-42c0-98e1-5e914da040de tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:09.222486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5e0afba8-ca22-42c0-98e1-5e914da040de tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:09.228463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e0afba8-ca22-42c0-98e1-5e914da040de tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:09.228952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e0afba8-ca22-42c0-98e1-5e914da040de tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:09.229385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e0afba8-ca22-42c0-98e1-5e914da040de tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:09.230044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e0afba8-ca22-42c0-98e1-5e914da040de tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:09.230493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e0afba8-ca22-42c0-98e1-5e914da040de tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:09.230913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e0afba8-ca22-42c0-98e1-5e914da040de tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:09.295402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5e0afba8-ca22-42c0-98e1-5e914da040de tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:09.303526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5e0afba8-ca22-42c0-98e1-5e914da040de tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085987 Aug 06 12:40:09.304088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 508/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:09 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:09.871024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-715731ae-71d1-4803-b81a-ad500a0f0a0a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:09.873204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-715731ae-71d1-4803-b81a-ad500a0f0a0a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:09.879590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-715731ae-71d1-4803-b81a-ad500a0f0a0a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:09.880060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-715731ae-71d1-4803-b81a-ad500a0f0a0a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:09.880526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-715731ae-71d1-4803-b81a-ad500a0f0a0a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:09.881207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-715731ae-71d1-4803-b81a-ad500a0f0a0a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:09.881656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-715731ae-71d1-4803-b81a-ad500a0f0a0a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:09.882074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-715731ae-71d1-4803-b81a-ad500a0f0a0a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:09.910331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-715731ae-71d1-4803-b81a-ad500a0f0a0a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Aug 06 12:40:09.910929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 661/1169] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:09 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:09.962590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7554132f-3e69-4202-bfd5-c6609647a3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:09.964818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7554132f-3e69-4202-bfd5-c6609647a3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:09.971119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7554132f-3e69-4202-bfd5-c6609647a3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:09.971594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7554132f-3e69-4202-bfd5-c6609647a3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:09.972024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7554132f-3e69-4202-bfd5-c6609647a3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:09.972755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7554132f-3e69-4202-bfd5-c6609647a3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:09.973206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7554132f-3e69-4202-bfd5-c6609647a3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:09.973621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7554132f-3e69-4202-bfd5-c6609647a3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:10.003175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7554132f-3e69-4202-bfd5-c6609647a3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044508 Aug 06 12:40:10.003722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 509/1170] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:10.323690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6501d27a-5ec8-4513-b6ca-d6dd3b04cb44 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:10.324319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6501d27a-5ec8-4513-b6ca-d6dd3b04cb44 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:10.330818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6501d27a-5ec8-4513-b6ca-d6dd3b04cb44 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:10.331295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6501d27a-5ec8-4513-b6ca-d6dd3b04cb44 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:10.331731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6501d27a-5ec8-4513-b6ca-d6dd3b04cb44 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:10.332455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6501d27a-5ec8-4513-b6ca-d6dd3b04cb44 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:10.332910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6501d27a-5ec8-4513-b6ca-d6dd3b04cb44 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:10.333331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6501d27a-5ec8-4513-b6ca-d6dd3b04cb44 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:10.395971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6501d27a-5ec8-4513-b6ca-d6dd3b04cb44 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:10.403328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6501d27a-5ec8-4513-b6ca-d6dd3b04cb44 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083477 Aug 06 12:40:10.403883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 662/1171] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:10 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:10.923156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c7d9c3b9-9034-4191-92dd-8fe8be1e28e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:10.925285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c7d9c3b9-9034-4191-92dd-8fe8be1e28e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:10.931144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d9c3b9-9034-4191-92dd-8fe8be1e28e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:10.931615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d9c3b9-9034-4191-92dd-8fe8be1e28e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:10.932045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d9c3b9-9034-4191-92dd-8fe8be1e28e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:10.932753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d9c3b9-9034-4191-92dd-8fe8be1e28e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:10.933197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d9c3b9-9034-4191-92dd-8fe8be1e28e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:10.933608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d9c3b9-9034-4191-92dd-8fe8be1e28e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:10.961925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c7d9c3b9-9034-4191-92dd-8fe8be1e28e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043346 Aug 06 12:40:10.962457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 510/1172] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:10 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:11.016101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-896e41ca-df24-4208-a1e7-399c5bf16efc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:11.018257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-896e41ca-df24-4208-a1e7-399c5bf16efc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:11.024118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-896e41ca-df24-4208-a1e7-399c5bf16efc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:11.024631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-896e41ca-df24-4208-a1e7-399c5bf16efc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:11.025063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-896e41ca-df24-4208-a1e7-399c5bf16efc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:11.025740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-896e41ca-df24-4208-a1e7-399c5bf16efc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:11.026188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-896e41ca-df24-4208-a1e7-399c5bf16efc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:11.026607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-896e41ca-df24-4208-a1e7-399c5bf16efc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:11.054571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-896e41ca-df24-4208-a1e7-399c5bf16efc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043022 Aug 06 12:40:11.055099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 663/1173] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:11 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:11.424549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c34007f6-8302-4ea8-8c04-21189f5312c6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:11.425155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c34007f6-8302-4ea8-8c04-21189f5312c6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:11.431407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34007f6-8302-4ea8-8c04-21189f5312c6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:11.431880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34007f6-8302-4ea8-8c04-21189f5312c6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:11.432316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34007f6-8302-4ea8-8c04-21189f5312c6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:11.433005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34007f6-8302-4ea8-8c04-21189f5312c6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:11.433454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34007f6-8302-4ea8-8c04-21189f5312c6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:11.433872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c34007f6-8302-4ea8-8c04-21189f5312c6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:11.494213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c34007f6-8302-4ea8-8c04-21189f5312c6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:11.501863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c34007f6-8302-4ea8-8c04-21189f5312c6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081760 Aug 06 12:40:11.502426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 511/1174] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:11 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:11.974486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ce816f17-5f26-4816-97a3-c9191a0f70f7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:11.976725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ce816f17-5f26-4816-97a3-c9191a0f70f7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:11.983291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce816f17-5f26-4816-97a3-c9191a0f70f7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:11.983770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce816f17-5f26-4816-97a3-c9191a0f70f7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:11.984200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce816f17-5f26-4816-97a3-c9191a0f70f7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:11.984918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce816f17-5f26-4816-97a3-c9191a0f70f7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:11.985367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce816f17-5f26-4816-97a3-c9191a0f70f7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:11.985783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce816f17-5f26-4816-97a3-c9191a0f70f7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:12.014213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ce816f17-5f26-4816-97a3-c9191a0f70f7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Aug 06 12:40:12.015281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 664/1175] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:11 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:12.067245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-11885a4b-333e-4988-ae57-7495e35e96ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:12.069374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-11885a4b-333e-4988-ae57-7495e35e96ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:12.075246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11885a4b-333e-4988-ae57-7495e35e96ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:12.075718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11885a4b-333e-4988-ae57-7495e35e96ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:12.076144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11885a4b-333e-4988-ae57-7495e35e96ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:12.076842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11885a4b-333e-4988-ae57-7495e35e96ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:12.077284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11885a4b-333e-4988-ae57-7495e35e96ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:12.077696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11885a4b-333e-4988-ae57-7495e35e96ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:12.105794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-11885a4b-333e-4988-ae57-7495e35e96ab tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042435 Aug 06 12:40:12.106325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 512/1176] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:12 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:40:12.522064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-683e3f12-996a-4a6e-8a2f-6d9e1a886eb0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:12.522732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-683e3f12-996a-4a6e-8a2f-6d9e1a886eb0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:12.528549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-683e3f12-996a-4a6e-8a2f-6d9e1a886eb0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:12.529029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-683e3f12-996a-4a6e-8a2f-6d9e1a886eb0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:12.529461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-683e3f12-996a-4a6e-8a2f-6d9e1a886eb0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:12.530142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-683e3f12-996a-4a6e-8a2f-6d9e1a886eb0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:12.531263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-683e3f12-996a-4a6e-8a2f-6d9e1a886eb0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:12.531684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-683e3f12-996a-4a6e-8a2f-6d9e1a886eb0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:12.591197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-683e3f12-996a-4a6e-8a2f-6d9e1a886eb0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:12.599165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-683e3f12-996a-4a6e-8a2f-6d9e1a886eb0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080969 Aug 06 12:40:12.599748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 665/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:12 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:13.027095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1edf0d4a-550b-427d-bdd5-b961ce34a3fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:13.029306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1edf0d4a-550b-427d-bdd5-b961ce34a3fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:13.035610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1edf0d4a-550b-427d-bdd5-b961ce34a3fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:13.036088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1edf0d4a-550b-427d-bdd5-b961ce34a3fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:13.036626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1edf0d4a-550b-427d-bdd5-b961ce34a3fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:13.037317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1edf0d4a-550b-427d-bdd5-b961ce34a3fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:13.037768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1edf0d4a-550b-427d-bdd5-b961ce34a3fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:13.038190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1edf0d4a-550b-427d-bdd5-b961ce34a3fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:13.066659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1edf0d4a-550b-427d-bdd5-b961ce34a3fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043553 Aug 06 12:40:13.067264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 513/1178] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:13 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:13.119023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-67887edb-cf93-41f1-ad13-df4dce188762 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:13.121507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-67887edb-cf93-41f1-ad13-df4dce188762 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:13.128224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67887edb-cf93-41f1-ad13-df4dce188762 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:13.128735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67887edb-cf93-41f1-ad13-df4dce188762 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:13.129162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67887edb-cf93-41f1-ad13-df4dce188762 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:13.129839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67887edb-cf93-41f1-ad13-df4dce188762 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:13.130288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67887edb-cf93-41f1-ad13-df4dce188762 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:13.130704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67887edb-cf93-41f1-ad13-df4dce188762 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:13.160163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-67887edb-cf93-41f1-ad13-df4dce188762 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045073 Aug 06 12:40:13.160728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 666/1179] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:13 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:13.619714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-59b84269-f995-473a-a308-f448a26a69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:13.620328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-59b84269-f995-473a-a308-f448a26a69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:13.622196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=86 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:13.627403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59b84269-f995-473a-a308-f448a26a69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:13.627875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59b84269-f995-473a-a308-f448a26a69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:13.628317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59b84269-f995-473a-a308-f448a26a69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:13.628994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59b84269-f995-473a-a308-f448a26a69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:13.629436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59b84269-f995-473a-a308-f448a26a69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:13.629850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59b84269-f995-473a-a308-f448a26a69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:13.689442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-59b84269-f995-473a-a308-f448a26a69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:13.696754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-59b84269-f995-473a-a308-f448a26a69cd tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080841 Aug 06 12:40:13.697309 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 514/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:13 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:14.079828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c6e51812-70d8-44e5-9a41-3490430c1263 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:14.081987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c6e51812-70d8-44e5-9a41-3490430c1263 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:14.087924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6e51812-70d8-44e5-9a41-3490430c1263 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:14.088435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6e51812-70d8-44e5-9a41-3490430c1263 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:14.088868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6e51812-70d8-44e5-9a41-3490430c1263 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:14.089549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6e51812-70d8-44e5-9a41-3490430c1263 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:14.089997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6e51812-70d8-44e5-9a41-3490430c1263 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:14.090418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6e51812-70d8-44e5-9a41-3490430c1263 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:14.118809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c6e51812-70d8-44e5-9a41-3490430c1263 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043508 Aug 06 12:40:14.119351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 667/1181] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:14 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:14.172171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9183ea64-9cf1-4217-a0d1-444eccc84e84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:14.174352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9183ea64-9cf1-4217-a0d1-444eccc84e84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:14.180699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9183ea64-9cf1-4217-a0d1-444eccc84e84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:14.181180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9183ea64-9cf1-4217-a0d1-444eccc84e84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:14.181609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9183ea64-9cf1-4217-a0d1-444eccc84e84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:14.182299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9183ea64-9cf1-4217-a0d1-444eccc84e84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:14.182741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9183ea64-9cf1-4217-a0d1-444eccc84e84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:14.183151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9183ea64-9cf1-4217-a0d1-444eccc84e84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:14.212679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9183ea64-9cf1-4217-a0d1-444eccc84e84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044300 Aug 06 12:40:14.213227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 515/1182] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:14.716747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9ddc5ff6-82f1-46a6-81f8-d08ac5abd8d8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:14.717342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9ddc5ff6-82f1-46a6-81f8-d08ac5abd8d8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:14.723743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ddc5ff6-82f1-46a6-81f8-d08ac5abd8d8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:14.724214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ddc5ff6-82f1-46a6-81f8-d08ac5abd8d8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:14.724671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ddc5ff6-82f1-46a6-81f8-d08ac5abd8d8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:14.725348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ddc5ff6-82f1-46a6-81f8-d08ac5abd8d8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:14.725791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ddc5ff6-82f1-46a6-81f8-d08ac5abd8d8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:14.726205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ddc5ff6-82f1-46a6-81f8-d08ac5abd8d8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:14.787067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9ddc5ff6-82f1-46a6-81f8-d08ac5abd8d8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:14.794571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9ddc5ff6-82f1-46a6-81f8-d08ac5abd8d8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081682 Aug 06 12:40:14.795129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 668/1183] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:14 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:15.130990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eb9ccf70-0520-48ae-8a29-6f4fb8a4d19d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:15.133137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eb9ccf70-0520-48ae-8a29-6f4fb8a4d19d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:15.139384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb9ccf70-0520-48ae-8a29-6f4fb8a4d19d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:15.139874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb9ccf70-0520-48ae-8a29-6f4fb8a4d19d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:15.140322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb9ccf70-0520-48ae-8a29-6f4fb8a4d19d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:15.141006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb9ccf70-0520-48ae-8a29-6f4fb8a4d19d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:15.141452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb9ccf70-0520-48ae-8a29-6f4fb8a4d19d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:15.141877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb9ccf70-0520-48ae-8a29-6f4fb8a4d19d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:15.170110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eb9ccf70-0520-48ae-8a29-6f4fb8a4d19d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 Aug 06 12:40:15.170655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 516/1184] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:15 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:15.224629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a7050e2d-7d3c-4b12-96c8-6e038e28d0f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:15.226777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a7050e2d-7d3c-4b12-96c8-6e038e28d0f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:15.232819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7050e2d-7d3c-4b12-96c8-6e038e28d0f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:15.233909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7050e2d-7d3c-4b12-96c8-6e038e28d0f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:15.234340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7050e2d-7d3c-4b12-96c8-6e038e28d0f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:15.235305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7050e2d-7d3c-4b12-96c8-6e038e28d0f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:15.235754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7050e2d-7d3c-4b12-96c8-6e038e28d0f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:15.236172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7050e2d-7d3c-4b12-96c8-6e038e28d0f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:15.263633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a7050e2d-7d3c-4b12-96c8-6e038e28d0f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042863 Aug 06 12:40:15.264107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 669/1185] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:15 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:15.815246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eef4b36d-6f17-4070-86ac-68605faf17fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:15.815850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eef4b36d-6f17-4070-86ac-68605faf17fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:15.821726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eef4b36d-6f17-4070-86ac-68605faf17fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:15.822206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eef4b36d-6f17-4070-86ac-68605faf17fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:15.822668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eef4b36d-6f17-4070-86ac-68605faf17fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:15.823345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eef4b36d-6f17-4070-86ac-68605faf17fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:15.823793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eef4b36d-6f17-4070-86ac-68605faf17fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:15.824212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eef4b36d-6f17-4070-86ac-68605faf17fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:15.884249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eef4b36d-6f17-4070-86ac-68605faf17fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:15.892237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eef4b36d-6f17-4070-86ac-68605faf17fb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081004 Aug 06 12:40:15.892828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 517/1186] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:15 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:16.183086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b3ef26f7-7d38-4863-85ed-6f8a02c1f883 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:16.185204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b3ef26f7-7d38-4863-85ed-6f8a02c1f883 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:16.192057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3ef26f7-7d38-4863-85ed-6f8a02c1f883 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:16.192571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3ef26f7-7d38-4863-85ed-6f8a02c1f883 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:16.193065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3ef26f7-7d38-4863-85ed-6f8a02c1f883 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:16.193748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3ef26f7-7d38-4863-85ed-6f8a02c1f883 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:16.194194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3ef26f7-7d38-4863-85ed-6f8a02c1f883 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:16.194611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3ef26f7-7d38-4863-85ed-6f8a02c1f883 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:16.223284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b3ef26f7-7d38-4863-85ed-6f8a02c1f883 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 Aug 06 12:40:16.223826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 670/1187] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:16 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:16.275728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a401e8c6-7c20-4b0f-82d4-3ed2fd877d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:16.277984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a401e8c6-7c20-4b0f-82d4-3ed2fd877d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:16.283798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a401e8c6-7c20-4b0f-82d4-3ed2fd877d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:16.284270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a401e8c6-7c20-4b0f-82d4-3ed2fd877d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:16.284726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a401e8c6-7c20-4b0f-82d4-3ed2fd877d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:16.285404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a401e8c6-7c20-4b0f-82d4-3ed2fd877d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:16.285848 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a401e8c6-7c20-4b0f-82d4-3ed2fd877d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:16.286284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a401e8c6-7c20-4b0f-82d4-3ed2fd877d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:16.314912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a401e8c6-7c20-4b0f-82d4-3ed2fd877d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043183 Aug 06 12:40:16.315451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 518/1188] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:16.914349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1bd82418-f4c6-41bb-b134-b19b7dac97d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:16.914955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1bd82418-f4c6-41bb-b134-b19b7dac97d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:16.921997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bd82418-f4c6-41bb-b134-b19b7dac97d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:16.922549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bd82418-f4c6-41bb-b134-b19b7dac97d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:16.923018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bd82418-f4c6-41bb-b134-b19b7dac97d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:16.923722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bd82418-f4c6-41bb-b134-b19b7dac97d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:16.924178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bd82418-f4c6-41bb-b134-b19b7dac97d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:16.924644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bd82418-f4c6-41bb-b134-b19b7dac97d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:16.986595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1bd82418-f4c6-41bb-b134-b19b7dac97d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:16.994356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1bd82418-f4c6-41bb-b134-b19b7dac97d5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085779 Aug 06 12:40:16.995114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 671/1189] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:16 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:17.235556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb9d945e-7248-445e-8971-ad5073e27612 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:17.237721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb9d945e-7248-445e-8971-ad5073e27612 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:17.244028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb9d945e-7248-445e-8971-ad5073e27612 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:17.244538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb9d945e-7248-445e-8971-ad5073e27612 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:17.244967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb9d945e-7248-445e-8971-ad5073e27612 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:17.245648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb9d945e-7248-445e-8971-ad5073e27612 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:17.246096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb9d945e-7248-445e-8971-ad5073e27612 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:17.246515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb9d945e-7248-445e-8971-ad5073e27612 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:17.270807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:17.275909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb9d945e-7248-445e-8971-ad5073e27612 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Aug 06 12:40:17.276505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 519/1190] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:17 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:17.327070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dcedb308-c935-4137-9e8b-fb050131055c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:17.329791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dcedb308-c935-4137-9e8b-fb050131055c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:17.336040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcedb308-c935-4137-9e8b-fb050131055c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:17.336565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcedb308-c935-4137-9e8b-fb050131055c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:17.336991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcedb308-c935-4137-9e8b-fb050131055c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:17.337669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcedb308-c935-4137-9e8b-fb050131055c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:17.338115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcedb308-c935-4137-9e8b-fb050131055c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:17.338528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcedb308-c935-4137-9e8b-fb050131055c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:17.366383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dcedb308-c935-4137-9e8b-fb050131055c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043356 Aug 06 12:40:17.366922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 672/1191] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:17 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:18.014695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d3614f14-3513-45df-87a7-432324d8ef8a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:18.015295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d3614f14-3513-45df-87a7-432324d8ef8a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:18.021307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3614f14-3513-45df-87a7-432324d8ef8a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:18.021777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3614f14-3513-45df-87a7-432324d8ef8a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:18.022202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3614f14-3513-45df-87a7-432324d8ef8a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:18.022875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3614f14-3513-45df-87a7-432324d8ef8a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:18.023318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3614f14-3513-45df-87a7-432324d8ef8a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:18.023733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3614f14-3513-45df-87a7-432324d8ef8a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:18.085354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d3614f14-3513-45df-87a7-432324d8ef8a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:18.092625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d3614f14-3513-45df-87a7-432324d8ef8a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081743 Aug 06 12:40:18.093171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 520/1192] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:18 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:18.288856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0afc8729-280a-4d4b-a2b4-c317128f758c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:18.291579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0afc8729-280a-4d4b-a2b4-c317128f758c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:18.298120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0afc8729-280a-4d4b-a2b4-c317128f758c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:18.298600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0afc8729-280a-4d4b-a2b4-c317128f758c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:18.299034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0afc8729-280a-4d4b-a2b4-c317128f758c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:18.299725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0afc8729-280a-4d4b-a2b4-c317128f758c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:18.300174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0afc8729-280a-4d4b-a2b4-c317128f758c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:18.300627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0afc8729-280a-4d4b-a2b4-c317128f758c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:18.304194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:18.328737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0afc8729-280a-4d4b-a2b4-c317128f758c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043940 Aug 06 12:40:18.329276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 673/1193] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:18 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:18.378800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d0e0f1a-4fdd-4a37-b9c1-28d84a4df000 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:18.381002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9d0e0f1a-4fdd-4a37-b9c1-28d84a4df000 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:18.386883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d0e0f1a-4fdd-4a37-b9c1-28d84a4df000 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:18.387354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d0e0f1a-4fdd-4a37-b9c1-28d84a4df000 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:18.387781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d0e0f1a-4fdd-4a37-b9c1-28d84a4df000 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:18.388480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d0e0f1a-4fdd-4a37-b9c1-28d84a4df000 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:18.388924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d0e0f1a-4fdd-4a37-b9c1-28d84a4df000 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:18.389337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d0e0f1a-4fdd-4a37-b9c1-28d84a4df000 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:18.418145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d0e0f1a-4fdd-4a37-b9c1-28d84a4df000 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043177 Aug 06 12:40:18.418675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 521/1194] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:19.113652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa6cc686-c342-4f69-9873-27839ee2f72e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:19.114277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa6cc686-c342-4f69-9873-27839ee2f72e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:19.120638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa6cc686-c342-4f69-9873-27839ee2f72e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:19.121108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa6cc686-c342-4f69-9873-27839ee2f72e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:19.121537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa6cc686-c342-4f69-9873-27839ee2f72e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:19.122213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa6cc686-c342-4f69-9873-27839ee2f72e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:19.122661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa6cc686-c342-4f69-9873-27839ee2f72e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:19.123081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa6cc686-c342-4f69-9873-27839ee2f72e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:19.188838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fa6cc686-c342-4f69-9873-27839ee2f72e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:19.196432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa6cc686-c342-4f69-9873-27839ee2f72e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.086647 Aug 06 12:40:19.196994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 674/1195] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:19 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:19.340907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f18eacdc-a31e-4b65-b497-5addbb533d1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:19.343047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f18eacdc-a31e-4b65-b497-5addbb533d1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:19.350292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f18eacdc-a31e-4b65-b497-5addbb533d1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:19.350770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f18eacdc-a31e-4b65-b497-5addbb533d1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:19.351443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f18eacdc-a31e-4b65-b497-5addbb533d1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:19.352135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f18eacdc-a31e-4b65-b497-5addbb533d1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:19.352616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f18eacdc-a31e-4b65-b497-5addbb533d1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:19.353040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f18eacdc-a31e-4b65-b497-5addbb533d1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:19.382437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f18eacdc-a31e-4b65-b497-5addbb533d1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Aug 06 12:40:19.383078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 522/1196] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:19 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:19.431357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d1a465bd-467f-41a2-91b4-07594f60dd47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:19.433558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d1a465bd-467f-41a2-91b4-07594f60dd47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:19.439421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1a465bd-467f-41a2-91b4-07594f60dd47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:19.439896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1a465bd-467f-41a2-91b4-07594f60dd47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:19.440354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1a465bd-467f-41a2-91b4-07594f60dd47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:19.441036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1a465bd-467f-41a2-91b4-07594f60dd47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:19.441480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1a465bd-467f-41a2-91b4-07594f60dd47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:19.441897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1a465bd-467f-41a2-91b4-07594f60dd47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:19.471907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d1a465bd-467f-41a2-91b4-07594f60dd47 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044690 Aug 06 12:40:19.472681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 675/1197] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:20.216883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-980179bf-a9e8-49e9-919a-1a1d65d5fe0a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:20.217477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-980179bf-a9e8-49e9-919a-1a1d65d5fe0a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:20.224763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-980179bf-a9e8-49e9-919a-1a1d65d5fe0a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:20.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-980179bf-a9e8-49e9-919a-1a1d65d5fe0a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:20.225661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-980179bf-a9e8-49e9-919a-1a1d65d5fe0a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:20.226341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-980179bf-a9e8-49e9-919a-1a1d65d5fe0a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:20.226782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-980179bf-a9e8-49e9-919a-1a1d65d5fe0a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:20.227193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-980179bf-a9e8-49e9-919a-1a1d65d5fe0a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:20.287761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-980179bf-a9e8-49e9-919a-1a1d65d5fe0a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:20.295216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-980179bf-a9e8-49e9-919a-1a1d65d5fe0a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082162 Aug 06 12:40:20.295770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 523/1198] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:20 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:20.395688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-92fba15a-591a-4789-a0f2-340640777c35 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:20.397910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-92fba15a-591a-4789-a0f2-340640777c35 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:20.404251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fba15a-591a-4789-a0f2-340640777c35 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:20.404752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fba15a-591a-4789-a0f2-340640777c35 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:20.405179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fba15a-591a-4789-a0f2-340640777c35 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:20.405849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fba15a-591a-4789-a0f2-340640777c35 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:20.406297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fba15a-591a-4789-a0f2-340640777c35 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:20.406729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92fba15a-591a-4789-a0f2-340640777c35 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:20.434304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-92fba15a-591a-4789-a0f2-340640777c35 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 Aug 06 12:40:20.434885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 676/1199] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:20 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:20.484624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3791e5c4-96b8-4435-a46f-40303ba5839d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:20.486835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3791e5c4-96b8-4435-a46f-40303ba5839d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:20.492763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3791e5c4-96b8-4435-a46f-40303ba5839d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:20.493236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3791e5c4-96b8-4435-a46f-40303ba5839d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:20.493662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3791e5c4-96b8-4435-a46f-40303ba5839d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:20.494339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3791e5c4-96b8-4435-a46f-40303ba5839d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:20.494782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3791e5c4-96b8-4435-a46f-40303ba5839d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:20.495195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3791e5c4-96b8-4435-a46f-40303ba5839d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:20.525536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3791e5c4-96b8-4435-a46f-40303ba5839d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045108 Aug 06 12:40:20.526183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 524/1200] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:21.043825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:40:21.043994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:40:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:40:21.315680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9ae4471d-5be7-4ac1-95fc-5d9024216f2a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:21.316191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9ae4471d-5be7-4ac1-95fc-5d9024216f2a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:21.322022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ae4471d-5be7-4ac1-95fc-5d9024216f2a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:21.322492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ae4471d-5be7-4ac1-95fc-5d9024216f2a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:21.322916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ae4471d-5be7-4ac1-95fc-5d9024216f2a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:21.323587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ae4471d-5be7-4ac1-95fc-5d9024216f2a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:21.324033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ae4471d-5be7-4ac1-95fc-5d9024216f2a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:21.324547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ae4471d-5be7-4ac1-95fc-5d9024216f2a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:21.384117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9ae4471d-5be7-4ac1-95fc-5d9024216f2a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:21.391448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9ae4471d-5be7-4ac1-95fc-5d9024216f2a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.079723 Aug 06 12:40:21.391995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 677/1201] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:21 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:21.446607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f70613f2-cc0d-457b-ad93-a6fdf277f5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:21.448776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f70613f2-cc0d-457b-ad93-a6fdf277f5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:21.455720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f70613f2-cc0d-457b-ad93-a6fdf277f5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:21.456191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f70613f2-cc0d-457b-ad93-a6fdf277f5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:21.456642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f70613f2-cc0d-457b-ad93-a6fdf277f5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:21.457314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f70613f2-cc0d-457b-ad93-a6fdf277f5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:21.457756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f70613f2-cc0d-457b-ad93-a6fdf277f5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:21.458178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f70613f2-cc0d-457b-ad93-a6fdf277f5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:21.488290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f70613f2-cc0d-457b-ad93-a6fdf277f5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Aug 06 12:40:21.488857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 525/1202] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:21 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:21.538544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-07fc1acf-4bea-487c-8e9c-2861fdc71a0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:21.540723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-07fc1acf-4bea-487c-8e9c-2861fdc71a0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:21.547036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07fc1acf-4bea-487c-8e9c-2861fdc71a0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:21.547842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07fc1acf-4bea-487c-8e9c-2861fdc71a0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:21.548294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07fc1acf-4bea-487c-8e9c-2861fdc71a0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:21.549004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07fc1acf-4bea-487c-8e9c-2861fdc71a0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:21.549461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07fc1acf-4bea-487c-8e9c-2861fdc71a0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:21.549915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07fc1acf-4bea-487c-8e9c-2861fdc71a0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:21.577848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-07fc1acf-4bea-487c-8e9c-2861fdc71a0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043241 Aug 06 12:40:21.578847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 678/1203] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:21 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:22.412597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4ffa15e-e717-44bf-bd09-26f08028454a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:22.413176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d4ffa15e-e717-44bf-bd09-26f08028454a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:22.419339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ffa15e-e717-44bf-bd09-26f08028454a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:22.419816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ffa15e-e717-44bf-bd09-26f08028454a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:22.420240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ffa15e-e717-44bf-bd09-26f08028454a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:22.420947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ffa15e-e717-44bf-bd09-26f08028454a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:22.421406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ffa15e-e717-44bf-bd09-26f08028454a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:22.421814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4ffa15e-e717-44bf-bd09-26f08028454a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:22.481839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d4ffa15e-e717-44bf-bd09-26f08028454a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:22.489520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d4ffa15e-e717-44bf-bd09-26f08028454a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080925 Aug 06 12:40:22.490073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 526/1204] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:22 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:22.500179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-60ccb078-22ed-474e-8659-4b23427be828 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:22.502339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-60ccb078-22ed-474e-8659-4b23427be828 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:22.508264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60ccb078-22ed-474e-8659-4b23427be828 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:22.508784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60ccb078-22ed-474e-8659-4b23427be828 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:22.509218 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60ccb078-22ed-474e-8659-4b23427be828 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:22.509902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60ccb078-22ed-474e-8659-4b23427be828 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:22.510422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60ccb078-22ed-474e-8659-4b23427be828 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:22.510845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60ccb078-22ed-474e-8659-4b23427be828 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:22.540563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-60ccb078-22ed-474e-8659-4b23427be828 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Aug 06 12:40:22.541492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 679/1205] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:22 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:22.590681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f01e0011-ebf0-4824-841c-e74d183e662f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:22.592890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f01e0011-ebf0-4824-841c-e74d183e662f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:22.598790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f01e0011-ebf0-4824-841c-e74d183e662f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:22.599273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f01e0011-ebf0-4824-841c-e74d183e662f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:22.599701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f01e0011-ebf0-4824-841c-e74d183e662f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:22.600409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f01e0011-ebf0-4824-841c-e74d183e662f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:22.600865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f01e0011-ebf0-4824-841c-e74d183e662f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:22.601283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f01e0011-ebf0-4824-841c-e74d183e662f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:22.631163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f01e0011-ebf0-4824-841c-e74d183e662f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044387 Aug 06 12:40:22.631712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 527/1206] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:22.714345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3f77e308-34b0-40e5-9672-9668888e3ff0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:22.714830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3f77e308-34b0-40e5-9672-9668888e3ff0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:22.721585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f77e308-34b0-40e5-9672-9668888e3ff0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:22.722063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f77e308-34b0-40e5-9672-9668888e3ff0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:22.722488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f77e308-34b0-40e5-9672-9668888e3ff0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:22.723183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f77e308-34b0-40e5-9672-9668888e3ff0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:22.723627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f77e308-34b0-40e5-9672-9668888e3ff0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:22.724049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f77e308-34b0-40e5-9672-9668888e3ff0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:23.509662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bfd8dce5-1952-4fb2-b05c-b8b76ad2140c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:23.510258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bfd8dce5-1952-4fb2-b05c-b8b76ad2140c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:23.516568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfd8dce5-1952-4fb2-b05c-b8b76ad2140c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:23.517038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfd8dce5-1952-4fb2-b05c-b8b76ad2140c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:23.517461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfd8dce5-1952-4fb2-b05c-b8b76ad2140c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:23.518133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfd8dce5-1952-4fb2-b05c-b8b76ad2140c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:23.518575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfd8dce5-1952-4fb2-b05c-b8b76ad2140c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:23.518988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfd8dce5-1952-4fb2-b05c-b8b76ad2140c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:23.579137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bfd8dce5-1952-4fb2-b05c-b8b76ad2140c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:23.586455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bfd8dce5-1952-4fb2-b05c-b8b76ad2140c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080702 Aug 06 12:40:23.586998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 528/1207] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:23 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:23.591383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4673ba1e-90d6-4078-8717-3661c9c90c73 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:23.593469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4673ba1e-90d6-4078-8717-3661c9c90c73 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:23.599355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4673ba1e-90d6-4078-8717-3661c9c90c73 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:23.599827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4673ba1e-90d6-4078-8717-3661c9c90c73 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:23.600248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4673ba1e-90d6-4078-8717-3661c9c90c73 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:23.600962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4673ba1e-90d6-4078-8717-3661c9c90c73 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:23.601410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4673ba1e-90d6-4078-8717-3661c9c90c73 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:23.601823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4673ba1e-90d6-4078-8717-3661c9c90c73 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:23.630170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4673ba1e-90d6-4078-8717-3661c9c90c73 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042186 Aug 06 12:40:23.630707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 529/1208] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:23.642394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ecd3365b-108e-4666-9743-d12582234f27 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:23.644456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ecd3365b-108e-4666-9743-d12582234f27 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:23.649994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ecd3365b-108e-4666-9743-d12582234f27 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:23.650463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ecd3365b-108e-4666-9743-d12582234f27 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:23.650885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ecd3365b-108e-4666-9743-d12582234f27 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:23.651551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ecd3365b-108e-4666-9743-d12582234f27 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:23.651992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ecd3365b-108e-4666-9743-d12582234f27 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:23.652432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ecd3365b-108e-4666-9743-d12582234f27 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:23.681947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ecd3365b-108e-4666-9743-d12582234f27 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043078 Aug 06 12:40:23.682474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 530/1209] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:40:24.607623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5f2c602b-34c0-478a-8aa9-d82c2540e200 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:24.608319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5f2c602b-34c0-478a-8aa9-d82c2540e200 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:24.614581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f2c602b-34c0-478a-8aa9-d82c2540e200 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:24.615060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f2c602b-34c0-478a-8aa9-d82c2540e200 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:24.615486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f2c602b-34c0-478a-8aa9-d82c2540e200 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:24.616245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f2c602b-34c0-478a-8aa9-d82c2540e200 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:24.616718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f2c602b-34c0-478a-8aa9-d82c2540e200 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:24.617175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f2c602b-34c0-478a-8aa9-d82c2540e200 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:24.680407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5f2c602b-34c0-478a-8aa9-d82c2540e200 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:24.687747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5f2c602b-34c0-478a-8aa9-d82c2540e200 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084235 Aug 06 12:40:24.688317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 531/1210] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:24 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:24.692702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6bafc04b-dc4b-4330-a5b4-4bd230608c62 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:24.694777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6bafc04b-dc4b-4330-a5b4-4bd230608c62 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:24.700252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bafc04b-dc4b-4330-a5b4-4bd230608c62 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:24.700753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bafc04b-dc4b-4330-a5b4-4bd230608c62 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:24.701182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bafc04b-dc4b-4330-a5b4-4bd230608c62 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:24.701857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bafc04b-dc4b-4330-a5b4-4bd230608c62 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:24.702302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bafc04b-dc4b-4330-a5b4-4bd230608c62 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:24.702715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bafc04b-dc4b-4330-a5b4-4bd230608c62 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:24.731163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6bafc04b-dc4b-4330-a5b4-4bd230608c62 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 Aug 06 12:40:24.731698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 532/1211] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:24.736384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-62c92f89-1dbc-4124-a950-096827ae5844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:24.738412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-62c92f89-1dbc-4124-a950-096827ae5844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:24.743721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62c92f89-1dbc-4124-a950-096827ae5844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:24.744192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62c92f89-1dbc-4124-a950-096827ae5844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:24.744652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62c92f89-1dbc-4124-a950-096827ae5844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:24.745321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62c92f89-1dbc-4124-a950-096827ae5844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:24.745768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62c92f89-1dbc-4124-a950-096827ae5844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:24.746186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62c92f89-1dbc-4124-a950-096827ae5844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:24.774846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-62c92f89-1dbc-4124-a950-096827ae5844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041858 Aug 06 12:40:24.775399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 533/1212] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:25.707087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-231ca468-c643-4095-ba2a-d1a6784c29e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:25.707741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-231ca468-c643-4095-ba2a-d1a6784c29e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:25.714223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-231ca468-c643-4095-ba2a-d1a6784c29e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:25.714702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-231ca468-c643-4095-ba2a-d1a6784c29e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:25.715156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-231ca468-c643-4095-ba2a-d1a6784c29e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:25.715896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-231ca468-c643-4095-ba2a-d1a6784c29e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:25.716393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-231ca468-c643-4095-ba2a-d1a6784c29e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:25.716819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-231ca468-c643-4095-ba2a-d1a6784c29e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:25.779145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-231ca468-c643-4095-ba2a-d1a6784c29e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:25.787229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-231ca468-c643-4095-ba2a-d1a6784c29e9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084087 Aug 06 12:40:25.787786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 534/1213] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:25 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:25.792254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ec8f4812-a98c-4108-a5d7-45f0ee5dc4c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:25.794368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ec8f4812-a98c-4108-a5d7-45f0ee5dc4c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:25.800757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec8f4812-a98c-4108-a5d7-45f0ee5dc4c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:25.801268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec8f4812-a98c-4108-a5d7-45f0ee5dc4c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:25.801719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec8f4812-a98c-4108-a5d7-45f0ee5dc4c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:25.802402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec8f4812-a98c-4108-a5d7-45f0ee5dc4c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:25.802855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec8f4812-a98c-4108-a5d7-45f0ee5dc4c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:25.803276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec8f4812-a98c-4108-a5d7-45f0ee5dc4c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:25.835448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ec8f4812-a98c-4108-a5d7-45f0ee5dc4c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046672 Aug 06 12:40:25.835991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 535/1214] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:25 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:25.840493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1812bffc-31db-46aa-bbab-41ad798fc689 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:25.842535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1812bffc-31db-46aa-bbab-41ad798fc689 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:25.848642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1812bffc-31db-46aa-bbab-41ad798fc689 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:25.849121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1812bffc-31db-46aa-bbab-41ad798fc689 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:25.849551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1812bffc-31db-46aa-bbab-41ad798fc689 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:25.850226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1812bffc-31db-46aa-bbab-41ad798fc689 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:25.850673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1812bffc-31db-46aa-bbab-41ad798fc689 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:25.851092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1812bffc-31db-46aa-bbab-41ad798fc689 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:25.868357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:25.897651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1812bffc-31db-46aa-bbab-41ad798fc689 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060615 Aug 06 12:40:25.898221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 536/1215] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:26.807962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac64cdc8-7146-4878-b72a-ba2d21a1f16a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:26.808605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac64cdc8-7146-4878-b72a-ba2d21a1f16a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:26.814917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac64cdc8-7146-4878-b72a-ba2d21a1f16a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:26.815385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac64cdc8-7146-4878-b72a-ba2d21a1f16a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:26.815814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac64cdc8-7146-4878-b72a-ba2d21a1f16a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:26.816516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac64cdc8-7146-4878-b72a-ba2d21a1f16a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:26.816965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac64cdc8-7146-4878-b72a-ba2d21a1f16a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:26.817381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac64cdc8-7146-4878-b72a-ba2d21a1f16a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:26.877880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ac64cdc8-7146-4878-b72a-ba2d21a1f16a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:26.885256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac64cdc8-7146-4878-b72a-ba2d21a1f16a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081100 Aug 06 12:40:26.885803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 537/1216] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:26 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:40:26.890291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6f5d7be6-e3d7-4ede-81ef-906cbf111d7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:26.892918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6f5d7be6-e3d7-4ede-81ef-906cbf111d7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:26.898665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f5d7be6-e3d7-4ede-81ef-906cbf111d7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:26.899204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f5d7be6-e3d7-4ede-81ef-906cbf111d7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:26.899635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f5d7be6-e3d7-4ede-81ef-906cbf111d7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:26.900335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f5d7be6-e3d7-4ede-81ef-906cbf111d7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:26.900777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f5d7be6-e3d7-4ede-81ef-906cbf111d7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:26.901189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f5d7be6-e3d7-4ede-81ef-906cbf111d7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:26.929448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6f5d7be6-e3d7-4ede-81ef-906cbf111d7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 Aug 06 12:40:26.929985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 538/1217] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:26.934737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0874541a-8f2a-49c2-97ce-7fb4c402c9be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:26.937178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0874541a-8f2a-49c2-97ce-7fb4c402c9be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:26.942842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0874541a-8f2a-49c2-97ce-7fb4c402c9be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:26.943316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0874541a-8f2a-49c2-97ce-7fb4c402c9be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:26.943744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0874541a-8f2a-49c2-97ce-7fb4c402c9be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:26.944453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0874541a-8f2a-49c2-97ce-7fb4c402c9be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:26.944910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0874541a-8f2a-49c2-97ce-7fb4c402c9be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:26.945355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0874541a-8f2a-49c2-97ce-7fb4c402c9be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:26.975642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0874541a-8f2a-49c2-97ce-7fb4c402c9be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044686 Aug 06 12:40:26.976195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 539/1218] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:27.908665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1896f6cc-ec3b-4dfa-851b-eae046a2ffb5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:27.909338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1896f6cc-ec3b-4dfa-851b-eae046a2ffb5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:27.915515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1896f6cc-ec3b-4dfa-851b-eae046a2ffb5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:27.915984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1896f6cc-ec3b-4dfa-851b-eae046a2ffb5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:27.916439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1896f6cc-ec3b-4dfa-851b-eae046a2ffb5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:27.917109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1896f6cc-ec3b-4dfa-851b-eae046a2ffb5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:27.917550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1896f6cc-ec3b-4dfa-851b-eae046a2ffb5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:27.917963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1896f6cc-ec3b-4dfa-851b-eae046a2ffb5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:27.977397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1896f6cc-ec3b-4dfa-851b-eae046a2ffb5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:27.984917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1896f6cc-ec3b-4dfa-851b-eae046a2ffb5 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080585 Aug 06 12:40:27.985459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 540/1219] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:27 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:27.990444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4adf2edf-0392-4fa5-9a39-0b7f907f7ec1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:27.992957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4adf2edf-0392-4fa5-9a39-0b7f907f7ec1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:27.998936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4adf2edf-0392-4fa5-9a39-0b7f907f7ec1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:27.999408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4adf2edf-0392-4fa5-9a39-0b7f907f7ec1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:28.000230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4adf2edf-0392-4fa5-9a39-0b7f907f7ec1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:28.000525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4adf2edf-0392-4fa5-9a39-0b7f907f7ec1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:28.000967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4adf2edf-0392-4fa5-9a39-0b7f907f7ec1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:28.001377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4adf2edf-0392-4fa5-9a39-0b7f907f7ec1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:28.029322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4adf2edf-0392-4fa5-9a39-0b7f907f7ec1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 Aug 06 12:40:28.029861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 541/1220] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:27 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:28.034730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c790c3f-44d4-427a-8d02-3ccd6cce27b4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:28.036797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c790c3f-44d4-427a-8d02-3ccd6cce27b4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:28.042263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c790c3f-44d4-427a-8d02-3ccd6cce27b4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:28.042737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c790c3f-44d4-427a-8d02-3ccd6cce27b4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:28.043163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c790c3f-44d4-427a-8d02-3ccd6cce27b4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:28.043837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c790c3f-44d4-427a-8d02-3ccd6cce27b4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:28.044282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c790c3f-44d4-427a-8d02-3ccd6cce27b4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:28.044724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c790c3f-44d4-427a-8d02-3ccd6cce27b4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:28.072555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c790c3f-44d4-427a-8d02-3ccd6cce27b4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041696 Aug 06 12:40:28.073088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 542/1221] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:29.005986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6b900d12-ce81-4365-afd4-9642604d4b81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:29.006723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6b900d12-ce81-4365-afd4-9642604d4b81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:29.012992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b900d12-ce81-4365-afd4-9642604d4b81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:29.013406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b900d12-ce81-4365-afd4-9642604d4b81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:29.013824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b900d12-ce81-4365-afd4-9642604d4b81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:29.014507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b900d12-ce81-4365-afd4-9642604d4b81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:29.014950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b900d12-ce81-4365-afd4-9642604d4b81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:29.015365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b900d12-ce81-4365-afd4-9642604d4b81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:29.077673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6b900d12-ce81-4365-afd4-9642604d4b81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:29.085600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6b900d12-ce81-4365-afd4-9642604d4b81 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083449 Aug 06 12:40:29.086152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 543/1222] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:29 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:29.090568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eaf26311-aab6-4883-aef6-62a4f7fe0feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:29.092701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eaf26311-aab6-4883-aef6-62a4f7fe0feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:29.098707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf26311-aab6-4883-aef6-62a4f7fe0feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:29.099184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf26311-aab6-4883-aef6-62a4f7fe0feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:29.099613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf26311-aab6-4883-aef6-62a4f7fe0feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:29.100294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf26311-aab6-4883-aef6-62a4f7fe0feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:29.100774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf26311-aab6-4883-aef6-62a4f7fe0feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:29.101191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf26311-aab6-4883-aef6-62a4f7fe0feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:29.128733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eaf26311-aab6-4883-aef6-62a4f7fe0feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041573 Aug 06 12:40:29.129275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 544/1223] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:29 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:29.133643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-455908db-c6f4-4bb2-a33d-681ed0f8bad9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:29.136193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-455908db-c6f4-4bb2-a33d-681ed0f8bad9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:29.141550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455908db-c6f4-4bb2-a33d-681ed0f8bad9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:29.142073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455908db-c6f4-4bb2-a33d-681ed0f8bad9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:29.142468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455908db-c6f4-4bb2-a33d-681ed0f8bad9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:29.143708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455908db-c6f4-4bb2-a33d-681ed0f8bad9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:29.144125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455908db-c6f4-4bb2-a33d-681ed0f8bad9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:29.144569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455908db-c6f4-4bb2-a33d-681ed0f8bad9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:29.173133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-455908db-c6f4-4bb2-a33d-681ed0f8bad9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042876 Aug 06 12:40:29.173683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 545/1224] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:30.106480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c0c3648-0f44-4d44-92c0-b26ba5c80481 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:30.107330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c0c3648-0f44-4d44-92c0-b26ba5c80481 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:30.114485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0c3648-0f44-4d44-92c0-b26ba5c80481 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:30.114962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0c3648-0f44-4d44-92c0-b26ba5c80481 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:30.115403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0c3648-0f44-4d44-92c0-b26ba5c80481 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:30.116085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0c3648-0f44-4d44-92c0-b26ba5c80481 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:30.116564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0c3648-0f44-4d44-92c0-b26ba5c80481 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:30.116988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0c3648-0f44-4d44-92c0-b26ba5c80481 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:30.196059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4c0c3648-0f44-4d44-92c0-b26ba5c80481 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:30.203500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c0c3648-0f44-4d44-92c0-b26ba5c80481 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.100990 Aug 06 12:40:30.204051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 546/1225] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:30 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:30.208642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8fa35624-4a8c-4033-be6f-4ba5a6d63e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:30.210791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8fa35624-4a8c-4033-be6f-4ba5a6d63e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:30.216372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8fa35624-4a8c-4033-be6f-4ba5a6d63e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:30.216847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8fa35624-4a8c-4033-be6f-4ba5a6d63e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:30.217276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8fa35624-4a8c-4033-be6f-4ba5a6d63e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:30.217989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8fa35624-4a8c-4033-be6f-4ba5a6d63e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:30.218438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8fa35624-4a8c-4033-be6f-4ba5a6d63e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:30.218854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8fa35624-4a8c-4033-be6f-4ba5a6d63e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:30.247572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8fa35624-4a8c-4033-be6f-4ba5a6d63e70 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042526 Aug 06 12:40:30.248110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 547/1226] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:30 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:30.252743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-599cc7d9-c202-4c75-8027-4022e2d47b9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:30.254692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-599cc7d9-c202-4c75-8027-4022e2d47b9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:30.260015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599cc7d9-c202-4c75-8027-4022e2d47b9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:30.260528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599cc7d9-c202-4c75-8027-4022e2d47b9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:30.260960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599cc7d9-c202-4c75-8027-4022e2d47b9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:30.261632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599cc7d9-c202-4c75-8027-4022e2d47b9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:30.262081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599cc7d9-c202-4c75-8027-4022e2d47b9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:30.262500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599cc7d9-c202-4c75-8027-4022e2d47b9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:30.291577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-599cc7d9-c202-4c75-8027-4022e2d47b9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042392 Aug 06 12:40:30.292118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 548/1227] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:31.228018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e88b8e7f-bd9c-4f1c-bdc5-6b56b9569453 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:31.228682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e88b8e7f-bd9c-4f1c-bdc5-6b56b9569453 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:31.235239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e88b8e7f-bd9c-4f1c-bdc5-6b56b9569453 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:31.235713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e88b8e7f-bd9c-4f1c-bdc5-6b56b9569453 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:31.236142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e88b8e7f-bd9c-4f1c-bdc5-6b56b9569453 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:31.236854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e88b8e7f-bd9c-4f1c-bdc5-6b56b9569453 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:31.237301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e88b8e7f-bd9c-4f1c-bdc5-6b56b9569453 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:31.237718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e88b8e7f-bd9c-4f1c-bdc5-6b56b9569453 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:31.297671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e88b8e7f-bd9c-4f1c-bdc5-6b56b9569453 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:31.305769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e88b8e7f-bd9c-4f1c-bdc5-6b56b9569453 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081506 Aug 06 12:40:31.306324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 549/1228] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:31 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:31.310869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ad2f6e99-d3f2-47c3-a83e-9b2ebcaa4aa7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:31.312960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ad2f6e99-d3f2-47c3-a83e-9b2ebcaa4aa7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:31.318528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ad2f6e99-d3f2-47c3-a83e-9b2ebcaa4aa7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:31.319015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ad2f6e99-d3f2-47c3-a83e-9b2ebcaa4aa7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:31.319448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ad2f6e99-d3f2-47c3-a83e-9b2ebcaa4aa7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:31.320132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ad2f6e99-d3f2-47c3-a83e-9b2ebcaa4aa7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:31.320622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ad2f6e99-d3f2-47c3-a83e-9b2ebcaa4aa7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:31.321044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ad2f6e99-d3f2-47c3-a83e-9b2ebcaa4aa7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:31.350086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ad2f6e99-d3f2-47c3-a83e-9b2ebcaa4aa7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042789 Aug 06 12:40:31.350633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 550/1229] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:31 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:31.355032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f1433ccb-36e1-4e1e-a741-5c46d29fe218 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:31.357344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f1433ccb-36e1-4e1e-a741-5c46d29fe218 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:31.362745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1433ccb-36e1-4e1e-a741-5c46d29fe218 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:31.363247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1433ccb-36e1-4e1e-a741-5c46d29fe218 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:31.363675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1433ccb-36e1-4e1e-a741-5c46d29fe218 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:31.364379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1433ccb-36e1-4e1e-a741-5c46d29fe218 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:31.364832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1433ccb-36e1-4e1e-a741-5c46d29fe218 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:31.365251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1433ccb-36e1-4e1e-a741-5c46d29fe218 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:31.393446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f1433ccb-36e1-4e1e-a741-5c46d29fe218 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041276 Aug 06 12:40:31.393951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 551/1230] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:32.326037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-96c1d41c-b5bc-47b8-91f0-61dcca247814 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:32.326696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-96c1d41c-b5bc-47b8-91f0-61dcca247814 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:32.333822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96c1d41c-b5bc-47b8-91f0-61dcca247814 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:32.334324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96c1d41c-b5bc-47b8-91f0-61dcca247814 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:32.334750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96c1d41c-b5bc-47b8-91f0-61dcca247814 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:32.335454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96c1d41c-b5bc-47b8-91f0-61dcca247814 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:32.335898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96c1d41c-b5bc-47b8-91f0-61dcca247814 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:32.336326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96c1d41c-b5bc-47b8-91f0-61dcca247814 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:32.396728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-96c1d41c-b5bc-47b8-91f0-61dcca247814 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:32.404112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-96c1d41c-b5bc-47b8-91f0-61dcca247814 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082080 Aug 06 12:40:32.404690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 552/1231] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:32 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:32.409126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fe6f2abc-9502-472a-8324-ea1482120279 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:32.411181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fe6f2abc-9502-472a-8324-ea1482120279 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:32.417389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6f2abc-9502-472a-8324-ea1482120279 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:32.417932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6f2abc-9502-472a-8324-ea1482120279 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:32.418361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6f2abc-9502-472a-8324-ea1482120279 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:32.419033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6f2abc-9502-472a-8324-ea1482120279 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:32.419515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6f2abc-9502-472a-8324-ea1482120279 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:32.420184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6f2abc-9502-472a-8324-ea1482120279 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:32.423898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:32.448962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fe6f2abc-9502-472a-8324-ea1482120279 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043290 Aug 06 12:40:32.449494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 553/1232] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:32.453813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-17885bbe-a9d9-4937-bb7e-f4281595066f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:32.456490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-17885bbe-a9d9-4937-bb7e-f4281595066f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:32.461986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17885bbe-a9d9-4937-bb7e-f4281595066f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:32.462463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17885bbe-a9d9-4937-bb7e-f4281595066f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:32.462914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17885bbe-a9d9-4937-bb7e-f4281595066f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:32.463583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17885bbe-a9d9-4937-bb7e-f4281595066f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:32.464025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17885bbe-a9d9-4937-bb7e-f4281595066f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:32.464477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17885bbe-a9d9-4937-bb7e-f4281595066f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:32.491538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-17885bbe-a9d9-4937-bb7e-f4281595066f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041121 Aug 06 12:40:32.492069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 554/1233] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:32.719396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=83 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:32.742436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=44 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:33.425400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7a1e213a-2eeb-4e6f-aee2-b5a8ec45020f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:33.425991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7a1e213a-2eeb-4e6f-aee2-b5a8ec45020f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:33.432244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a1e213a-2eeb-4e6f-aee2-b5a8ec45020f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:33.432740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a1e213a-2eeb-4e6f-aee2-b5a8ec45020f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:33.433163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a1e213a-2eeb-4e6f-aee2-b5a8ec45020f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:33.433830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a1e213a-2eeb-4e6f-aee2-b5a8ec45020f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:33.434272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a1e213a-2eeb-4e6f-aee2-b5a8ec45020f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:33.434685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a1e213a-2eeb-4e6f-aee2-b5a8ec45020f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:33.498275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7a1e213a-2eeb-4e6f-aee2-b5a8ec45020f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:33.506322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7a1e213a-2eeb-4e6f-aee2-b5a8ec45020f tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085207 Aug 06 12:40:33.506870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 555/1234] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:33 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:33.511237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-952f2ecb-afb2-487b-abac-a693d715801b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:33.513317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-952f2ecb-afb2-487b-abac-a693d715801b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:33.519313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952f2ecb-afb2-487b-abac-a693d715801b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:33.519778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952f2ecb-afb2-487b-abac-a693d715801b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:33.520200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952f2ecb-afb2-487b-abac-a693d715801b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:33.520901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952f2ecb-afb2-487b-abac-a693d715801b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:33.521344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952f2ecb-afb2-487b-abac-a693d715801b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:33.521753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952f2ecb-afb2-487b-abac-a693d715801b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:33.549875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-952f2ecb-afb2-487b-abac-a693d715801b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042042 Aug 06 12:40:33.550403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 556/1235] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:33.554691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4efd2e9a-0ddb-4fb2-ac3c-aaa9812e62f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:33.556706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4efd2e9a-0ddb-4fb2-ac3c-aaa9812e62f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:33.561935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4efd2e9a-0ddb-4fb2-ac3c-aaa9812e62f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:33.562399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4efd2e9a-0ddb-4fb2-ac3c-aaa9812e62f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:33.562821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4efd2e9a-0ddb-4fb2-ac3c-aaa9812e62f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:33.563482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4efd2e9a-0ddb-4fb2-ac3c-aaa9812e62f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:33.563921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4efd2e9a-0ddb-4fb2-ac3c-aaa9812e62f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:33.564356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4efd2e9a-0ddb-4fb2-ac3c-aaa9812e62f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:33.592809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4efd2e9a-0ddb-4fb2-ac3c-aaa9812e62f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041467 Aug 06 12:40:33.593336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 557/1236] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:34.526856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-840c6d82-0fd7-47a8-bc32-54c7708651e6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:34.527540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-840c6d82-0fd7-47a8-bc32-54c7708651e6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:34.533771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-840c6d82-0fd7-47a8-bc32-54c7708651e6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:34.534245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-840c6d82-0fd7-47a8-bc32-54c7708651e6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:34.534676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-840c6d82-0fd7-47a8-bc32-54c7708651e6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:34.535380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-840c6d82-0fd7-47a8-bc32-54c7708651e6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:34.535828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-840c6d82-0fd7-47a8-bc32-54c7708651e6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:34.536242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-840c6d82-0fd7-47a8-bc32-54c7708651e6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:34.595558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-840c6d82-0fd7-47a8-bc32-54c7708651e6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:34.602897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-840c6d82-0fd7-47a8-bc32-54c7708651e6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.079871 Aug 06 12:40:34.603443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 558/1237] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:34 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:34.608100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e6df4d90-c55f-47b0-ac26-ff9ef05c1b93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:34.610185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e6df4d90-c55f-47b0-ac26-ff9ef05c1b93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:34.615629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6df4d90-c55f-47b0-ac26-ff9ef05c1b93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:34.616107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6df4d90-c55f-47b0-ac26-ff9ef05c1b93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:34.616566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6df4d90-c55f-47b0-ac26-ff9ef05c1b93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:34.617244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6df4d90-c55f-47b0-ac26-ff9ef05c1b93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:34.617747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6df4d90-c55f-47b0-ac26-ff9ef05c1b93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:34.618169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6df4d90-c55f-47b0-ac26-ff9ef05c1b93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:34.647598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e6df4d90-c55f-47b0-ac26-ff9ef05c1b93 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043191 Aug 06 12:40:34.648132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 559/1238] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:34 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:34.652589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-760f2d6b-e7b5-40cf-9207-b81a5cf61e24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:34.654630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-760f2d6b-e7b5-40cf-9207-b81a5cf61e24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:34.660058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-760f2d6b-e7b5-40cf-9207-b81a5cf61e24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:34.660549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-760f2d6b-e7b5-40cf-9207-b81a5cf61e24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:34.660979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-760f2d6b-e7b5-40cf-9207-b81a5cf61e24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:34.661649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-760f2d6b-e7b5-40cf-9207-b81a5cf61e24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:34.662109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-760f2d6b-e7b5-40cf-9207-b81a5cf61e24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:34.662533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-760f2d6b-e7b5-40cf-9207-b81a5cf61e24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:34.689440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-760f2d6b-e7b5-40cf-9207-b81a5cf61e24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040306 Aug 06 12:40:34.690507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 560/1239] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:35.623304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6991c2f1-e0ae-4b3d-a3ad-9c6921c866bb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:35.623886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6991c2f1-e0ae-4b3d-a3ad-9c6921c866bb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:35.630141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6991c2f1-e0ae-4b3d-a3ad-9c6921c866bb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:35.630616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6991c2f1-e0ae-4b3d-a3ad-9c6921c866bb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:35.631047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6991c2f1-e0ae-4b3d-a3ad-9c6921c866bb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:35.631723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6991c2f1-e0ae-4b3d-a3ad-9c6921c866bb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:35.632170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6991c2f1-e0ae-4b3d-a3ad-9c6921c866bb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:35.632618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6991c2f1-e0ae-4b3d-a3ad-9c6921c866bb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:35.691811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6991c2f1-e0ae-4b3d-a3ad-9c6921c866bb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:35.699216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6991c2f1-e0ae-4b3d-a3ad-9c6921c866bb tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.079774 Aug 06 12:40:35.699765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 561/1240] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:35 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:35.704149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f07fa4c0-48ab-4763-b610-fcbeecf025eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:35.706735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f07fa4c0-48ab-4763-b610-fcbeecf025eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:35.712208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f07fa4c0-48ab-4763-b610-fcbeecf025eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:35.712704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f07fa4c0-48ab-4763-b610-fcbeecf025eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:35.713134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f07fa4c0-48ab-4763-b610-fcbeecf025eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:35.713807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f07fa4c0-48ab-4763-b610-fcbeecf025eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:35.714251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f07fa4c0-48ab-4763-b610-fcbeecf025eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:35.714671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f07fa4c0-48ab-4763-b610-fcbeecf025eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:35.742997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f07fa4c0-48ab-4763-b610-fcbeecf025eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042275 Aug 06 12:40:35.743529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 562/1241] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:35 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:35.747841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bbbba561-57d8-497b-801b-c997a68c501e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:35.749900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bbbba561-57d8-497b-801b-c997a68c501e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:35.755181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbbba561-57d8-497b-801b-c997a68c501e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:35.755648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbbba561-57d8-497b-801b-c997a68c501e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:35.756076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbbba561-57d8-497b-801b-c997a68c501e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:35.756770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbbba561-57d8-497b-801b-c997a68c501e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:35.757214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbbba561-57d8-497b-801b-c997a68c501e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:35.757627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbbba561-57d8-497b-801b-c997a68c501e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:35.786009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bbbba561-57d8-497b-801b-c997a68c501e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041537 Aug 06 12:40:35.786543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 563/1242] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:36.719628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3054e0a9-e55c-41f0-8eaf-ca6b1de49182 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:36.720370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3054e0a9-e55c-41f0-8eaf-ca6b1de49182 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:36.722842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:36.728382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3054e0a9-e55c-41f0-8eaf-ca6b1de49182 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:36.728855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3054e0a9-e55c-41f0-8eaf-ca6b1de49182 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:36.729280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3054e0a9-e55c-41f0-8eaf-ca6b1de49182 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:36.729978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3054e0a9-e55c-41f0-8eaf-ca6b1de49182 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:36.730418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3054e0a9-e55c-41f0-8eaf-ca6b1de49182 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:36.730857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3054e0a9-e55c-41f0-8eaf-ca6b1de49182 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:36.792509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3054e0a9-e55c-41f0-8eaf-ca6b1de49182 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:36.801294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3054e0a9-e55c-41f0-8eaf-ca6b1de49182 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085433 Aug 06 12:40:36.801849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 564/1243] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:36 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:36.806415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8f7e5b50-c3fb-4aff-b0ce-32e5a208eb21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:36.808532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8f7e5b50-c3fb-4aff-b0ce-32e5a208eb21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:36.814577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f7e5b50-c3fb-4aff-b0ce-32e5a208eb21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:36.815052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f7e5b50-c3fb-4aff-b0ce-32e5a208eb21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:36.815479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f7e5b50-c3fb-4aff-b0ce-32e5a208eb21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:36.816169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f7e5b50-c3fb-4aff-b0ce-32e5a208eb21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:36.816620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f7e5b50-c3fb-4aff-b0ce-32e5a208eb21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:36.817035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f7e5b50-c3fb-4aff-b0ce-32e5a208eb21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:36.844608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8f7e5b50-c3fb-4aff-b0ce-32e5a208eb21 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041742 Aug 06 12:40:36.845151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 565/1244] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:36 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:36.850236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-25614f90-d9f0-485d-8b25-f7388156d96d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:36.852271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-25614f90-d9f0-485d-8b25-f7388156d96d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:36.857890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25614f90-d9f0-485d-8b25-f7388156d96d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:36.858352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25614f90-d9f0-485d-8b25-f7388156d96d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:36.858773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25614f90-d9f0-485d-8b25-f7388156d96d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:36.859433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25614f90-d9f0-485d-8b25-f7388156d96d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:36.859869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25614f90-d9f0-485d-8b25-f7388156d96d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:36.860277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25614f90-d9f0-485d-8b25-f7388156d96d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:36.889158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-25614f90-d9f0-485d-8b25-f7388156d96d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042507 Aug 06 12:40:36.889688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 566/1245] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:37.821411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bec3d05e-6319-4bc5-b8e7-03773ba58798 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:37.822581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bec3d05e-6319-4bc5-b8e7-03773ba58798 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:37.828918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec3d05e-6319-4bc5-b8e7-03773ba58798 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:37.829383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec3d05e-6319-4bc5-b8e7-03773ba58798 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:37.829804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec3d05e-6319-4bc5-b8e7-03773ba58798 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:37.831097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec3d05e-6319-4bc5-b8e7-03773ba58798 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:37.831539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec3d05e-6319-4bc5-b8e7-03773ba58798 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:37.831947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec3d05e-6319-4bc5-b8e7-03773ba58798 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:37.895258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bec3d05e-6319-4bc5-b8e7-03773ba58798 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:37.902957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bec3d05e-6319-4bc5-b8e7-03773ba58798 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085359 Aug 06 12:40:37.903504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 567/1246] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:37 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:37.907937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3411af0a-7102-436b-9124-9d2da6b495b7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:37.910032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3411af0a-7102-436b-9124-9d2da6b495b7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:37.915634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3411af0a-7102-436b-9124-9d2da6b495b7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:37.916108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3411af0a-7102-436b-9124-9d2da6b495b7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:37.916574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3411af0a-7102-436b-9124-9d2da6b495b7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:37.917254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3411af0a-7102-436b-9124-9d2da6b495b7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:37.917695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3411af0a-7102-436b-9124-9d2da6b495b7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:37.918138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3411af0a-7102-436b-9124-9d2da6b495b7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:37.946733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3411af0a-7102-436b-9124-9d2da6b495b7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042266 Aug 06 12:40:37.947263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 568/1247] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:37.951806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1377de56-ab23-4cd6-b61e-f9c57a6e3f1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:37.953836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1377de56-ab23-4cd6-b61e-f9c57a6e3f1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:37.959282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1377de56-ab23-4cd6-b61e-f9c57a6e3f1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:37.959755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1377de56-ab23-4cd6-b61e-f9c57a6e3f1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:37.960188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1377de56-ab23-4cd6-b61e-f9c57a6e3f1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:37.960904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1377de56-ab23-4cd6-b61e-f9c57a6e3f1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:37.961361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1377de56-ab23-4cd6-b61e-f9c57a6e3f1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:37.961778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1377de56-ab23-4cd6-b61e-f9c57a6e3f1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:37.985538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:37.990810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1377de56-ab23-4cd6-b61e-f9c57a6e3f1e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042557 Aug 06 12:40:37.991352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 569/1248] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:38.923134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4d995e64-dc14-47bf-9e55-764b926e70a2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:38.923795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4d995e64-dc14-47bf-9e55-764b926e70a2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:38.930383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d995e64-dc14-47bf-9e55-764b926e70a2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:38.930853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d995e64-dc14-47bf-9e55-764b926e70a2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:38.931279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d995e64-dc14-47bf-9e55-764b926e70a2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:38.931951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d995e64-dc14-47bf-9e55-764b926e70a2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:38.932422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d995e64-dc14-47bf-9e55-764b926e70a2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:38.932841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d995e64-dc14-47bf-9e55-764b926e70a2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:38.992243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4d995e64-dc14-47bf-9e55-764b926e70a2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:38.999934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4d995e64-dc14-47bf-9e55-764b926e70a2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080667 Aug 06 12:40:39.000629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 570/1249] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:38 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:39.005847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c2072ef5-b04e-46c0-a176-6cea8c4d22cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:39.008010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c2072ef5-b04e-46c0-a176-6cea8c4d22cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:39.014012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c2072ef5-b04e-46c0-a176-6cea8c4d22cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:39.014433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c2072ef5-b04e-46c0-a176-6cea8c4d22cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:39.014865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c2072ef5-b04e-46c0-a176-6cea8c4d22cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:39.015545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c2072ef5-b04e-46c0-a176-6cea8c4d22cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:39.015998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c2072ef5-b04e-46c0-a176-6cea8c4d22cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:39.016475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c2072ef5-b04e-46c0-a176-6cea8c4d22cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:39.045009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c2072ef5-b04e-46c0-a176-6cea8c4d22cd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Aug 06 12:40:39.045549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 571/1250] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:39 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:39.049946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1556c9c5-b0eb-4682-9259-f8a875ed34dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:39.051952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1556c9c5-b0eb-4682-9259-f8a875ed34dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:39.057333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1556c9c5-b0eb-4682-9259-f8a875ed34dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:39.057806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1556c9c5-b0eb-4682-9259-f8a875ed34dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:39.058239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1556c9c5-b0eb-4682-9259-f8a875ed34dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:39.058910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1556c9c5-b0eb-4682-9259-f8a875ed34dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:39.059355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1556c9c5-b0eb-4682-9259-f8a875ed34dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:39.059771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1556c9c5-b0eb-4682-9259-f8a875ed34dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:39.088141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1556c9c5-b0eb-4682-9259-f8a875ed34dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041618 Aug 06 12:40:39.088907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 572/1251] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:40.020768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-40766b71-dc23-4cd5-9ecb-b5b2858d8b5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:40.021349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-40766b71-dc23-4cd5-9ecb-b5b2858d8b5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:40.027762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40766b71-dc23-4cd5-9ecb-b5b2858d8b5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:40.028228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40766b71-dc23-4cd5-9ecb-b5b2858d8b5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:40.028679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40766b71-dc23-4cd5-9ecb-b5b2858d8b5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:40.029350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40766b71-dc23-4cd5-9ecb-b5b2858d8b5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:40.029791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40766b71-dc23-4cd5-9ecb-b5b2858d8b5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:40.030202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40766b71-dc23-4cd5-9ecb-b5b2858d8b5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:40.089683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-40766b71-dc23-4cd5-9ecb-b5b2858d8b5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:40.097673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-40766b71-dc23-4cd5-9ecb-b5b2858d8b5d tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080738 Aug 06 12:40:40.098217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 573/1252] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:40 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:40.102621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fe8abfbd-05e7-463c-86fe-b3ee2ba1a446 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:40.104729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fe8abfbd-05e7-463c-86fe-b3ee2ba1a446 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:40.110536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe8abfbd-05e7-463c-86fe-b3ee2ba1a446 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:40.111002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe8abfbd-05e7-463c-86fe-b3ee2ba1a446 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:40.111976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe8abfbd-05e7-463c-86fe-b3ee2ba1a446 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:40.112679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe8abfbd-05e7-463c-86fe-b3ee2ba1a446 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:40.113121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe8abfbd-05e7-463c-86fe-b3ee2ba1a446 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:40.113532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe8abfbd-05e7-463c-86fe-b3ee2ba1a446 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:40.142242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fe8abfbd-05e7-463c-86fe-b3ee2ba1a446 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043062 Aug 06 12:40:40.143287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 574/1253] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:40 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:40.147618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-392a4987-c18e-4ec6-ad42-654a817e084e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:40.149841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-392a4987-c18e-4ec6-ad42-654a817e084e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:40.155104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-392a4987-c18e-4ec6-ad42-654a817e084e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:40.155567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-392a4987-c18e-4ec6-ad42-654a817e084e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:40.155993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-392a4987-c18e-4ec6-ad42-654a817e084e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:40.156691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-392a4987-c18e-4ec6-ad42-654a817e084e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:40.157134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-392a4987-c18e-4ec6-ad42-654a817e084e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:40.157547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-392a4987-c18e-4ec6-ad42-654a817e084e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:40.185613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-392a4987-c18e-4ec6-ad42-654a817e084e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041370 Aug 06 12:40:40.186143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 575/1254] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:41.118196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-04911da0-8737-43c8-b56e-aa5be942b210 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:41.118844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-04911da0-8737-43c8-b56e-aa5be942b210 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:41.125248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04911da0-8737-43c8-b56e-aa5be942b210 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:41.125721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04911da0-8737-43c8-b56e-aa5be942b210 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:41.126174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04911da0-8737-43c8-b56e-aa5be942b210 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:41.127474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04911da0-8737-43c8-b56e-aa5be942b210 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:41.127922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04911da0-8737-43c8-b56e-aa5be942b210 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:41.128362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04911da0-8737-43c8-b56e-aa5be942b210 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:41.187282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-04911da0-8737-43c8-b56e-aa5be942b210 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:41.195375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-04911da0-8737-43c8-b56e-aa5be942b210 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081006 Aug 06 12:40:41.195930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 576/1255] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:41 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:41.200869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9ed82b8d-124f-4b7b-8a12-945db0fef767 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:41.202450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9ed82b8d-124f-4b7b-8a12-945db0fef767 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:41.208012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ed82b8d-124f-4b7b-8a12-945db0fef767 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:41.208530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ed82b8d-124f-4b7b-8a12-945db0fef767 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:41.208958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ed82b8d-124f-4b7b-8a12-945db0fef767 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:41.209647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ed82b8d-124f-4b7b-8a12-945db0fef767 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:41.210091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ed82b8d-124f-4b7b-8a12-945db0fef767 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:41.210508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ed82b8d-124f-4b7b-8a12-945db0fef767 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:41.243362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9ed82b8d-124f-4b7b-8a12-945db0fef767 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Aug 06 12:40:41.243922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 577/1256] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:41 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:41.248461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-39b7a7a7-8c9d-4096-a932-25eb8a76d5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:41.250526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-39b7a7a7-8c9d-4096-a932-25eb8a76d5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:41.256788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b7a7a7-8c9d-4096-a932-25eb8a76d5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:41.257258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b7a7a7-8c9d-4096-a932-25eb8a76d5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:41.257686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b7a7a7-8c9d-4096-a932-25eb8a76d5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:41.258362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b7a7a7-8c9d-4096-a932-25eb8a76d5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:41.258806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b7a7a7-8c9d-4096-a932-25eb8a76d5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:41.259224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b7a7a7-8c9d-4096-a932-25eb8a76d5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:41.287289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-39b7a7a7-8c9d-4096-a932-25eb8a76d5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042345 Aug 06 12:40:41.287823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 578/1257] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:42.214936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3e31ea3e-d5c8-4138-ac25-798f5fe8aa5b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:42.215567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e31ea3e-d5c8-4138-ac25-798f5fe8aa5b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:42.221958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e31ea3e-d5c8-4138-ac25-798f5fe8aa5b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:42.222446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e31ea3e-d5c8-4138-ac25-798f5fe8aa5b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:42.222860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e31ea3e-d5c8-4138-ac25-798f5fe8aa5b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:42.223539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e31ea3e-d5c8-4138-ac25-798f5fe8aa5b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:42.223985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e31ea3e-d5c8-4138-ac25-798f5fe8aa5b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:42.224420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e31ea3e-d5c8-4138-ac25-798f5fe8aa5b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:42.291092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3e31ea3e-d5c8-4138-ac25-798f5fe8aa5b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:42.298710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3e31ea3e-d5c8-4138-ac25-798f5fe8aa5b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.087632 Aug 06 12:40:42.299256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 579/1258] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:42 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:42.303906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-49b7c29e-d2d8-432e-890e-ffac79f7afdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:42.306002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-49b7c29e-d2d8-432e-890e-ffac79f7afdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:42.313043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49b7c29e-d2d8-432e-890e-ffac79f7afdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:42.313778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49b7c29e-d2d8-432e-890e-ffac79f7afdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:42.314840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49b7c29e-d2d8-432e-890e-ffac79f7afdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:42.315690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49b7c29e-d2d8-432e-890e-ffac79f7afdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:42.316136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49b7c29e-d2d8-432e-890e-ffac79f7afdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:42.316600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49b7c29e-d2d8-432e-890e-ffac79f7afdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:42.318178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:40:42.318888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:40:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa (ip 10.222.0.20) !!! Aug 06 12:40:42.348030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-49b7c29e-d2d8-432e-890e-ffac79f7afdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047719 Aug 06 12:40:42.348604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 580/1259] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:42 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:42.352962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2840572f-c893-4373-a409-d64b31dc2a6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:42.355009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2840572f-c893-4373-a409-d64b31dc2a6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:42.360522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2840572f-c893-4373-a409-d64b31dc2a6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:42.361483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2840572f-c893-4373-a409-d64b31dc2a6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:42.361917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2840572f-c893-4373-a409-d64b31dc2a6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:42.362586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2840572f-c893-4373-a409-d64b31dc2a6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:42.363028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2840572f-c893-4373-a409-d64b31dc2a6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:42.363441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2840572f-c893-4373-a409-d64b31dc2a6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:42.390967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2840572f-c893-4373-a409-d64b31dc2a6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041413 Aug 06 12:40:42.391492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 581/1260] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:42.788487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:40:42.788661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:40:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:40:43.319103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-adf5dc5c-8776-4b89-99bc-cd735408ef7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:43.319855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-adf5dc5c-8776-4b89-99bc-cd735408ef7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:43.326259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5dc5c-8776-4b89-99bc-cd735408ef7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:43.326731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5dc5c-8776-4b89-99bc-cd735408ef7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:43.327158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5dc5c-8776-4b89-99bc-cd735408ef7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:43.327838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5dc5c-8776-4b89-99bc-cd735408ef7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:43.328280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5dc5c-8776-4b89-99bc-cd735408ef7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:43.328722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5dc5c-8776-4b89-99bc-cd735408ef7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:43.388176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-adf5dc5c-8776-4b89-99bc-cd735408ef7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:43.396027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-adf5dc5c-8776-4b89-99bc-cd735408ef7a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080817 Aug 06 12:40:43.397850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 582/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:43 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:43.401009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a1a18282-3072-40af-8922-cf9993aaf58c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:43.403094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a1a18282-3072-40af-8922-cf9993aaf58c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:43.409228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a18282-3072-40af-8922-cf9993aaf58c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:43.409703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a18282-3072-40af-8922-cf9993aaf58c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:43.410126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a18282-3072-40af-8922-cf9993aaf58c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:43.410802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a18282-3072-40af-8922-cf9993aaf58c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:43.411246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a18282-3072-40af-8922-cf9993aaf58c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:43.411662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a18282-3072-40af-8922-cf9993aaf58c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:43.439109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a1a18282-3072-40af-8922-cf9993aaf58c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041550 Aug 06 12:40:43.439642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 583/1262] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:43.443956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac9eaf6d-e5b7-4fe4-91cd-272a1fbad38f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:43.446001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac9eaf6d-e5b7-4fe4-91cd-272a1fbad38f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:43.451220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac9eaf6d-e5b7-4fe4-91cd-272a1fbad38f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:43.451708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac9eaf6d-e5b7-4fe4-91cd-272a1fbad38f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:43.452118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac9eaf6d-e5b7-4fe4-91cd-272a1fbad38f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:43.452817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac9eaf6d-e5b7-4fe4-91cd-272a1fbad38f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:43.453263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac9eaf6d-e5b7-4fe4-91cd-272a1fbad38f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:43.453680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac9eaf6d-e5b7-4fe4-91cd-272a1fbad38f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:43.482060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac9eaf6d-e5b7-4fe4-91cd-272a1fbad38f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041240 Aug 06 12:40:43.482596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 584/1263] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:44.417515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fb195cea-97af-457f-a010-2790f0351c4b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:44.418240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fb195cea-97af-457f-a010-2790f0351c4b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:44.425331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb195cea-97af-457f-a010-2790f0351c4b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:44.425840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb195cea-97af-457f-a010-2790f0351c4b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:44.426270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb195cea-97af-457f-a010-2790f0351c4b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:44.426984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb195cea-97af-457f-a010-2790f0351c4b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:44.427433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb195cea-97af-457f-a010-2790f0351c4b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:44.427956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb195cea-97af-457f-a010-2790f0351c4b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:44.489590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fb195cea-97af-457f-a010-2790f0351c4b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:44.497047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fb195cea-97af-457f-a010-2790f0351c4b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083391 Aug 06 12:40:44.497590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 585/1264] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:44 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:44.502040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-957e4c08-fdee-4bf8-8a91-ca5c2d6f249b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:44.504108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-957e4c08-fdee-4bf8-8a91-ca5c2d6f249b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:44.509468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-957e4c08-fdee-4bf8-8a91-ca5c2d6f249b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:44.509941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-957e4c08-fdee-4bf8-8a91-ca5c2d6f249b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:44.510367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-957e4c08-fdee-4bf8-8a91-ca5c2d6f249b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:44.511037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-957e4c08-fdee-4bf8-8a91-ca5c2d6f249b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:44.511479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-957e4c08-fdee-4bf8-8a91-ca5c2d6f249b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:44.511890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-957e4c08-fdee-4bf8-8a91-ca5c2d6f249b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:44.528112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:44.545214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-957e4c08-fdee-4bf8-8a91-ca5c2d6f249b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Aug 06 12:40:44.545763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 586/1265] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:44.551291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-87a5c4ea-6384-4550-817f-ded5223f767b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:44.553602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-87a5c4ea-6384-4550-817f-ded5223f767b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:44.559503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87a5c4ea-6384-4550-817f-ded5223f767b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:44.559971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87a5c4ea-6384-4550-817f-ded5223f767b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:44.560432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87a5c4ea-6384-4550-817f-ded5223f767b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:44.561112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87a5c4ea-6384-4550-817f-ded5223f767b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:44.561549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87a5c4ea-6384-4550-817f-ded5223f767b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:44.561963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87a5c4ea-6384-4550-817f-ded5223f767b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:44.589953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-87a5c4ea-6384-4550-817f-ded5223f767b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043197 Aug 06 12:40:44.590493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 587/1266] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:45.295889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-3f77e308-34b0-40e5-9672-9668888e3ff0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'services' on Instance uuid 7a8a8915-eeca-4909-aab7-6fe8381ced6e {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:40:45.517414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-68e2cde5-1979-43fe-be30-ebd68b9c33a8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:45.517951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-68e2cde5-1979-43fe-be30-ebd68b9c33a8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:45.523961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68e2cde5-1979-43fe-be30-ebd68b9c33a8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:45.524460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68e2cde5-1979-43fe-be30-ebd68b9c33a8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:45.524892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68e2cde5-1979-43fe-be30-ebd68b9c33a8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:45.525566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68e2cde5-1979-43fe-be30-ebd68b9c33a8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:45.526004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68e2cde5-1979-43fe-be30-ebd68b9c33a8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:45.526415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68e2cde5-1979-43fe-be30-ebd68b9c33a8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:45.585104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-68e2cde5-1979-43fe-be30-ebd68b9c33a8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:45.592334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-68e2cde5-1979-43fe-be30-ebd68b9c33a8 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.078961 Aug 06 12:40:45.592881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 588/1267] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:45 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:45.601822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d5ef613-6294-4700-a40d-cd45c2309477 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:45.601822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9d5ef613-6294-4700-a40d-cd45c2309477 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:45.604945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d5ef613-6294-4700-a40d-cd45c2309477 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:45.605413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d5ef613-6294-4700-a40d-cd45c2309477 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:45.605836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d5ef613-6294-4700-a40d-cd45c2309477 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:45.606763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d5ef613-6294-4700-a40d-cd45c2309477 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:45.607200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d5ef613-6294-4700-a40d-cd45c2309477 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:45.607611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d5ef613-6294-4700-a40d-cd45c2309477 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:45.636606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d5ef613-6294-4700-a40d-cd45c2309477 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042730 Aug 06 12:40:45.637142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 589/1268] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:45.641473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1b2466e3-4ae6-49ac-8b63-612838fc6360 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:45.643510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1b2466e3-4ae6-49ac-8b63-612838fc6360 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:45.648856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b2466e3-4ae6-49ac-8b63-612838fc6360 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:45.649320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b2466e3-4ae6-49ac-8b63-612838fc6360 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:45.649748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b2466e3-4ae6-49ac-8b63-612838fc6360 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:45.650405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b2466e3-4ae6-49ac-8b63-612838fc6360 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:45.650842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b2466e3-4ae6-49ac-8b63-612838fc6360 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:45.651253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b2466e3-4ae6-49ac-8b63-612838fc6360 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:45.678411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1b2466e3-4ae6-49ac-8b63-612838fc6360 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040332 Aug 06 12:40:45.678941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 590/1269] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:46.613940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-686e0a53-8feb-4298-86b2-5e52f7f27068 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:46.614530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-686e0a53-8feb-4298-86b2-5e52f7f27068 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:46.621117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-686e0a53-8feb-4298-86b2-5e52f7f27068 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:46.621592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-686e0a53-8feb-4298-86b2-5e52f7f27068 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:46.622138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-686e0a53-8feb-4298-86b2-5e52f7f27068 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:46.622816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-686e0a53-8feb-4298-86b2-5e52f7f27068 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:46.623256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-686e0a53-8feb-4298-86b2-5e52f7f27068 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:46.623665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-686e0a53-8feb-4298-86b2-5e52f7f27068 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:46.686469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-686e0a53-8feb-4298-86b2-5e52f7f27068 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:46.693857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-686e0a53-8feb-4298-86b2-5e52f7f27068 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084397 Aug 06 12:40:46.694416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 591/1270] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:46 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:46.698788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-db4dd3ae-48c3-419c-a621-045150384863 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:46.700867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-db4dd3ae-48c3-419c-a621-045150384863 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:46.706190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db4dd3ae-48c3-419c-a621-045150384863 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:46.706655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db4dd3ae-48c3-419c-a621-045150384863 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:46.707075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db4dd3ae-48c3-419c-a621-045150384863 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:46.707741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db4dd3ae-48c3-419c-a621-045150384863 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:46.708179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db4dd3ae-48c3-419c-a621-045150384863 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:46.708610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db4dd3ae-48c3-419c-a621-045150384863 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:46.736381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-db4dd3ae-48c3-419c-a621-045150384863 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040981 Aug 06 12:40:46.737577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 592/1271] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:46.741916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3ca10138-d81c-443b-8383-e5508b42f236 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:46.743944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3ca10138-d81c-443b-8383-e5508b42f236 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:46.749264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ca10138-d81c-443b-8383-e5508b42f236 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:46.749729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ca10138-d81c-443b-8383-e5508b42f236 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:46.750150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ca10138-d81c-443b-8383-e5508b42f236 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:46.750811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ca10138-d81c-443b-8383-e5508b42f236 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:46.751258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ca10138-d81c-443b-8383-e5508b42f236 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:46.751668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ca10138-d81c-443b-8383-e5508b42f236 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:46.779112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3ca10138-d81c-443b-8383-e5508b42f236 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040571 Aug 06 12:40:46.779649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 593/1272] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:47.713969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5369cfcd-35ff-4623-8753-ed2f3c338278 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:47.714634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5369cfcd-35ff-4623-8753-ed2f3c338278 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:47.721146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5369cfcd-35ff-4623-8753-ed2f3c338278 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:47.721390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5369cfcd-35ff-4623-8753-ed2f3c338278 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:47.721814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5369cfcd-35ff-4623-8753-ed2f3c338278 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:47.722481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5369cfcd-35ff-4623-8753-ed2f3c338278 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:47.722923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5369cfcd-35ff-4623-8753-ed2f3c338278 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:47.723334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5369cfcd-35ff-4623-8753-ed2f3c338278 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:47.783556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5369cfcd-35ff-4623-8753-ed2f3c338278 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:47.790975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5369cfcd-35ff-4623-8753-ed2f3c338278 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080828 Aug 06 12:40:47.791531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 594/1273] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:47 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:47.796059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a5e1ce53-90c8-445f-abb2-e9b2d935df33 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:47.798164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a5e1ce53-90c8-445f-abb2-e9b2d935df33 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:47.804052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5e1ce53-90c8-445f-abb2-e9b2d935df33 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:47.804562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5e1ce53-90c8-445f-abb2-e9b2d935df33 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:47.804993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5e1ce53-90c8-445f-abb2-e9b2d935df33 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:47.805669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5e1ce53-90c8-445f-abb2-e9b2d935df33 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:47.806123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5e1ce53-90c8-445f-abb2-e9b2d935df33 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:47.806543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5e1ce53-90c8-445f-abb2-e9b2d935df33 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:47.835319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a5e1ce53-90c8-445f-abb2-e9b2d935df33 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042824 Aug 06 12:40:47.835852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 595/1274] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:47.840187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-904a686d-7b10-42b1-a461-9d8e6b27f3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:47.842243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-904a686d-7b10-42b1-a461-9d8e6b27f3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:47.848926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904a686d-7b10-42b1-a461-9d8e6b27f3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:47.849760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904a686d-7b10-42b1-a461-9d8e6b27f3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:47.850548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904a686d-7b10-42b1-a461-9d8e6b27f3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:47.851604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904a686d-7b10-42b1-a461-9d8e6b27f3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:47.852062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904a686d-7b10-42b1-a461-9d8e6b27f3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:47.852603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904a686d-7b10-42b1-a461-9d8e6b27f3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:47.886410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-904a686d-7b10-42b1-a461-9d8e6b27f3cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049505 Aug 06 12:40:47.886964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 596/1275] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:48.812431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f4b5cd4c-615e-4b66-83ef-39f01c07389a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:48.813035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f4b5cd4c-615e-4b66-83ef-39f01c07389a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:48.819894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4b5cd4c-615e-4b66-83ef-39f01c07389a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:48.820398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4b5cd4c-615e-4b66-83ef-39f01c07389a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:48.820830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4b5cd4c-615e-4b66-83ef-39f01c07389a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:48.821507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4b5cd4c-615e-4b66-83ef-39f01c07389a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:48.821952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4b5cd4c-615e-4b66-83ef-39f01c07389a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:48.822374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4b5cd4c-615e-4b66-83ef-39f01c07389a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:48.882976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f4b5cd4c-615e-4b66-83ef-39f01c07389a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:48.890329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f4b5cd4c-615e-4b66-83ef-39f01c07389a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081795 Aug 06 12:40:48.890888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 597/1276] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:48 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:48.895838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4165de92-47e5-454c-8a35-ec1508d4c3b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:48.897921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4165de92-47e5-454c-8a35-ec1508d4c3b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:48.903758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4165de92-47e5-454c-8a35-ec1508d4c3b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:48.904252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4165de92-47e5-454c-8a35-ec1508d4c3b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:48.904706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4165de92-47e5-454c-8a35-ec1508d4c3b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:48.905381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4165de92-47e5-454c-8a35-ec1508d4c3b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:48.905819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4165de92-47e5-454c-8a35-ec1508d4c3b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:48.906227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4165de92-47e5-454c-8a35-ec1508d4c3b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:48.933672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4165de92-47e5-454c-8a35-ec1508d4c3b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041823 Aug 06 12:40:48.934198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 598/1277] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:48.939221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-36bb9a0c-00e6-4fb4-84ca-a0ea23272a24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:48.941756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-36bb9a0c-00e6-4fb4-84ca-a0ea23272a24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:48.947091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36bb9a0c-00e6-4fb4-84ca-a0ea23272a24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:48.947555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36bb9a0c-00e6-4fb4-84ca-a0ea23272a24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:48.947978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36bb9a0c-00e6-4fb4-84ca-a0ea23272a24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:48.948672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36bb9a0c-00e6-4fb4-84ca-a0ea23272a24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:48.949114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36bb9a0c-00e6-4fb4-84ca-a0ea23272a24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:48.949525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36bb9a0c-00e6-4fb4-84ca-a0ea23272a24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:48.977117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-36bb9a0c-00e6-4fb4-84ca-a0ea23272a24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041369 Aug 06 12:40:48.977647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 599/1278] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:49.911622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b7c51ae0-57f7-4de9-8af2-9a226f5cd547 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:49.912287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b7c51ae0-57f7-4de9-8af2-9a226f5cd547 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:49.918552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7c51ae0-57f7-4de9-8af2-9a226f5cd547 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:49.919024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7c51ae0-57f7-4de9-8af2-9a226f5cd547 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:49.919453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7c51ae0-57f7-4de9-8af2-9a226f5cd547 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:49.920128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7c51ae0-57f7-4de9-8af2-9a226f5cd547 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:49.920598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7c51ae0-57f7-4de9-8af2-9a226f5cd547 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:49.921015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7c51ae0-57f7-4de9-8af2-9a226f5cd547 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:49.980264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b7c51ae0-57f7-4de9-8af2-9a226f5cd547 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:49.988177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b7c51ae0-57f7-4de9-8af2-9a226f5cd547 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081080 Aug 06 12:40:49.988761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 600/1279] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:49 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:49.993668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-64127f28-c644-4d62-a5de-2e0a868ae968 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:49.996042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-64127f28-c644-4d62-a5de-2e0a868ae968 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:50.002949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64127f28-c644-4d62-a5de-2e0a868ae968 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:50.003429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64127f28-c644-4d62-a5de-2e0a868ae968 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:50.003863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64127f28-c644-4d62-a5de-2e0a868ae968 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:50.004575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64127f28-c644-4d62-a5de-2e0a868ae968 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:50.005059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64127f28-c644-4d62-a5de-2e0a868ae968 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:50.005479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64127f28-c644-4d62-a5de-2e0a868ae968 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:50.034724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-64127f28-c644-4d62-a5de-2e0a868ae968 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Aug 06 12:40:50.035277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 601/1280] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:50.039868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1d4d17dd-be3d-4921-bc8b-f5c38bc3d344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:50.041960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1d4d17dd-be3d-4921-bc8b-f5c38bc3d344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:50.047435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d4d17dd-be3d-4921-bc8b-f5c38bc3d344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:50.047902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d4d17dd-be3d-4921-bc8b-f5c38bc3d344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:50.048355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d4d17dd-be3d-4921-bc8b-f5c38bc3d344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:50.049080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d4d17dd-be3d-4921-bc8b-f5c38bc3d344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:50.049521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d4d17dd-be3d-4921-bc8b-f5c38bc3d344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:50.049938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d4d17dd-be3d-4921-bc8b-f5c38bc3d344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:50.077290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1d4d17dd-be3d-4921-bc8b-f5c38bc3d344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041063 Aug 06 12:40:50.077822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 602/1281] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:51.007997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ca46d0fc-2309-4442-ab93-0ec884353616 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:51.008631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ca46d0fc-2309-4442-ab93-0ec884353616 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:51.015081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca46d0fc-2309-4442-ab93-0ec884353616 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:51.015560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca46d0fc-2309-4442-ab93-0ec884353616 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:51.015990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca46d0fc-2309-4442-ab93-0ec884353616 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:51.016693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca46d0fc-2309-4442-ab93-0ec884353616 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:51.017169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca46d0fc-2309-4442-ab93-0ec884353616 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:51.017587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca46d0fc-2309-4442-ab93-0ec884353616 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:51.021451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:51.080896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ca46d0fc-2309-4442-ab93-0ec884353616 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:51.088417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ca46d0fc-2309-4442-ab93-0ec884353616 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084203 Aug 06 12:40:51.088977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 603/1282] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:51 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:51.155296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a7a5d27f-af06-40c4-9d83-9151a0e1db63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:51.157497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a7a5d27f-af06-40c4-9d83-9151a0e1db63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:51.163768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7a5d27f-af06-40c4-9d83-9151a0e1db63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:51.164239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7a5d27f-af06-40c4-9d83-9151a0e1db63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:51.164691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7a5d27f-af06-40c4-9d83-9151a0e1db63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:51.165369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7a5d27f-af06-40c4-9d83-9151a0e1db63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:51.165810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7a5d27f-af06-40c4-9d83-9151a0e1db63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:51.166226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7a5d27f-af06-40c4-9d83-9151a0e1db63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:51.196190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a7a5d27f-af06-40c4-9d83-9151a0e1db63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106200 Aug 06 12:40:51.196767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 604/1283] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:51.201082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6aa28cdc-5a11-4a35-a975-89eb17f7b3b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:51.203063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6aa28cdc-5a11-4a35-a975-89eb17f7b3b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:51.208571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6aa28cdc-5a11-4a35-a975-89eb17f7b3b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:51.209035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6aa28cdc-5a11-4a35-a975-89eb17f7b3b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:51.209459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6aa28cdc-5a11-4a35-a975-89eb17f7b3b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:51.210122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6aa28cdc-5a11-4a35-a975-89eb17f7b3b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:51.210564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6aa28cdc-5a11-4a35-a975-89eb17f7b3b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:51.210977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6aa28cdc-5a11-4a35-a975-89eb17f7b3b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:51.383351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6aa28cdc-5a11-4a35-a975-89eb17f7b3b2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.185582 Aug 06 12:40:51.383907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 605/1284] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:52.108935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-25037f3b-e1f7-43b7-8b6f-5d2f9266d9ab tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:52.109601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-25037f3b-e1f7-43b7-8b6f-5d2f9266d9ab tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:52.116291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25037f3b-e1f7-43b7-8b6f-5d2f9266d9ab tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:52.116790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25037f3b-e1f7-43b7-8b6f-5d2f9266d9ab tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:52.117212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25037f3b-e1f7-43b7-8b6f-5d2f9266d9ab tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:52.117883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25037f3b-e1f7-43b7-8b6f-5d2f9266d9ab tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:52.118324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25037f3b-e1f7-43b7-8b6f-5d2f9266d9ab tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:52.118737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25037f3b-e1f7-43b7-8b6f-5d2f9266d9ab tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:52.177743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-25037f3b-e1f7-43b7-8b6f-5d2f9266d9ab tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:52.184991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-25037f3b-e1f7-43b7-8b6f-5d2f9266d9ab tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.079976 Aug 06 12:40:52.185531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 606/1285] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:52 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:52.207606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-461eaa26-2b48-42e0-a2ae-ff2ee23bb195 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:52.209690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-461eaa26-2b48-42e0-a2ae-ff2ee23bb195 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:52.215127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-461eaa26-2b48-42e0-a2ae-ff2ee23bb195 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:52.215602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-461eaa26-2b48-42e0-a2ae-ff2ee23bb195 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:52.216023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-461eaa26-2b48-42e0-a2ae-ff2ee23bb195 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:52.216725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-461eaa26-2b48-42e0-a2ae-ff2ee23bb195 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:52.217167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-461eaa26-2b48-42e0-a2ae-ff2ee23bb195 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:52.217583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-461eaa26-2b48-42e0-a2ae-ff2ee23bb195 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:52.246029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-461eaa26-2b48-42e0-a2ae-ff2ee23bb195 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041940 Aug 06 12:40:52.246551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 607/1286] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:52 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:40:52.395609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e49be68a-3dfa-4e7c-9620-6f892b8d87e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:52.397728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e49be68a-3dfa-4e7c-9620-6f892b8d87e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:52.403556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e49be68a-3dfa-4e7c-9620-6f892b8d87e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:52.404028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e49be68a-3dfa-4e7c-9620-6f892b8d87e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:52.404493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e49be68a-3dfa-4e7c-9620-6f892b8d87e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:52.405172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e49be68a-3dfa-4e7c-9620-6f892b8d87e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:52.405624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e49be68a-3dfa-4e7c-9620-6f892b8d87e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:52.406038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e49be68a-3dfa-4e7c-9620-6f892b8d87e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:52.434072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e49be68a-3dfa-4e7c-9620-6f892b8d87e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042387 Aug 06 12:40:52.434782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 608/1287] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:40:53.205998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d958efdf-8f9f-4457-be59-6d15d3f9d665 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:53.206624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d958efdf-8f9f-4457-be59-6d15d3f9d665 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:53.212961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d958efdf-8f9f-4457-be59-6d15d3f9d665 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:53.213437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d958efdf-8f9f-4457-be59-6d15d3f9d665 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:53.213865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d958efdf-8f9f-4457-be59-6d15d3f9d665 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:53.214553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d958efdf-8f9f-4457-be59-6d15d3f9d665 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:53.214997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d958efdf-8f9f-4457-be59-6d15d3f9d665 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:53.215418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d958efdf-8f9f-4457-be59-6d15d3f9d665 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:53.275871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d958efdf-8f9f-4457-be59-6d15d3f9d665 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:53.283414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d958efdf-8f9f-4457-be59-6d15d3f9d665 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081665 Aug 06 12:40:53.283958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 609/1288] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:53 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:53.288473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a8f2aa74-8235-43c0-a184-de9a7acf86e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:53.291267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a8f2aa74-8235-43c0-a184-de9a7acf86e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:53.296757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8f2aa74-8235-43c0-a184-de9a7acf86e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:53.297258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8f2aa74-8235-43c0-a184-de9a7acf86e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:53.297682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8f2aa74-8235-43c0-a184-de9a7acf86e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:53.298355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8f2aa74-8235-43c0-a184-de9a7acf86e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:53.298794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8f2aa74-8235-43c0-a184-de9a7acf86e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:53.299204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8f2aa74-8235-43c0-a184-de9a7acf86e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:53.327634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a8f2aa74-8235-43c0-a184-de9a7acf86e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042703 Aug 06 12:40:53.328156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 610/1289] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:53 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:53.448262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-16b25609-7f84-4319-b144-059242ce35a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:53.450329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-16b25609-7f84-4319-b144-059242ce35a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:53.456614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16b25609-7f84-4319-b144-059242ce35a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:53.457028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16b25609-7f84-4319-b144-059242ce35a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:53.457453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16b25609-7f84-4319-b144-059242ce35a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:53.458123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16b25609-7f84-4319-b144-059242ce35a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:53.458569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16b25609-7f84-4319-b144-059242ce35a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:53.458982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-16b25609-7f84-4319-b144-059242ce35a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:53.487733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-16b25609-7f84-4319-b144-059242ce35a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043140 Aug 06 12:40:53.488253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 611/1290] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:40:54.304366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c9d6aa0d-9e27-4c6d-bd9d-5aaf60e21bc6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:54.305000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c9d6aa0d-9e27-4c6d-bd9d-5aaf60e21bc6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:54.311183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9d6aa0d-9e27-4c6d-bd9d-5aaf60e21bc6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:54.311683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9d6aa0d-9e27-4c6d-bd9d-5aaf60e21bc6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:54.312106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9d6aa0d-9e27-4c6d-bd9d-5aaf60e21bc6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:54.312802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9d6aa0d-9e27-4c6d-bd9d-5aaf60e21bc6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:54.313245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9d6aa0d-9e27-4c6d-bd9d-5aaf60e21bc6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:54.313723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9d6aa0d-9e27-4c6d-bd9d-5aaf60e21bc6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:54.375435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c9d6aa0d-9e27-4c6d-bd9d-5aaf60e21bc6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:54.382875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c9d6aa0d-9e27-4c6d-bd9d-5aaf60e21bc6 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082326 Aug 06 12:40:54.383446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 612/1291] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:54 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:54.387925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5f7bab9a-808d-4527-a2c3-a4b2aa58bcd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:54.390082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5f7bab9a-808d-4527-a2c3-a4b2aa58bcd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:54.396004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f7bab9a-808d-4527-a2c3-a4b2aa58bcd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:54.396516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f7bab9a-808d-4527-a2c3-a4b2aa58bcd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:54.396946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f7bab9a-808d-4527-a2c3-a4b2aa58bcd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:54.397625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f7bab9a-808d-4527-a2c3-a4b2aa58bcd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:54.398072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f7bab9a-808d-4527-a2c3-a4b2aa58bcd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:54.398491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f7bab9a-808d-4527-a2c3-a4b2aa58bcd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:54.426495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5f7bab9a-808d-4527-a2c3-a4b2aa58bcd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042087 Aug 06 12:40:54.427027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 613/1292] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:54 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:54.499145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4abbabc0-5e1f-4d64-a1ef-35809d5cdfea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:54.501236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4abbabc0-5e1f-4d64-a1ef-35809d5cdfea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:54.502939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:54.508182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abbabc0-5e1f-4d64-a1ef-35809d5cdfea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:54.508689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abbabc0-5e1f-4d64-a1ef-35809d5cdfea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:54.509146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abbabc0-5e1f-4d64-a1ef-35809d5cdfea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:54.509823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abbabc0-5e1f-4d64-a1ef-35809d5cdfea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:54.510270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abbabc0-5e1f-4d64-a1ef-35809d5cdfea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:54.510739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4abbabc0-5e1f-4d64-a1ef-35809d5cdfea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:54.539122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4abbabc0-5e1f-4d64-a1ef-35809d5cdfea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043592 Aug 06 12:40:54.539651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 614/1293] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:40:55.299963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:55.403615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fb1409fd-c288-4911-8034-3030235e34cf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:55.404212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fb1409fd-c288-4911-8034-3030235e34cf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:55.410456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb1409fd-c288-4911-8034-3030235e34cf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:55.410927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb1409fd-c288-4911-8034-3030235e34cf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:55.411351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb1409fd-c288-4911-8034-3030235e34cf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:55.412022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb1409fd-c288-4911-8034-3030235e34cf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:55.412493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb1409fd-c288-4911-8034-3030235e34cf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:55.412906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb1409fd-c288-4911-8034-3030235e34cf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:55.475327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fb1409fd-c288-4911-8034-3030235e34cf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:55.482912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fb1409fd-c288-4911-8034-3030235e34cf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083082 Aug 06 12:40:55.483453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 615/1294] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:55 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:55.488521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-733299d8-9e40-4c9d-8e41-d881396258bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:55.490583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-733299d8-9e40-4c9d-8e41-d881396258bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:55.496183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-733299d8-9e40-4c9d-8e41-d881396258bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:55.496680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-733299d8-9e40-4c9d-8e41-d881396258bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:55.497115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-733299d8-9e40-4c9d-8e41-d881396258bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:55.497792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-733299d8-9e40-4c9d-8e41-d881396258bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:55.498237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-733299d8-9e40-4c9d-8e41-d881396258bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:55.498646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-733299d8-9e40-4c9d-8e41-d881396258bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:55.525999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-733299d8-9e40-4c9d-8e41-d881396258bf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041600 Aug 06 12:40:55.526516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 616/1295] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:55 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:55.551072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d0f59c3c-9b7d-4067-8058-cd21f78c468e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:55.553062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d0f59c3c-9b7d-4067-8058-cd21f78c468e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:55.558917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0f59c3c-9b7d-4067-8058-cd21f78c468e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:55.559393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0f59c3c-9b7d-4067-8058-cd21f78c468e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:55.559823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0f59c3c-9b7d-4067-8058-cd21f78c468e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:55.560532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0f59c3c-9b7d-4067-8058-cd21f78c468e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:55.560973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0f59c3c-9b7d-4067-8058-cd21f78c468e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:55.561385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0f59c3c-9b7d-4067-8058-cd21f78c468e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:55.588902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d0f59c3c-9b7d-4067-8058-cd21f78c468e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042004 Aug 06 12:40:55.589438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 617/1296] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:40:56.503333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2839824a-edcf-42b7-ad96-287ce58df705 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:56.503960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2839824a-edcf-42b7-ad96-287ce58df705 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:56.510216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2839824a-edcf-42b7-ad96-287ce58df705 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:56.510683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2839824a-edcf-42b7-ad96-287ce58df705 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:56.511121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2839824a-edcf-42b7-ad96-287ce58df705 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:56.511776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2839824a-edcf-42b7-ad96-287ce58df705 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:56.512215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2839824a-edcf-42b7-ad96-287ce58df705 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:56.512652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2839824a-edcf-42b7-ad96-287ce58df705 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:56.573681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2839824a-edcf-42b7-ad96-287ce58df705 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:56.581864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2839824a-edcf-42b7-ad96-287ce58df705 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082794 Aug 06 12:40:56.582408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 618/1297] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:56 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:56.587360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4d1d47af-f692-4b17-8da8-e1163c80c8b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:56.589492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4d1d47af-f692-4b17-8da8-e1163c80c8b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:56.596461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d1d47af-f692-4b17-8da8-e1163c80c8b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:56.596943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d1d47af-f692-4b17-8da8-e1163c80c8b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:56.597369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d1d47af-f692-4b17-8da8-e1163c80c8b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:56.598052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d1d47af-f692-4b17-8da8-e1163c80c8b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:56.598491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d1d47af-f692-4b17-8da8-e1163c80c8b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:56.598902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4d1d47af-f692-4b17-8da8-e1163c80c8b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:56.624197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:40:56.629768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4d1d47af-f692-4b17-8da8-e1163c80c8b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046403 Aug 06 12:40:56.630318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 619/1298] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:56.634912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-17c563bb-36b1-4f61-bfa5-cbe624671ab2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:56.637036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-17c563bb-36b1-4f61-bfa5-cbe624671ab2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:56.642652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17c563bb-36b1-4f61-bfa5-cbe624671ab2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:56.643120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17c563bb-36b1-4f61-bfa5-cbe624671ab2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:56.643546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17c563bb-36b1-4f61-bfa5-cbe624671ab2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:56.644219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17c563bb-36b1-4f61-bfa5-cbe624671ab2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:56.644682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17c563bb-36b1-4f61-bfa5-cbe624671ab2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:56.645095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17c563bb-36b1-4f61-bfa5-cbe624671ab2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:56.674087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-17c563bb-36b1-4f61-bfa5-cbe624671ab2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042276 Aug 06 12:40:56.674622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 620/1299] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:56 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:57.602479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d495d705-6619-4ffe-8aa9-82a1c51bef57 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:57.603145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d495d705-6619-4ffe-8aa9-82a1c51bef57 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:57.609728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d495d705-6619-4ffe-8aa9-82a1c51bef57 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:57.610198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d495d705-6619-4ffe-8aa9-82a1c51bef57 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:57.610620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d495d705-6619-4ffe-8aa9-82a1c51bef57 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:57.611292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d495d705-6619-4ffe-8aa9-82a1c51bef57 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:57.611729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d495d705-6619-4ffe-8aa9-82a1c51bef57 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:57.612140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d495d705-6619-4ffe-8aa9-82a1c51bef57 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:57.672099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d495d705-6619-4ffe-8aa9-82a1c51bef57 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:57.679538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d495d705-6619-4ffe-8aa9-82a1c51bef57 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080896 Aug 06 12:40:57.680366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 621/1300] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:57 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:57.684707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-248f0892-7b36-4fcd-b057-6fa1fc806bcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:57.686798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-248f0892-7b36-4fcd-b057-6fa1fc806bcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:57.692330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-248f0892-7b36-4fcd-b057-6fa1fc806bcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:57.692798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-248f0892-7b36-4fcd-b057-6fa1fc806bcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:57.693227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-248f0892-7b36-4fcd-b057-6fa1fc806bcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:57.693904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-248f0892-7b36-4fcd-b057-6fa1fc806bcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:57.694352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-248f0892-7b36-4fcd-b057-6fa1fc806bcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:57.694773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-248f0892-7b36-4fcd-b057-6fa1fc806bcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:57.723448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-248f0892-7b36-4fcd-b057-6fa1fc806bcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042259 Aug 06 12:40:57.723974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 622/1301] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:57 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:57.728459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-be2a83cf-5523-4b71-a581-02c66f12f34a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:57.730475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-be2a83cf-5523-4b71-a581-02c66f12f34a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:57.736110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be2a83cf-5523-4b71-a581-02c66f12f34a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:57.736633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be2a83cf-5523-4b71-a581-02c66f12f34a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:57.737065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be2a83cf-5523-4b71-a581-02c66f12f34a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:57.737734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be2a83cf-5523-4b71-a581-02c66f12f34a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:57.738179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be2a83cf-5523-4b71-a581-02c66f12f34a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:57.738596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be2a83cf-5523-4b71-a581-02c66f12f34a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:57.766116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-be2a83cf-5523-4b71-a581-02c66f12f34a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041111 Aug 06 12:40:57.766637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 623/1302] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:58.699554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c9a1c7fb-02d6-46d7-af0b-87e4a0e991ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:58.700194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c9a1c7fb-02d6-46d7-af0b-87e4a0e991ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:58.706534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9a1c7fb-02d6-46d7-af0b-87e4a0e991ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:58.707008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9a1c7fb-02d6-46d7-af0b-87e4a0e991ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:58.707438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9a1c7fb-02d6-46d7-af0b-87e4a0e991ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:58.708113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9a1c7fb-02d6-46d7-af0b-87e4a0e991ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:58.708586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9a1c7fb-02d6-46d7-af0b-87e4a0e991ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:58.709004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9a1c7fb-02d6-46d7-af0b-87e4a0e991ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:58.768703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c9a1c7fb-02d6-46d7-af0b-87e4a0e991ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:58.776193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c9a1c7fb-02d6-46d7-af0b-87e4a0e991ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080551 Aug 06 12:40:58.776900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 624/1303] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:58 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:58.781296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ffeed716-ebf7-4f02-b277-37b19a88566b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:58.783918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ffeed716-ebf7-4f02-b277-37b19a88566b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:58.789601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffeed716-ebf7-4f02-b277-37b19a88566b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:58.790079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffeed716-ebf7-4f02-b277-37b19a88566b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:58.790508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffeed716-ebf7-4f02-b277-37b19a88566b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:58.791186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffeed716-ebf7-4f02-b277-37b19a88566b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:58.791631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffeed716-ebf7-4f02-b277-37b19a88566b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:58.792048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffeed716-ebf7-4f02-b277-37b19a88566b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:58.820178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ffeed716-ebf7-4f02-b277-37b19a88566b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042448 Aug 06 12:40:58.820745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 625/1304] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:58.825361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cfc43caf-9680-42df-af16-4845cf703ede tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:58.827397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cfc43caf-9680-42df-af16-4845cf703ede tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:58.833246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc43caf-9680-42df-af16-4845cf703ede tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:58.833719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc43caf-9680-42df-af16-4845cf703ede tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:58.834151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc43caf-9680-42df-af16-4845cf703ede tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:58.834826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc43caf-9680-42df-af16-4845cf703ede tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:58.835271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc43caf-9680-42df-af16-4845cf703ede tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:58.835687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc43caf-9680-42df-af16-4845cf703ede tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:58.863392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cfc43caf-9680-42df-af16-4845cf703ede tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041708 Aug 06 12:40:58.863918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 626/1305] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:40:59.796739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d6ad0057-bfd6-4acd-9378-fa5bc3b406b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:59.797422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d6ad0057-bfd6-4acd-9378-fa5bc3b406b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:59.803660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6ad0057-bfd6-4acd-9378-fa5bc3b406b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:59.804136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6ad0057-bfd6-4acd-9378-fa5bc3b406b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:59.804597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6ad0057-bfd6-4acd-9378-fa5bc3b406b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:59.805273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6ad0057-bfd6-4acd-9378-fa5bc3b406b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:59.805720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6ad0057-bfd6-4acd-9378-fa5bc3b406b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:59.806140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6ad0057-bfd6-4acd-9378-fa5bc3b406b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:59.868824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d6ad0057-bfd6-4acd-9378-fa5bc3b406b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:40:59.876229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d6ad0057-bfd6-4acd-9378-fa5bc3b406b1 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083313 Aug 06 12:40:59.876809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 627/1306] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:40:59 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:40:59.881283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-39c242db-3bf2-4ec5-b4bf-9c504914341c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:59.883414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-39c242db-3bf2-4ec5-b4bf-9c504914341c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:59.889494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39c242db-3bf2-4ec5-b4bf-9c504914341c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:59.889983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39c242db-3bf2-4ec5-b4bf-9c504914341c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:59.890408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39c242db-3bf2-4ec5-b4bf-9c504914341c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:59.891110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39c242db-3bf2-4ec5-b4bf-9c504914341c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:59.891582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39c242db-3bf2-4ec5-b4bf-9c504914341c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:59.892000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39c242db-3bf2-4ec5-b4bf-9c504914341c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:59.922065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-39c242db-3bf2-4ec5-b4bf-9c504914341c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Aug 06 12:40:59.922624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 628/1307] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:40:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:40:59.927119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b525db04-fb02-482c-826d-803c28543bed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:40:59.929257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b525db04-fb02-482c-826d-803c28543bed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:40:59.934712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b525db04-fb02-482c-826d-803c28543bed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:59.935184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b525db04-fb02-482c-826d-803c28543bed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:59.935608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b525db04-fb02-482c-826d-803c28543bed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:59.936281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b525db04-fb02-482c-826d-803c28543bed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:40:59.936745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b525db04-fb02-482c-826d-803c28543bed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:40:59.937162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b525db04-fb02-482c-826d-803c28543bed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:40:59.966512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b525db04-fb02-482c-826d-803c28543bed tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042904 Aug 06 12:40:59.967051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 629/1308] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:40:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:00.897066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bf94caaa-9a3b-40d0-a172-eb115901d61a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:00.897728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bf94caaa-9a3b-40d0-a172-eb115901d61a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:00.903907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf94caaa-9a3b-40d0-a172-eb115901d61a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:00.904416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf94caaa-9a3b-40d0-a172-eb115901d61a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:00.904841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf94caaa-9a3b-40d0-a172-eb115901d61a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:00.905511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf94caaa-9a3b-40d0-a172-eb115901d61a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:00.905954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf94caaa-9a3b-40d0-a172-eb115901d61a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:00.906370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf94caaa-9a3b-40d0-a172-eb115901d61a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:00.965696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bf94caaa-9a3b-40d0-a172-eb115901d61a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:00.973609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bf94caaa-9a3b-40d0-a172-eb115901d61a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080315 Aug 06 12:41:00.974242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 630/1309] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:00 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:00.978774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1f494d00-512f-417a-b636-c0aed9c41655 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:00.980880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f494d00-512f-417a-b636-c0aed9c41655 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:00.987283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f494d00-512f-417a-b636-c0aed9c41655 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:00.987750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f494d00-512f-417a-b636-c0aed9c41655 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:00.988173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f494d00-512f-417a-b636-c0aed9c41655 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:00.988864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f494d00-512f-417a-b636-c0aed9c41655 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:00.989307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f494d00-512f-417a-b636-c0aed9c41655 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:00.989719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f494d00-512f-417a-b636-c0aed9c41655 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:01.018691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1f494d00-512f-417a-b636-c0aed9c41655 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043393 Aug 06 12:41:01.019235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 631/1310] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:00 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:01.023639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-13f03470-cd33-4da2-a2bc-f65e83b11b95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:01.025780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-13f03470-cd33-4da2-a2bc-f65e83b11b95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:01.031536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13f03470-cd33-4da2-a2bc-f65e83b11b95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:01.032074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13f03470-cd33-4da2-a2bc-f65e83b11b95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:01.032544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13f03470-cd33-4da2-a2bc-f65e83b11b95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:01.033748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13f03470-cd33-4da2-a2bc-f65e83b11b95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:01.034197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13f03470-cd33-4da2-a2bc-f65e83b11b95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:01.034614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13f03470-cd33-4da2-a2bc-f65e83b11b95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:01.062676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-13f03470-cd33-4da2-a2bc-f65e83b11b95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042480 Aug 06 12:41:01.063209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 632/1311] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:01.994650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d49e9782-4207-400a-91ec-93b850348e06 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:01.995305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d49e9782-4207-400a-91ec-93b850348e06 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:02.002441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d49e9782-4207-400a-91ec-93b850348e06 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:02.002932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d49e9782-4207-400a-91ec-93b850348e06 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:02.003366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d49e9782-4207-400a-91ec-93b850348e06 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:02.004055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d49e9782-4207-400a-91ec-93b850348e06 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:02.004542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d49e9782-4207-400a-91ec-93b850348e06 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:02.004967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d49e9782-4207-400a-91ec-93b850348e06 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:02.065067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d49e9782-4207-400a-91ec-93b850348e06 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:02.072454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d49e9782-4207-400a-91ec-93b850348e06 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081700 Aug 06 12:41:02.073006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 633/1312] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:01 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:02.077419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-853aae18-c096-40af-8db2-83a5fd899bae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:02.079491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-853aae18-c096-40af-8db2-83a5fd899bae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:02.085019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-853aae18-c096-40af-8db2-83a5fd899bae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:02.085494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-853aae18-c096-40af-8db2-83a5fd899bae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:02.085920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-853aae18-c096-40af-8db2-83a5fd899bae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:02.086595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-853aae18-c096-40af-8db2-83a5fd899bae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:02.087040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-853aae18-c096-40af-8db2-83a5fd899bae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:02.087453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-853aae18-c096-40af-8db2-83a5fd899bae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:02.115189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-853aae18-c096-40af-8db2-83a5fd899bae tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041235 Aug 06 12:41:02.115720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 634/1313] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:02 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:02.120031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6489a240-d325-4a84-a7d8-753081f55fc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:02.122059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6489a240-d325-4a84-a7d8-753081f55fc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:02.127878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6489a240-d325-4a84-a7d8-753081f55fc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:02.128378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6489a240-d325-4a84-a7d8-753081f55fc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:02.128807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6489a240-d325-4a84-a7d8-753081f55fc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:02.129473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6489a240-d325-4a84-a7d8-753081f55fc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:02.129914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6489a240-d325-4a84-a7d8-753081f55fc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:02.130327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6489a240-d325-4a84-a7d8-753081f55fc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:02.157225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6489a240-d325-4a84-a7d8-753081f55fc0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040582 Aug 06 12:41:02.157776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 635/1314] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:02 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:03.093013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-17a9a24b-354c-471f-8646-39ca8f031d24 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:03.093619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-17a9a24b-354c-471f-8646-39ca8f031d24 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:03.100432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17a9a24b-354c-471f-8646-39ca8f031d24 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:03.100913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17a9a24b-354c-471f-8646-39ca8f031d24 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:03.101344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17a9a24b-354c-471f-8646-39ca8f031d24 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:03.102029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17a9a24b-354c-471f-8646-39ca8f031d24 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:03.102478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17a9a24b-354c-471f-8646-39ca8f031d24 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:03.102898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17a9a24b-354c-471f-8646-39ca8f031d24 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:03.120684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:41:03.163818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-17a9a24b-354c-471f-8646-39ca8f031d24 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:03.171210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-17a9a24b-354c-471f-8646-39ca8f031d24 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082067 Aug 06 12:41:03.171758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 636/1315] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:03 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:03.176183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-898561e0-faa3-4f35-8ba1-0b4a304c9a24 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:03.178299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-898561e0-faa3-4f35-8ba1-0b4a304c9a24 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:03.183688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-898561e0-faa3-4f35-8ba1-0b4a304c9a24 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:03.184160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-898561e0-faa3-4f35-8ba1-0b4a304c9a24 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:03.184630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-898561e0-faa3-4f35-8ba1-0b4a304c9a24 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:03.185306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-898561e0-faa3-4f35-8ba1-0b4a304c9a24 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:03.185754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-898561e0-faa3-4f35-8ba1-0b4a304c9a24 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:03.186169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-898561e0-faa3-4f35-8ba1-0b4a304c9a24 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:03.214970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-898561e0-faa3-4f35-8ba1-0b4a304c9a24 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042207 Aug 06 12:41:03.215508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 637/1316] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:03 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:03.220053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8932e187-f00d-42f7-9c18-7a12afb7e0f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:03.222173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8932e187-f00d-42f7-9c18-7a12afb7e0f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:03.227923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8932e187-f00d-42f7-9c18-7a12afb7e0f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:03.228431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8932e187-f00d-42f7-9c18-7a12afb7e0f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:03.228867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8932e187-f00d-42f7-9c18-7a12afb7e0f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:03.229550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8932e187-f00d-42f7-9c18-7a12afb7e0f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:03.229996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8932e187-f00d-42f7-9c18-7a12afb7e0f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:03.230413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8932e187-f00d-42f7-9c18-7a12afb7e0f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:03.260635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8932e187-f00d-42f7-9c18-7a12afb7e0f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044084 Aug 06 12:41:03.261189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 638/1317] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:04.192078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-be55129c-7044-4c51-b70a-c10e49cfa10c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:04.192733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-be55129c-7044-4c51-b70a-c10e49cfa10c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:04.198947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be55129c-7044-4c51-b70a-c10e49cfa10c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:04.199398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be55129c-7044-4c51-b70a-c10e49cfa10c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:04.199816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be55129c-7044-4c51-b70a-c10e49cfa10c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:04.200520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be55129c-7044-4c51-b70a-c10e49cfa10c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:04.200974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be55129c-7044-4c51-b70a-c10e49cfa10c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:04.201384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be55129c-7044-4c51-b70a-c10e49cfa10c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:04.264109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-be55129c-7044-4c51-b70a-c10e49cfa10c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:04.271889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-be55129c-7044-4c51-b70a-c10e49cfa10c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084368 Aug 06 12:41:04.272488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 639/1318] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:04 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:04.277016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cdc125d8-ad60-4450-afd7-dfdf1251c44c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:04.279158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cdc125d8-ad60-4450-afd7-dfdf1251c44c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:04.285251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdc125d8-ad60-4450-afd7-dfdf1251c44c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:04.285731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdc125d8-ad60-4450-afd7-dfdf1251c44c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:04.286162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdc125d8-ad60-4450-afd7-dfdf1251c44c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:04.286847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdc125d8-ad60-4450-afd7-dfdf1251c44c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:04.287349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdc125d8-ad60-4450-afd7-dfdf1251c44c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:04.287829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdc125d8-ad60-4450-afd7-dfdf1251c44c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:04.316826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cdc125d8-ad60-4450-afd7-dfdf1251c44c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043320 Aug 06 12:41:04.317360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 640/1319] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:04.321751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d9a5e5bf-a2c3-408a-882b-4883a1164337 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:04.323981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d9a5e5bf-a2c3-408a-882b-4883a1164337 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:04.330377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5bf-a2c3-408a-882b-4883a1164337 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:04.330856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5bf-a2c3-408a-882b-4883a1164337 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:04.331287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5bf-a2c3-408a-882b-4883a1164337 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:04.331969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5bf-a2c3-408a-882b-4883a1164337 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:04.332451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5bf-a2c3-408a-882b-4883a1164337 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:04.332882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9a5e5bf-a2c3-408a-882b-4883a1164337 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:04.361886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d9a5e5bf-a2c3-408a-882b-4883a1164337 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043552 Aug 06 12:41:04.362424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 641/1320] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:05.292250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fa2454e7-f2b3-451d-97c4-73ed2de3e6b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:05.293892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fa2454e7-f2b3-451d-97c4-73ed2de3e6b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:05.300520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa2454e7-f2b3-451d-97c4-73ed2de3e6b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:05.301003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa2454e7-f2b3-451d-97c4-73ed2de3e6b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:05.301433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa2454e7-f2b3-451d-97c4-73ed2de3e6b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:05.302142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa2454e7-f2b3-451d-97c4-73ed2de3e6b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:05.302592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa2454e7-f2b3-451d-97c4-73ed2de3e6b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:05.303007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa2454e7-f2b3-451d-97c4-73ed2de3e6b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:05.364422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fa2454e7-f2b3-451d-97c4-73ed2de3e6b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:05.371837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fa2454e7-f2b3-451d-97c4-73ed2de3e6b0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083685 Aug 06 12:41:05.372515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 642/1321] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:05 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:05.377065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e4ee301e-9911-4f90-9d09-031b63bce274 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:05.379701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e4ee301e-9911-4f90-9d09-031b63bce274 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:05.385434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4ee301e-9911-4f90-9d09-031b63bce274 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:05.385939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4ee301e-9911-4f90-9d09-031b63bce274 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:05.386393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4ee301e-9911-4f90-9d09-031b63bce274 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:05.387107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4ee301e-9911-4f90-9d09-031b63bce274 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:05.387547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4ee301e-9911-4f90-9d09-031b63bce274 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:05.387961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4ee301e-9911-4f90-9d09-031b63bce274 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:05.416247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e4ee301e-9911-4f90-9d09-031b63bce274 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042772 Aug 06 12:41:05.416807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 643/1322] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:05 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:05.421189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-706e95d4-d862-488c-9ef4-a09fea95743d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:05.423228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-706e95d4-d862-488c-9ef4-a09fea95743d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:05.429074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-706e95d4-d862-488c-9ef4-a09fea95743d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:05.429547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-706e95d4-d862-488c-9ef4-a09fea95743d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:05.429971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-706e95d4-d862-488c-9ef4-a09fea95743d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:05.430641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-706e95d4-d862-488c-9ef4-a09fea95743d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:05.431082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-706e95d4-d862-488c-9ef4-a09fea95743d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:05.431497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-706e95d4-d862-488c-9ef4-a09fea95743d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:05.459663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-706e95d4-d862-488c-9ef4-a09fea95743d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041911 Aug 06 12:41:05.460192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 644/1323] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:06.392746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8e593710-e0db-474a-8dfa-b6e1a9c066b4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:06.393482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8e593710-e0db-474a-8dfa-b6e1a9c066b4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:06.399801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e593710-e0db-474a-8dfa-b6e1a9c066b4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:06.400275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e593710-e0db-474a-8dfa-b6e1a9c066b4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:06.400727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e593710-e0db-474a-8dfa-b6e1a9c066b4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:06.401398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e593710-e0db-474a-8dfa-b6e1a9c066b4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:06.401842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e593710-e0db-474a-8dfa-b6e1a9c066b4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:06.402256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e593710-e0db-474a-8dfa-b6e1a9c066b4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:06.461921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8e593710-e0db-474a-8dfa-b6e1a9c066b4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:06.469530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8e593710-e0db-474a-8dfa-b6e1a9c066b4 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080622 Aug 06 12:41:06.470077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 645/1324] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:06 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:06.475071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dc2e35a2-63c4-4d13-a199-bf1b503cc8a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:06.477359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dc2e35a2-63c4-4d13-a199-bf1b503cc8a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:06.483165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc2e35a2-63c4-4d13-a199-bf1b503cc8a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:06.483890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc2e35a2-63c4-4d13-a199-bf1b503cc8a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:06.484351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc2e35a2-63c4-4d13-a199-bf1b503cc8a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:06.485038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc2e35a2-63c4-4d13-a199-bf1b503cc8a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:06.485483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc2e35a2-63c4-4d13-a199-bf1b503cc8a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:06.485901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc2e35a2-63c4-4d13-a199-bf1b503cc8a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:06.513887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dc2e35a2-63c4-4d13-a199-bf1b503cc8a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042853 Aug 06 12:41:06.514413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 646/1325] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:06 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:06.518891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b6134b34-4dd5-474a-89c8-e087509c8398 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:06.520939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b6134b34-4dd5-474a-89c8-e087509c8398 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:06.526227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6134b34-4dd5-474a-89c8-e087509c8398 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:06.526719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6134b34-4dd5-474a-89c8-e087509c8398 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:06.527149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6134b34-4dd5-474a-89c8-e087509c8398 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:06.527819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6134b34-4dd5-474a-89c8-e087509c8398 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:06.528267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6134b34-4dd5-474a-89c8-e087509c8398 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:06.528714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6134b34-4dd5-474a-89c8-e087509c8398 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:06.558229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b6134b34-4dd5-474a-89c8-e087509c8398 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042804 Aug 06 12:41:06.558766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 647/1326] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:06 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:07.490852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9580c2d8-432c-4fb2-8731-9d4ed8dc6009 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:07.491482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9580c2d8-432c-4fb2-8731-9d4ed8dc6009 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:07.497817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9580c2d8-432c-4fb2-8731-9d4ed8dc6009 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:07.498288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9580c2d8-432c-4fb2-8731-9d4ed8dc6009 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:07.498713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9580c2d8-432c-4fb2-8731-9d4ed8dc6009 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:07.499389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9580c2d8-432c-4fb2-8731-9d4ed8dc6009 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:07.499833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9580c2d8-432c-4fb2-8731-9d4ed8dc6009 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:07.500249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9580c2d8-432c-4fb2-8731-9d4ed8dc6009 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:07.559984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9580c2d8-432c-4fb2-8731-9d4ed8dc6009 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:07.568124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9580c2d8-432c-4fb2-8731-9d4ed8dc6009 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081579 Aug 06 12:41:07.568722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 648/1327] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:07 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:07.573209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5394c1df-8773-420e-8d40-6d158eb81545 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:07.575302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5394c1df-8773-420e-8d40-6d158eb81545 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:07.580995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5394c1df-8773-420e-8d40-6d158eb81545 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:07.581475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5394c1df-8773-420e-8d40-6d158eb81545 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:07.581905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5394c1df-8773-420e-8d40-6d158eb81545 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:07.582583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5394c1df-8773-420e-8d40-6d158eb81545 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:07.583054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5394c1df-8773-420e-8d40-6d158eb81545 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:07.583470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5394c1df-8773-420e-8d40-6d158eb81545 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:07.611047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5394c1df-8773-420e-8d40-6d158eb81545 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041368 Aug 06 12:41:07.612068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 649/1328] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:07 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:07.616406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1bb1b28-3838-4c03-8850-83cdbd6fc341 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:07.618413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b1bb1b28-3838-4c03-8850-83cdbd6fc341 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:07.623670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1bb1b28-3838-4c03-8850-83cdbd6fc341 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:07.624142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1bb1b28-3838-4c03-8850-83cdbd6fc341 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:07.624605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1bb1b28-3838-4c03-8850-83cdbd6fc341 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:07.625272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1bb1b28-3838-4c03-8850-83cdbd6fc341 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:07.625718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1bb1b28-3838-4c03-8850-83cdbd6fc341 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:07.626138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1bb1b28-3838-4c03-8850-83cdbd6fc341 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:07.653822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b1bb1b28-3838-4c03-8850-83cdbd6fc341 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040777 Aug 06 12:41:07.654349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 650/1329] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:07 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:08.587405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e95cf3e2-8d27-4cf7-a534-217ab93ba8ed tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:08.588026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e95cf3e2-8d27-4cf7-a534-217ab93ba8ed tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:08.594368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e95cf3e2-8d27-4cf7-a534-217ab93ba8ed tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:08.594838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e95cf3e2-8d27-4cf7-a534-217ab93ba8ed tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:08.595266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e95cf3e2-8d27-4cf7-a534-217ab93ba8ed tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:08.596439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e95cf3e2-8d27-4cf7-a534-217ab93ba8ed tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:08.596919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e95cf3e2-8d27-4cf7-a534-217ab93ba8ed tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:08.597335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e95cf3e2-8d27-4cf7-a534-217ab93ba8ed tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:08.659479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e95cf3e2-8d27-4cf7-a534-217ab93ba8ed tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:08.666833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e95cf3e2-8d27-4cf7-a534-217ab93ba8ed tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083276 Aug 06 12:41:08.667381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 651/1330] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:08 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:08.671778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-03c41b81-50ea-4979-b235-8b546ab4ad9a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:08.673882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-03c41b81-50ea-4979-b235-8b546ab4ad9a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:08.679936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03c41b81-50ea-4979-b235-8b546ab4ad9a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:08.680447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03c41b81-50ea-4979-b235-8b546ab4ad9a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:08.680873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03c41b81-50ea-4979-b235-8b546ab4ad9a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:08.681544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03c41b81-50ea-4979-b235-8b546ab4ad9a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:08.681988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03c41b81-50ea-4979-b235-8b546ab4ad9a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:08.682397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03c41b81-50ea-4979-b235-8b546ab4ad9a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:08.709497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-03c41b81-50ea-4979-b235-8b546ab4ad9a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041114 Aug 06 12:41:08.709963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 652/1331] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:08 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:08.714214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c7de48f-294d-4538-bd0a-5b5a91cb5369 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:08.716192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c7de48f-294d-4538-bd0a-5b5a91cb5369 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:08.721971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7de48f-294d-4538-bd0a-5b5a91cb5369 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:08.722438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7de48f-294d-4538-bd0a-5b5a91cb5369 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:08.722862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7de48f-294d-4538-bd0a-5b5a91cb5369 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:08.723522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7de48f-294d-4538-bd0a-5b5a91cb5369 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:08.723963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7de48f-294d-4538-bd0a-5b5a91cb5369 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:08.724398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7de48f-294d-4538-bd0a-5b5a91cb5369 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:08.727802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:41:08.752742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c7de48f-294d-4538-bd0a-5b5a91cb5369 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041807 Aug 06 12:41:08.753272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 653/1332] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:08 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:09.687321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9b97e777-4931-4d3f-a18e-abe1c447f7ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:09.687965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9b97e777-4931-4d3f-a18e-abe1c447f7ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:09.695166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b97e777-4931-4d3f-a18e-abe1c447f7ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:09.695639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b97e777-4931-4d3f-a18e-abe1c447f7ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:09.696066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b97e777-4931-4d3f-a18e-abe1c447f7ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:09.696776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b97e777-4931-4d3f-a18e-abe1c447f7ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:09.697222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b97e777-4931-4d3f-a18e-abe1c447f7ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:09.697633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b97e777-4931-4d3f-a18e-abe1c447f7ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:09.758188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9b97e777-4931-4d3f-a18e-abe1c447f7ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:09.765601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9b97e777-4931-4d3f-a18e-abe1c447f7ea tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082100 Aug 06 12:41:09.766142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 654/1333] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:09 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:09.770567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-204e43a7-6b79-409d-854e-d53d286c208f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:09.772689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-204e43a7-6b79-409d-854e-d53d286c208f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:09.778041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e43a7-6b79-409d-854e-d53d286c208f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:09.778511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e43a7-6b79-409d-854e-d53d286c208f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:09.778938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e43a7-6b79-409d-854e-d53d286c208f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:09.779609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e43a7-6b79-409d-854e-d53d286c208f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:09.780051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e43a7-6b79-409d-854e-d53d286c208f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:09.780496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e43a7-6b79-409d-854e-d53d286c208f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:09.808213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-204e43a7-6b79-409d-854e-d53d286c208f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041112 Aug 06 12:41:09.808768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 655/1334] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:09 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:09.813110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4a9298c2-905a-4799-9c64-bd5ef408f385 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:09.815745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4a9298c2-905a-4799-9c64-bd5ef408f385 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:09.821157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a9298c2-905a-4799-9c64-bd5ef408f385 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:09.821609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a9298c2-905a-4799-9c64-bd5ef408f385 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:09.822031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a9298c2-905a-4799-9c64-bd5ef408f385 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:09.822696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a9298c2-905a-4799-9c64-bd5ef408f385 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:09.823144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a9298c2-905a-4799-9c64-bd5ef408f385 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:09.823557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a9298c2-905a-4799-9c64-bd5ef408f385 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:09.851851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4a9298c2-905a-4799-9c64-bd5ef408f385 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042149 Aug 06 12:41:09.852399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 656/1335] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:10.785790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f6a5cd93-2878-44e6-bc64-c8ffa5c29612 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:10.786389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f6a5cd93-2878-44e6-bc64-c8ffa5c29612 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:10.792778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6a5cd93-2878-44e6-bc64-c8ffa5c29612 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:10.793253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6a5cd93-2878-44e6-bc64-c8ffa5c29612 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:10.793674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6a5cd93-2878-44e6-bc64-c8ffa5c29612 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:10.794346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6a5cd93-2878-44e6-bc64-c8ffa5c29612 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:10.794788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6a5cd93-2878-44e6-bc64-c8ffa5c29612 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:10.795202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f6a5cd93-2878-44e6-bc64-c8ffa5c29612 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:10.855155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f6a5cd93-2878-44e6-bc64-c8ffa5c29612 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:10.863814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f6a5cd93-2878-44e6-bc64-c8ffa5c29612 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081845 Aug 06 12:41:10.864476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 657/1336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:10 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:10.869003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b7ea7e58-876b-47c0-bbab-e8307e00ce1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:10.871084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b7ea7e58-876b-47c0-bbab-e8307e00ce1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:10.876532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ea7e58-876b-47c0-bbab-e8307e00ce1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:10.877003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ea7e58-876b-47c0-bbab-e8307e00ce1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:10.877454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ea7e58-876b-47c0-bbab-e8307e00ce1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:10.878130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ea7e58-876b-47c0-bbab-e8307e00ce1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:10.878568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ea7e58-876b-47c0-bbab-e8307e00ce1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:10.878978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ea7e58-876b-47c0-bbab-e8307e00ce1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:10.908041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b7ea7e58-876b-47c0-bbab-e8307e00ce1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Aug 06 12:41:10.909137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 658/1337] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:10 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:10.913708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-620936d5-556e-472f-bb2f-dfcae3df69da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:10.915794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-620936d5-556e-472f-bb2f-dfcae3df69da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:10.921154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-620936d5-556e-472f-bb2f-dfcae3df69da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:10.921622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-620936d5-556e-472f-bb2f-dfcae3df69da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:10.922047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-620936d5-556e-472f-bb2f-dfcae3df69da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:10.922718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-620936d5-556e-472f-bb2f-dfcae3df69da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:10.923158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-620936d5-556e-472f-bb2f-dfcae3df69da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:10.923572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-620936d5-556e-472f-bb2f-dfcae3df69da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:10.951340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-620936d5-556e-472f-bb2f-dfcae3df69da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041173 Aug 06 12:41:10.951869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 659/1338] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:10 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:11.883630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-02373ad1-e542-4bfe-b16a-dac0825327bf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:11.884329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-02373ad1-e542-4bfe-b16a-dac0825327bf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:11.890703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02373ad1-e542-4bfe-b16a-dac0825327bf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:11.891177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02373ad1-e542-4bfe-b16a-dac0825327bf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:11.891605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02373ad1-e542-4bfe-b16a-dac0825327bf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:11.892288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02373ad1-e542-4bfe-b16a-dac0825327bf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:11.893355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02373ad1-e542-4bfe-b16a-dac0825327bf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:11.893775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02373ad1-e542-4bfe-b16a-dac0825327bf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:11.960217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-02373ad1-e542-4bfe-b16a-dac0825327bf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:11.968747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-02373ad1-e542-4bfe-b16a-dac0825327bf tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.088886 Aug 06 12:41:11.969498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 660/1339] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:11 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:11.973881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-019f2b4f-3a62-4cd2-bdde-2a9fdf9b9efd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:11.976050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-019f2b4f-3a62-4cd2-bdde-2a9fdf9b9efd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:11.982020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-019f2b4f-3a62-4cd2-bdde-2a9fdf9b9efd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:11.982497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-019f2b4f-3a62-4cd2-bdde-2a9fdf9b9efd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:11.982928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-019f2b4f-3a62-4cd2-bdde-2a9fdf9b9efd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:11.983613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-019f2b4f-3a62-4cd2-bdde-2a9fdf9b9efd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:11.984061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-019f2b4f-3a62-4cd2-bdde-2a9fdf9b9efd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:11.984525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-019f2b4f-3a62-4cd2-bdde-2a9fdf9b9efd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:12.013849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-019f2b4f-3a62-4cd2-bdde-2a9fdf9b9efd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Aug 06 12:41:12.014398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 661/1340] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:11 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:12.018823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-61994b03-7965-4a74-846b-c5ce5213103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:12.020928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-61994b03-7965-4a74-846b-c5ce5213103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:12.026347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61994b03-7965-4a74-846b-c5ce5213103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:12.026820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61994b03-7965-4a74-846b-c5ce5213103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:12.027248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61994b03-7965-4a74-846b-c5ce5213103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:12.027927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61994b03-7965-4a74-846b-c5ce5213103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:12.028401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61994b03-7965-4a74-846b-c5ce5213103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:12.028824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61994b03-7965-4a74-846b-c5ce5213103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:12.056489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-61994b03-7965-4a74-846b-c5ce5213103c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041096 Aug 06 12:41:12.057025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 662/1341] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:12 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:12.989218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8ba3416f-caa8-43a2-9b11-1e30bfbe44b9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:12.989833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8ba3416f-caa8-43a2-9b11-1e30bfbe44b9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:12.996235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ba3416f-caa8-43a2-9b11-1e30bfbe44b9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:12.996743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ba3416f-caa8-43a2-9b11-1e30bfbe44b9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:12.997174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ba3416f-caa8-43a2-9b11-1e30bfbe44b9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:12.997869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ba3416f-caa8-43a2-9b11-1e30bfbe44b9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:12.998318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ba3416f-caa8-43a2-9b11-1e30bfbe44b9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:12.998737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ba3416f-caa8-43a2-9b11-1e30bfbe44b9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:13.061030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8ba3416f-caa8-43a2-9b11-1e30bfbe44b9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:13.069072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8ba3416f-caa8-43a2-9b11-1e30bfbe44b9 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083709 Aug 06 12:41:13.069623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 663/1342] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:12 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:13.074050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb52b1dc-8678-4a75-9e6f-305d416d8018 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:13.076167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb52b1dc-8678-4a75-9e6f-305d416d8018 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:13.077808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:41:13.083541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb52b1dc-8678-4a75-9e6f-305d416d8018 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:13.084015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb52b1dc-8678-4a75-9e6f-305d416d8018 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:13.084503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb52b1dc-8678-4a75-9e6f-305d416d8018 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:13.085190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb52b1dc-8678-4a75-9e6f-305d416d8018 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:13.085638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb52b1dc-8678-4a75-9e6f-305d416d8018 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:13.086053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb52b1dc-8678-4a75-9e6f-305d416d8018 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:13.113975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb52b1dc-8678-4a75-9e6f-305d416d8018 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043395 Aug 06 12:41:13.114511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 664/1343] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:13 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:13.118902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6f076167-a502-4436-8075-15ccebad95fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:13.120964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6f076167-a502-4436-8075-15ccebad95fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:13.126298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f076167-a502-4436-8075-15ccebad95fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:13.126766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f076167-a502-4436-8075-15ccebad95fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:13.127692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f076167-a502-4436-8075-15ccebad95fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:13.128409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f076167-a502-4436-8075-15ccebad95fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:13.128849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f076167-a502-4436-8075-15ccebad95fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:13.129268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6f076167-a502-4436-8075-15ccebad95fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:13.157064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6f076167-a502-4436-8075-15ccebad95fd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041609 Aug 06 12:41:13.157598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 665/1344] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:13 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:14.089796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-936a62e9-2419-4f16-b795-4d8906dc57ad tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:14.090416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-936a62e9-2419-4f16-b795-4d8906dc57ad tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:14.097343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936a62e9-2419-4f16-b795-4d8906dc57ad tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:14.097772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936a62e9-2419-4f16-b795-4d8906dc57ad tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:14.098209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936a62e9-2419-4f16-b795-4d8906dc57ad tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:14.098898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936a62e9-2419-4f16-b795-4d8906dc57ad tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:14.099353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936a62e9-2419-4f16-b795-4d8906dc57ad tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:14.099782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936a62e9-2419-4f16-b795-4d8906dc57ad tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:14.160721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-936a62e9-2419-4f16-b795-4d8906dc57ad tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:14.168142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-936a62e9-2419-4f16-b795-4d8906dc57ad tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.082244 Aug 06 12:41:14.168730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 666/1345] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:14 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:14.173180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-45633a31-5645-477e-a55d-9f62611bab67 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:14.175872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-45633a31-5645-477e-a55d-9f62611bab67 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:14.181387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45633a31-5645-477e-a55d-9f62611bab67 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:14.181863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45633a31-5645-477e-a55d-9f62611bab67 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:14.182294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45633a31-5645-477e-a55d-9f62611bab67 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:14.182973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45633a31-5645-477e-a55d-9f62611bab67 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:14.183422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45633a31-5645-477e-a55d-9f62611bab67 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:14.183844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45633a31-5645-477e-a55d-9f62611bab67 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:14.212195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-45633a31-5645-477e-a55d-9f62611bab67 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 Aug 06 12:41:14.212749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 667/1346] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:14 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:14.217055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-496a934c-33d1-4e7a-801e-6809e2e6869a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:14.219052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-496a934c-33d1-4e7a-801e-6809e2e6869a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:14.224988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a934c-33d1-4e7a-801e-6809e2e6869a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:14.225456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a934c-33d1-4e7a-801e-6809e2e6869a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:14.225875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a934c-33d1-4e7a-801e-6809e2e6869a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:14.226538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a934c-33d1-4e7a-801e-6809e2e6869a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:14.227460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a934c-33d1-4e7a-801e-6809e2e6869a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:14.227875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a934c-33d1-4e7a-801e-6809e2e6869a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:14.256338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-496a934c-33d1-4e7a-801e-6809e2e6869a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042604 Aug 06 12:41:14.256872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 668/1347] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:15.189104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ae198d39-d2c2-43e8-b6eb-23e46a3c7e3b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:15.190326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ae198d39-d2c2-43e8-b6eb-23e46a3c7e3b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:15.196830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae198d39-d2c2-43e8-b6eb-23e46a3c7e3b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:15.197307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae198d39-d2c2-43e8-b6eb-23e46a3c7e3b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:15.197757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae198d39-d2c2-43e8-b6eb-23e46a3c7e3b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:15.198426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae198d39-d2c2-43e8-b6eb-23e46a3c7e3b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:15.198877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae198d39-d2c2-43e8-b6eb-23e46a3c7e3b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:15.199301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae198d39-d2c2-43e8-b6eb-23e46a3c7e3b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:15.267367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ae198d39-d2c2-43e8-b6eb-23e46a3c7e3b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:15.270859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:41:15.275936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ae198d39-d2c2-43e8-b6eb-23e46a3c7e3b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.090694 Aug 06 12:41:15.276517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 669/1348] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:15 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:15.280976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-78aa6524-035b-403c-b127-8c1ad309450c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:15.283103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-78aa6524-035b-403c-b127-8c1ad309450c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:15.288851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78aa6524-035b-403c-b127-8c1ad309450c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:15.289325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78aa6524-035b-403c-b127-8c1ad309450c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:15.289748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78aa6524-035b-403c-b127-8c1ad309450c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:15.290422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78aa6524-035b-403c-b127-8c1ad309450c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:15.290865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78aa6524-035b-403c-b127-8c1ad309450c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:15.291274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78aa6524-035b-403c-b127-8c1ad309450c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:15.319841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-78aa6524-035b-403c-b127-8c1ad309450c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 Aug 06 12:41:15.320393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 670/1349] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:15 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:15.324735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ffc1b36f-931b-4e64-8b5c-eb263c6e5a66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:15.326756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ffc1b36f-931b-4e64-8b5c-eb263c6e5a66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:15.332033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffc1b36f-931b-4e64-8b5c-eb263c6e5a66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:15.332540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffc1b36f-931b-4e64-8b5c-eb263c6e5a66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:15.332963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffc1b36f-931b-4e64-8b5c-eb263c6e5a66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:15.333626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffc1b36f-931b-4e64-8b5c-eb263c6e5a66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:15.334065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffc1b36f-931b-4e64-8b5c-eb263c6e5a66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:15.334483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffc1b36f-931b-4e64-8b5c-eb263c6e5a66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:15.368865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ffc1b36f-931b-4e64-8b5c-eb263c6e5a66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047403 Aug 06 12:41:15.369423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 671/1350] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:15 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:16.296228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d0282a2a-406f-4d36-92d0-c129f873e070 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:16.297216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d0282a2a-406f-4d36-92d0-c129f873e070 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:16.303068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0282a2a-406f-4d36-92d0-c129f873e070 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:16.303535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0282a2a-406f-4d36-92d0-c129f873e070 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:16.303954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0282a2a-406f-4d36-92d0-c129f873e070 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:16.304680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0282a2a-406f-4d36-92d0-c129f873e070 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:16.305124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0282a2a-406f-4d36-92d0-c129f873e070 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:16.305537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0282a2a-406f-4d36-92d0-c129f873e070 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:16.365172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d0282a2a-406f-4d36-92d0-c129f873e070 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:16.372547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d0282a2a-406f-4d36-92d0-c129f873e070 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.080278 Aug 06 12:41:16.373091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 672/1351] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:16 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:16.378060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-31680537-a75e-4ef4-8048-de7e9169547f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:16.380161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-31680537-a75e-4ef4-8048-de7e9169547f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:16.385656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31680537-a75e-4ef4-8048-de7e9169547f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:16.386108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31680537-a75e-4ef4-8048-de7e9169547f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:16.386532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31680537-a75e-4ef4-8048-de7e9169547f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:16.387205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31680537-a75e-4ef4-8048-de7e9169547f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:16.387672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31680537-a75e-4ef4-8048-de7e9169547f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:16.388088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31680537-a75e-4ef4-8048-de7e9169547f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:16.416195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-31680537-a75e-4ef4-8048-de7e9169547f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042127 Aug 06 12:41:16.416762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 673/1352] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:16 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:16.421119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-37b3a1d6-4e54-492d-9ed0-df0db3b157fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:16.423138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-37b3a1d6-4e54-492d-9ed0-df0db3b157fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:16.430401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37b3a1d6-4e54-492d-9ed0-df0db3b157fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:16.430925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37b3a1d6-4e54-492d-9ed0-df0db3b157fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:16.431374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37b3a1d6-4e54-492d-9ed0-df0db3b157fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:16.432585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37b3a1d6-4e54-492d-9ed0-df0db3b157fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:16.433195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37b3a1d6-4e54-492d-9ed0-df0db3b157fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:16.433618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37b3a1d6-4e54-492d-9ed0-df0db3b157fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:16.467805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-37b3a1d6-4e54-492d-9ed0-df0db3b157fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050057 Aug 06 12:41:16.468369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 674/1353] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:17.394073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3e860fc3-0d0d-497d-aa17-92019c13f39a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:17.394694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e860fc3-0d0d-497d-aa17-92019c13f39a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:17.400995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e860fc3-0d0d-497d-aa17-92019c13f39a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:17.401463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e860fc3-0d0d-497d-aa17-92019c13f39a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:17.401886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e860fc3-0d0d-497d-aa17-92019c13f39a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:17.402557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e860fc3-0d0d-497d-aa17-92019c13f39a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:17.402999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e860fc3-0d0d-497d-aa17-92019c13f39a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:17.403412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e860fc3-0d0d-497d-aa17-92019c13f39a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:17.466269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3e860fc3-0d0d-497d-aa17-92019c13f39a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:17.473957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3e860fc3-0d0d-497d-aa17-92019c13f39a tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083746 Aug 06 12:41:17.474513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 675/1354] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:17 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:41:17.478922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ef9d0a68-3552-41b5-9ccd-c5ff5bbfc480 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:17.481310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ef9d0a68-3552-41b5-9ccd-c5ff5bbfc480 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:17.487216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a68-3552-41b5-9ccd-c5ff5bbfc480 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:17.487684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a68-3552-41b5-9ccd-c5ff5bbfc480 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:17.488108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a68-3552-41b5-9ccd-c5ff5bbfc480 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:17.488811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a68-3552-41b5-9ccd-c5ff5bbfc480 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:17.489262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a68-3552-41b5-9ccd-c5ff5bbfc480 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:17.489674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef9d0a68-3552-41b5-9ccd-c5ff5bbfc480 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:17.518401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ef9d0a68-3552-41b5-9ccd-c5ff5bbfc480 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042931 Aug 06 12:41:17.518931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 676/1355] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:17 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:17.523234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-88dcfcdb-f6a4-46be-8a98-e5097e10bc5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:17.525259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-88dcfcdb-f6a4-46be-8a98-e5097e10bc5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:17.530564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88dcfcdb-f6a4-46be-8a98-e5097e10bc5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:17.531026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88dcfcdb-f6a4-46be-8a98-e5097e10bc5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:17.531444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88dcfcdb-f6a4-46be-8a98-e5097e10bc5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:17.532110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88dcfcdb-f6a4-46be-8a98-e5097e10bc5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:17.532578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88dcfcdb-f6a4-46be-8a98-e5097e10bc5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:17.533018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88dcfcdb-f6a4-46be-8a98-e5097e10bc5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:17.560270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-88dcfcdb-f6a4-46be-8a98-e5097e10bc5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040420 Aug 06 12:41:17.560817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 677/1356] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:17 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:18.494692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fb80cfb5-89e1-4b59-b394-7b5ccfdae09b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:18.495387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fb80cfb5-89e1-4b59-b394-7b5ccfdae09b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:18.502069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb80cfb5-89e1-4b59-b394-7b5ccfdae09b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:18.502548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb80cfb5-89e1-4b59-b394-7b5ccfdae09b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:18.502978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb80cfb5-89e1-4b59-b394-7b5ccfdae09b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:18.503672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb80cfb5-89e1-4b59-b394-7b5ccfdae09b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:18.504114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb80cfb5-89e1-4b59-b394-7b5ccfdae09b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:18.504556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb80cfb5-89e1-4b59-b394-7b5ccfdae09b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:18.564670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fb80cfb5-89e1-4b59-b394-7b5ccfdae09b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:18.573064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fb80cfb5-89e1-4b59-b394-7b5ccfdae09b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.081374 Aug 06 12:41:18.573064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 678/1357] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:18 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:18.577297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3fb648ac-611c-496a-812d-84d552d6727c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:18.579375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3fb648ac-611c-496a-812d-84d552d6727c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:18.585529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb648ac-611c-496a-812d-84d552d6727c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:18.585999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb648ac-611c-496a-812d-84d552d6727c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:18.586427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb648ac-611c-496a-812d-84d552d6727c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:18.587098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb648ac-611c-496a-812d-84d552d6727c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:18.587539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb648ac-611c-496a-812d-84d552d6727c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:18.587949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb648ac-611c-496a-812d-84d552d6727c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:18.615642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3fb648ac-611c-496a-812d-84d552d6727c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Aug 06 12:41:18.616179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 679/1358] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:18 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:18.683334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-46e1dfe4-de4f-457d-96f2-28c30e509ec0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:18.685461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-46e1dfe4-de4f-457d-96f2-28c30e509ec0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:18.691717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-46e1dfe4-de4f-457d-96f2-28c30e509ec0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:18.692186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-46e1dfe4-de4f-457d-96f2-28c30e509ec0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:18.692633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-46e1dfe4-de4f-457d-96f2-28c30e509ec0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:18.693305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-46e1dfe4-de4f-457d-96f2-28c30e509ec0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:18.693747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-46e1dfe4-de4f-457d-96f2-28c30e509ec0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:18.694162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-46e1dfe4-de4f-457d-96f2-28c30e509ec0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:18.722377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-46e1dfe4-de4f-457d-96f2-28c30e509ec0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105241 Aug 06 12:41:18.722907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 680/1359] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:19.593582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-77118c11-27a2-4b0d-b735-9ed16f57568e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:19.594366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-77118c11-27a2-4b0d-b735-9ed16f57568e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:19.601682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77118c11-27a2-4b0d-b735-9ed16f57568e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:19.602353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77118c11-27a2-4b0d-b735-9ed16f57568e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:19.602904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77118c11-27a2-4b0d-b735-9ed16f57568e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:19.603608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77118c11-27a2-4b0d-b735-9ed16f57568e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:19.604058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77118c11-27a2-4b0d-b735-9ed16f57568e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:19.604517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77118c11-27a2-4b0d-b735-9ed16f57568e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:19.667059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-77118c11-27a2-4b0d-b735-9ed16f57568e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:19.674700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-77118c11-27a2-4b0d-b735-9ed16f57568e tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.085215 Aug 06 12:41:19.675275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 681/1360] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:19 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:41:19.679801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-614a935b-9f57-4f90-b35b-3b92be93ed55 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:19.681953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-614a935b-9f57-4f90-b35b-3b92be93ed55 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:19.687693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-614a935b-9f57-4f90-b35b-3b92be93ed55 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:19.688172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-614a935b-9f57-4f90-b35b-3b92be93ed55 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:19.688636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-614a935b-9f57-4f90-b35b-3b92be93ed55 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:19.689319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-614a935b-9f57-4f90-b35b-3b92be93ed55 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:19.689765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-614a935b-9f57-4f90-b35b-3b92be93ed55 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:19.690184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-614a935b-9f57-4f90-b35b-3b92be93ed55 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:19.719343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-614a935b-9f57-4f90-b35b-3b92be93ed55 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043048 Aug 06 12:41:19.719905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 682/1361] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:19 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:19.734161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-737158dc-7a7b-4a6b-a92c-f68f5b85a03c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:19.736499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-737158dc-7a7b-4a6b-a92c-f68f5b85a03c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:19.742344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-737158dc-7a7b-4a6b-a92c-f68f5b85a03c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:19.742819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-737158dc-7a7b-4a6b-a92c-f68f5b85a03c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:19.743311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-737158dc-7a7b-4a6b-a92c-f68f5b85a03c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:19.743989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-737158dc-7a7b-4a6b-a92c-f68f5b85a03c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:19.744463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-737158dc-7a7b-4a6b-a92c-f68f5b85a03c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:19.744876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-737158dc-7a7b-4a6b-a92c-f68f5b85a03c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:19.774034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-737158dc-7a7b-4a6b-a92c-f68f5b85a03c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043806 Aug 06 12:41:19.774579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 683/1362] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 12:41:20.695219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-970c69af-00f4-4fe0-8c19-fa7f986d4202 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:20.695878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-970c69af-00f4-4fe0-8c19-fa7f986d4202 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:20.702229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-970c69af-00f4-4fe0-8c19-fa7f986d4202 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:20.702709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-970c69af-00f4-4fe0-8c19-fa7f986d4202 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:20.703140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-970c69af-00f4-4fe0-8c19-fa7f986d4202 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:20.703855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-970c69af-00f4-4fe0-8c19-fa7f986d4202 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:20.704326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-970c69af-00f4-4fe0-8c19-fa7f986d4202 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:20.704749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-970c69af-00f4-4fe0-8c19-fa7f986d4202 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:20.767280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-970c69af-00f4-4fe0-8c19-fa7f986d4202 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:20.774759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-970c69af-00f4-4fe0-8c19-fa7f986d4202 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083452 Aug 06 12:41:20.775412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 684/1363] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:20 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:41:20.780585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-455e34ea-6c48-46de-b19f-d94ee31fde9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:20.782406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-455e34ea-6c48-46de-b19f-d94ee31fde9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:20.790284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455e34ea-6c48-46de-b19f-d94ee31fde9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:20.790776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455e34ea-6c48-46de-b19f-d94ee31fde9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:20.791209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455e34ea-6c48-46de-b19f-d94ee31fde9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:20.791902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455e34ea-6c48-46de-b19f-d94ee31fde9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:20.792387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455e34ea-6c48-46de-b19f-d94ee31fde9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:20.792828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-455e34ea-6c48-46de-b19f-d94ee31fde9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:20.824509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-455e34ea-6c48-46de-b19f-d94ee31fde9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048018 Aug 06 12:41:20.825084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 685/1364] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:20 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:20.829862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8ae7c6d2-e28a-40d4-bd4e-96ee97fff674 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:20.832508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8ae7c6d2-e28a-40d4-bd4e-96ee97fff674 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:20.838249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae7c6d2-e28a-40d4-bd4e-96ee97fff674 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:20.838726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae7c6d2-e28a-40d4-bd4e-96ee97fff674 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:20.839160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae7c6d2-e28a-40d4-bd4e-96ee97fff674 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:20.839853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae7c6d2-e28a-40d4-bd4e-96ee97fff674 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:20.840324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae7c6d2-e28a-40d4-bd4e-96ee97fff674 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:20.840750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae7c6d2-e28a-40d4-bd4e-96ee97fff674 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:20.857972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:41:20.872161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8ae7c6d2-e28a-40d4-bd4e-96ee97fff674 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046108 Aug 06 12:41:20.872762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 686/1365] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:21.796209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dca2d390-a43b-48db-a274-80727919145c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:21.796889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dca2d390-a43b-48db-a274-80727919145c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:21.803305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dca2d390-a43b-48db-a274-80727919145c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:21.803781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dca2d390-a43b-48db-a274-80727919145c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:21.804211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dca2d390-a43b-48db-a274-80727919145c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:21.804930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dca2d390-a43b-48db-a274-80727919145c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:21.805385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dca2d390-a43b-48db-a274-80727919145c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:21.805807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dca2d390-a43b-48db-a274-80727919145c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:21.868902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dca2d390-a43b-48db-a274-80727919145c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:41:21.876518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dca2d390-a43b-48db-a274-80727919145c tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.084144 Aug 06 12:41:21.877082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 687/1366] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:41:21 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:41:21.881669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dbcb41a6-f6b5-4264-a21a-007d33a14dcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:21.884383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dbcb41a6-f6b5-4264-a21a-007d33a14dcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:21.889524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbcb41a6-f6b5-4264-a21a-007d33a14dcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:21.890005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbcb41a6-f6b5-4264-a21a-007d33a14dcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:21.890443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbcb41a6-f6b5-4264-a21a-007d33a14dcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:21.891135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbcb41a6-f6b5-4264-a21a-007d33a14dcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:21.891583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbcb41a6-f6b5-4264-a21a-007d33a14dcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:21.892539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbcb41a6-f6b5-4264-a21a-007d33a14dcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:21.921997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dbcb41a6-f6b5-4264-a21a-007d33a14dcd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Aug 06 12:41:21.922559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 688/1367] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:41:21 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:41:21.927050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-39b0b577-3516-449f-b0d6-89c82822b1b3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:21.929170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-39b0b577-3516-449f-b0d6-89c82822b1b3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:21.934714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b0b577-3516-449f-b0d6-89c82822b1b3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:21.935187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b0b577-3516-449f-b0d6-89c82822b1b3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:21.935616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b0b577-3516-449f-b0d6-89c82822b1b3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:21.936318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b0b577-3516-449f-b0d6-89c82822b1b3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:21.936771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b0b577-3516-449f-b0d6-89c82822b1b3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:21.937188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-39b0b577-3516-449f-b0d6-89c82822b1b3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:21.965883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-39b0b577-3516-449f-b0d6-89c82822b1b3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042288 Aug 06 12:41:21.966634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 689/1368] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:41:21 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:41:22.761545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:41:22.762027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:41:22.767955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:22.768457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:22.768885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:22.769560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:41:22.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:41:22.770420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:41:32.766117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=53 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:41:32.787542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=24 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:41:56.728716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:41:56.729449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:41:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa (ip 10.222.0.20) !!! Aug 06 12:41:57.688627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:41:57.689200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:41:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa (ip 10.222.0.20) !!! Aug 06 12:42:03.502705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:42:03.503333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa (ip 10.222.0.20) !!! Aug 06 12:42:22.839538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3f77e308-34b0-40e5-9672-9668888e3ff0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa" status: 202 len: 0 microversion: 2.1 time: 120.128433 Aug 06 12:42:22.840350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 680/1369] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:40:22 2022] DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa => generated 0 bytes in 120130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:42:22.847228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ef3b28c2-839e-46b4-9e2c-0796387fe219 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:42:22.847923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ef3b28c2-839e-46b4-9e2c-0796387fe219 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:42:22.854590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef3b28c2-839e-46b4-9e2c-0796387fe219 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:42:22.855147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef3b28c2-839e-46b4-9e2c-0796387fe219 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:42:22.855646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef3b28c2-839e-46b4-9e2c-0796387fe219 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:42:22.856681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef3b28c2-839e-46b4-9e2c-0796387fe219 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:42:22.857576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef3b28c2-839e-46b4-9e2c-0796387fe219 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:42:22.857997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef3b28c2-839e-46b4-9e2c-0796387fe219 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:42:22.930257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ef3b28c2-839e-46b4-9e2c-0796387fe219 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:42:22.938965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'services' on Instance uuid 7a8a8915-eeca-4909-aab7-6fe8381ced6e {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:42:22.939480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ef3b28c2-839e-46b4-9e2c-0796387fe219 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.097517 Aug 06 12:42:22.952114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 681/1370] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:42:22 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:42:22.952114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ea258b86-f791-4784-a047-c8cdd0b54cfe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:42:22.952114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ea258b86-f791-4784-a047-c8cdd0b54cfe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:42:22.954105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea258b86-f791-4784-a047-c8cdd0b54cfe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:42:22.954763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea258b86-f791-4784-a047-c8cdd0b54cfe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:42:22.955258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea258b86-f791-4784-a047-c8cdd0b54cfe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:42:22.956017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea258b86-f791-4784-a047-c8cdd0b54cfe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:42:22.957005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea258b86-f791-4784-a047-c8cdd0b54cfe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:42:22.957491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea258b86-f791-4784-a047-c8cdd0b54cfe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:42:22.987861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ea258b86-f791-4784-a047-c8cdd0b54cfe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046761 Aug 06 12:42:22.988522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 682/1371] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:42:22 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:42:22.993045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5865e397-5a5d-4eb3-bb36-88b47266f04b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:42:22.995328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5865e397-5a5d-4eb3-bb36-88b47266f04b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:42:23.001302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5865e397-5a5d-4eb3-bb36-88b47266f04b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:42:23.001775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5865e397-5a5d-4eb3-bb36-88b47266f04b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:42:23.002203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5865e397-5a5d-4eb3-bb36-88b47266f04b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:42:23.002915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5865e397-5a5d-4eb3-bb36-88b47266f04b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:42:23.003359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5865e397-5a5d-4eb3-bb36-88b47266f04b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:42:23.003774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5865e397-5a5d-4eb3-bb36-88b47266f04b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:42:23.040943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5865e397-5a5d-4eb3-bb36-88b47266f04b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051403 Aug 06 12:42:23.042147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 683/1372] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:42:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:42:23.046752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:42:23.047234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:42:23.052583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:42:23.053062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:42:23.053498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:42:23.054176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:42:23.054631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:42:23.055053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:42:32.951501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:42:33.050924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=8 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:42:33.071918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:42:45.413483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6b8040e-4fae-4b46-948b-66ad7eba526c) Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa HTTP/1.1 Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:42:45.415778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:42:45.417302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:42:45.417302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:42:45.417302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:42:45.417302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:42:45.417302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:42:45.417302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:42:45.417302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:42:45.417302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 12:42:45.417302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:42:45.417302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6b8040e-4fae-4b46-948b-66ad7eba526c) Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': '7a8a8915-eeca-4909-aab7-6fe8381ced6e', 'id': 'd1b59212-9312-4893-97c3-6c27d1ef81aa'} Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:42:45.418434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6b8040e-4fae-4b46-948b-66ad7eba526c) Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:42:45.420659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6b8040e-4fae-4b46-948b-66ad7eba526c) Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:42:45.422075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6b8040e-4fae-4b46-948b-66ad7eba526c) Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:42:45.423262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6b8040e-4fae-4b46-948b-66ad7eba526c) Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6b8040e-4fae-4b46-948b-66ad7eba526c) Aug 06 12:42:45.424638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:42:45.425906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6b8040e-4fae-4b46-948b-66ad7eba526c) {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:42:45.425906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-705d5168-a19a-4e56-af20-edf701fb3bd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa" status: 400 len: 269 microversion: 2.1 time: 82.659695 Aug 06 12:42:45.425906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 690/1373] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:41:22 2022] DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa => generated 269 bytes in 82661 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 12:42:45.426190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ee3288cb-d7c1-42d6-b48c-f6e17cf17582 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:42:45.426432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ee3288cb-d7c1-42d6-b48c-f6e17cf17582 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:42:45.432317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee3288cb-d7c1-42d6-b48c-f6e17cf17582 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:42:45.432971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee3288cb-d7c1-42d6-b48c-f6e17cf17582 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:42:45.433531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee3288cb-d7c1-42d6-b48c-f6e17cf17582 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:42:45.434251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee3288cb-d7c1-42d6-b48c-f6e17cf17582 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:42:45.434702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee3288cb-d7c1-42d6-b48c-f6e17cf17582 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:42:45.435125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee3288cb-d7c1-42d6-b48c-f6e17cf17582 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:42:45.462361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'services' on Instance uuid 7a8a8915-eeca-4909-aab7-6fe8381ced6e {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:42:55.429673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:42:55.453618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:42:55.466863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:43:41.052256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:43:41.052730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:43:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 (ip 10.222.0.20) !!! Aug 06 12:44:02.796792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:44:02.797503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:44:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 (ip 10.222.0.20) !!! Aug 06 12:44:23.286543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-ee3288cb-d7c1-42d6-b48c-f6e17cf17582 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'services' on Instance uuid e5982553-7c7c-4d67-bb7e-13ac69cfc674 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:44:23.314130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fa02e7-838b-4cd3-a322-92246bb1ec03) Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa HTTP/1.1 Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:44:23.316486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:44:23.317929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:44:23.317929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:44:23.317929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:44:23.317929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:44:23.317929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:44:23.317929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:44:23.317929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:44:23.317929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 12:44:23.317929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:44:23.317929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fa02e7-838b-4cd3-a322-92246bb1ec03) Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '7a8a8915-eeca-4909-aab7-6fe8381ced6e', 'id': 'd1b59212-9312-4893-97c3-6c27d1ef81aa'} Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:44:23.318578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fa02e7-838b-4cd3-a322-92246bb1ec03) Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:44:23.320567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fa02e7-838b-4cd3-a322-92246bb1ec03) Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:44:23.321756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fa02e7-838b-4cd3-a322-92246bb1ec03) Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:44:23.322789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fa02e7-838b-4cd3-a322-92246bb1ec03) Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fa02e7-838b-4cd3-a322-92246bb1ec03) Aug 06 12:44:23.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:44:23.325155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f1fa02e7-838b-4cd3-a322-92246bb1ec03) {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:44:23.325155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4004fbd5-dddb-4a8d-991e-e20ff00a1454 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa" status: 400 len: 269 microversion: 2.1 time: 120.274842 Aug 06 12:44:23.325155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 684/1374] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:42:23 2022] DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa => generated 269 bytes in 120276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:44:23.325155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-80605050-e4d7-4f4d-afb4-2895819baf71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:44:23.326939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-80605050-e4d7-4f4d-afb4-2895819baf71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:44:23.332806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80605050-e4d7-4f4d-afb4-2895819baf71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:44:23.333280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80605050-e4d7-4f4d-afb4-2895819baf71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:44:23.333707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80605050-e4d7-4f4d-afb4-2895819baf71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:44:23.334382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80605050-e4d7-4f4d-afb4-2895819baf71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:44:23.334826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80605050-e4d7-4f4d-afb4-2895819baf71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:44:23.335242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80605050-e4d7-4f4d-afb4-2895819baf71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:44:23.365607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-80605050-e4d7-4f4d-afb4-2895819baf71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045973 Aug 06 12:44:23.366372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 685/1375] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:44:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:44:23.370921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3c4bbdd6-095e-4bda-8934-b171793b1931 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:44:23.373113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3c4bbdd6-095e-4bda-8934-b171793b1931 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:44:23.378733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c4bbdd6-095e-4bda-8934-b171793b1931 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:44:23.379201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c4bbdd6-095e-4bda-8934-b171793b1931 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:44:23.379628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c4bbdd6-095e-4bda-8934-b171793b1931 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:44:23.380322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c4bbdd6-095e-4bda-8934-b171793b1931 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:44:23.380774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c4bbdd6-095e-4bda-8934-b171793b1931 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:44:23.381198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c4bbdd6-095e-4bda-8934-b171793b1931 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:44:23.410138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3c4bbdd6-095e-4bda-8934-b171793b1931 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042758 Aug 06 12:44:23.410691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 686/1376] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:44:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:44:23.597111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c218872c-b66b-4e8c-a7c5-e996643284f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:44:23.597718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c218872c-b66b-4e8c-a7c5-e996643284f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:44:23.603653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c218872c-b66b-4e8c-a7c5-e996643284f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:44:23.604122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c218872c-b66b-4e8c-a7c5-e996643284f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:44:23.604584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c218872c-b66b-4e8c-a7c5-e996643284f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:44:23.605277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c218872c-b66b-4e8c-a7c5-e996643284f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:44:23.605731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c218872c-b66b-4e8c-a7c5-e996643284f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:44:23.606229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c218872c-b66b-4e8c-a7c5-e996643284f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:44:23.668001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c218872c-b66b-4e8c-a7c5-e996643284f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:44:23.675581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c218872c-b66b-4e8c-a7c5-e996643284f0 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.263827 Aug 06 12:44:23.676136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 687/1377] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:44:23 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:44:23.681546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:44:23.682026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:44:23.687432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:44:23.687899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:44:23.688344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:44:23.689020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:44:23.689465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:44:23.689877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:44:33.290647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:44:33.685318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=8 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:44:33.711069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=22 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:44:45.575680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ee3288cb-d7c1-42d6-b48c-f6e17cf17582 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11" status: 202 len: 0 microversion: 2.1 time: 120.156783 Aug 06 12:44:45.576484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 691/1378] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:42:45 2022] DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 => generated 0 bytes in 120158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:44:45.582391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:44:45.582966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:44:45.589069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:44:45.589552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:44:45.590322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:44:45.590673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:44:45.591120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:44:45.591545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:44:45.611912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'services' on Instance uuid 7a8a8915-eeca-4909-aab7-6fe8381ced6e {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:44:55.587205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:44:55.611695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:44:55.623898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:45:16.737169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:45:16.737736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 (ip 10.222.0.20) !!! Aug 06 12:45:17.696813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:45:17.697351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa (ip 10.222.0.20) !!! Aug 06 12:45:23.511495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:45:23.512193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:45:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa (ip 10.222.0.20) !!! Aug 06 12:45:42.329508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:45:42.330116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:45:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa (ip 10.222.0.20) !!! Aug 06 12:46:23.610760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'services' on Instance uuid e5982553-7c7c-4d67-bb7e-13ac69cfc674 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:46:23.789794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b1a148a1-a2e3-46a5-8b1f-0947916a0f2a) Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa HTTP/1.1 Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:46:23.792011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:46:23.793620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:46:23.793620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:23.793620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:46:23.793620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:23.793620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:46:23.793620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:46:23.793620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:46:23.793620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 12:46:23.793620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:46:23.793620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b1a148a1-a2e3-46a5-8b1f-0947916a0f2a) Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '7a8a8915-eeca-4909-aab7-6fe8381ced6e', 'id': 'd1b59212-9312-4893-97c3-6c27d1ef81aa'} Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:23.794554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b1a148a1-a2e3-46a5-8b1f-0947916a0f2a) Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:23.795932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b1a148a1-a2e3-46a5-8b1f-0947916a0f2a) Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:23.797379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b1a148a1-a2e3-46a5-8b1f-0947916a0f2a) Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:23.798918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b1a148a1-a2e3-46a5-8b1f-0947916a0f2a) Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b1a148a1-a2e3-46a5-8b1f-0947916a0f2a) Aug 06 12:46:23.800267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.804115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b1a148a1-a2e3-46a5-8b1f-0947916a0f2a) {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:46:23.804115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dfd86651-3dc5-4945-9519-9b54f256063b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa" status: 400 len: 269 microversion: 2.1 time: 120.116357 Aug 06 12:46:23.804115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 688/1379] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:44:23 2022] DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa => generated 269 bytes in 120118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:46:23.830998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42c36180-0d4a-4f85-b289-6b84c9bfe137) Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Request method failure captured: Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 HTTP/1.1 Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l963ks7Y3fjt37ybAlnEYdBJkWrtwFTWydRERg2t_6bOTX4B7a_gup8czlaU-40oPKqUTj-e042VO0Q93KC9u6lgBhkQcftj6bBUmCzh4rhn9qoXOerhdvlr7uGqcmyNjXwy_RqcZUzRWmFC57t7kl3pwMgOy4uOB7hnUq62U8lhWs Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 94cc3ab0fa2d47008fc45f600ff1613a Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:46:23.833955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:46:23.835551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:46:23.835551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:23.835551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 94cc3ab0fa2d47008fc45f600ff1613a Aug 06 12:46:23.835551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:23.835551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesSnapshotTestJSON-1038996424-project Aug 06 12:46:23.835551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:46:23.835551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:46:23.835551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 3fc91d2e9cd24694a5aa62e9d579c8e0 Aug 06 12:46:23.835551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesSnapshotTestJSON-1038996424-project Aug 06 12:46:23.835551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42c36180-0d4a-4f85-b289-6b84c9bfe137) Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': 'e5982553-7c7c-4d67-bb7e-13ac69cfc674', 'id': '66abc00e-688e-4559-8736-77410a760e11'} Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:23.836292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42c36180-0d4a-4f85-b289-6b84c9bfe137) Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:23.837524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42c36180-0d4a-4f85-b289-6b84c9bfe137) Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:23.839552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42c36180-0d4a-4f85-b289-6b84c9bfe137) Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:23.840959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42c36180-0d4a-4f85-b289-6b84c9bfe137) Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42c36180-0d4a-4f85-b289-6b84c9bfe137) Aug 06 12:46:23.842444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:23.843953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42c36180-0d4a-4f85-b289-6b84c9bfe137) {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:46:23.843953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a4126c5a-4c6a-498f-b3f9-4b776b7e9931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11" status: 400 len: 269 microversion: 2.1 time: 98.259666 Aug 06 12:46:23.843953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 692/1380] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:44:45 2022] DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 => generated 269 bytes in 98262 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:46:23.918838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6b7926ca-5be2-49c7-8031-bf4221b08eec tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:23.921548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6b7926ca-5be2-49c7-8031-bf4221b08eec tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:23.927655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7926ca-5be2-49c7-8031-bf4221b08eec tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:23.928234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7926ca-5be2-49c7-8031-bf4221b08eec tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:23.928768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7926ca-5be2-49c7-8031-bf4221b08eec tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:23.929533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7926ca-5be2-49c7-8031-bf4221b08eec tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:23.930017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7926ca-5be2-49c7-8031-bf4221b08eec tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:23.930449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7926ca-5be2-49c7-8031-bf4221b08eec tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:23.961065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6b7926ca-5be2-49c7-8031-bf4221b08eec tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165745 Aug 06 12:46:23.961717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 689/1381] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:23.963165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-babefcf1-7365-4374-997d-c9ab7f0b1202 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:23.965578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-babefcf1-7365-4374-997d-c9ab7f0b1202 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:23.966278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-35376f19-bff9-4e3b-a262-37e806462b93 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:23.966956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-35376f19-bff9-4e3b-a262-37e806462b93 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:23.972324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-babefcf1-7365-4374-997d-c9ab7f0b1202 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:23.972655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35376f19-bff9-4e3b-a262-37e806462b93 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:23.972807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-babefcf1-7365-4374-997d-c9ab7f0b1202 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:23.973237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-babefcf1-7365-4374-997d-c9ab7f0b1202 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:23.973366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35376f19-bff9-4e3b-a262-37e806462b93 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:23.973744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35376f19-bff9-4e3b-a262-37e806462b93 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:23.973993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-babefcf1-7365-4374-997d-c9ab7f0b1202 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:23.974432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35376f19-bff9-4e3b-a262-37e806462b93 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:23.974542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-babefcf1-7365-4374-997d-c9ab7f0b1202 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:23.974851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-babefcf1-7365-4374-997d-c9ab7f0b1202 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:23.974945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35376f19-bff9-4e3b-a262-37e806462b93 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:23.975300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35376f19-bff9-4e3b-a262-37e806462b93 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.005070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-babefcf1-7365-4374-997d-c9ab7f0b1202 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.164806 Aug 06 12:46:24.005581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 693/1382] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:46:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:46:24.010574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:24.011061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:24.017442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.017924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.018358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.019611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.020067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.020521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.039247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-35376f19-bff9-4e3b-a262-37e806462b93 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:46:24.046669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-35376f19-bff9-4e3b-a262-37e806462b93 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.083917 Aug 06 12:46:24.047252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 690/1383] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:46:23 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:46:24.051927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:24.052438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:24.058051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.058607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.059112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.059860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.060331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.060755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.101040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'services' on Instance uuid 7a8a8915-eeca-4909-aab7-6fe8381ced6e {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:46:24.146667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'services' on Instance uuid e5982553-7c7c-4d67-bb7e-13ac69cfc674 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:46:24.214814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b8db895-2d71-4e70-88f0-695c0ec737e2) Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa HTTP/1.1 Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:46:24.217034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:46:24.218578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:46:24.218578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:24.218578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:46:24.218578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:24.218578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:46:24.218578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:46:24.218578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:46:24.218578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 12:46:24.218578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:46:24.218578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b8db895-2d71-4e70-88f0-695c0ec737e2) Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': '7a8a8915-eeca-4909-aab7-6fe8381ced6e', 'id': 'd1b59212-9312-4893-97c3-6c27d1ef81aa'} Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:24.219548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b8db895-2d71-4e70-88f0-695c0ec737e2) Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:24.220802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b8db895-2d71-4e70-88f0-695c0ec737e2) Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:24.222378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b8db895-2d71-4e70-88f0-695c0ec737e2) Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:24.223817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b8db895-2d71-4e70-88f0-695c0ec737e2) Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b8db895-2d71-4e70-88f0-695c0ec737e2) Aug 06 12:46:24.225135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.226442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b8db895-2d71-4e70-88f0-695c0ec737e2) {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:46:24.226442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c91806bf-ae0a-4137-b52a-f1a61d3db119 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa" status: 400 len: 269 microversion: 2.1 time: 0.211772 Aug 06 12:46:24.226442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 694/1384] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:46:24 2022] DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa => generated 269 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:46:24.226442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a91202c6-6e93-4e63-a0b2-6eea57c8c35f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:24.226791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a91202c6-6e93-4e63-a0b2-6eea57c8c35f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:24.231500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a91202c6-6e93-4e63-a0b2-6eea57c8c35f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.231974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a91202c6-6e93-4e63-a0b2-6eea57c8c35f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.232434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a91202c6-6e93-4e63-a0b2-6eea57c8c35f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.233120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a91202c6-6e93-4e63-a0b2-6eea57c8c35f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.233566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a91202c6-6e93-4e63-a0b2-6eea57c8c35f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.233973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a91202c6-6e93-4e63-a0b2-6eea57c8c35f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.250808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65bed123-a441-42ab-a6fd-8b83641a9111) Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Request method failure captured: Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 HTTP/1.1 Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l963ks7Y3fjt37ybAlnEYdBJkWrtwFTWydRERg2t_6bOTX4B7a_gup8czlaU-40oPKqUTj-e042VO0Q93KC9u6lgBhkQcftj6bBUmCzh4rhn9qoXOerhdvlr7uGqcmyNjXwy_RqcZUzRWmFC57t7kl3pwMgOy4uOB7hnUq62U8lhWs Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 94cc3ab0fa2d47008fc45f600ff1613a Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:46:24.252977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:46:24.254850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:46:24.254850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:24.254850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 94cc3ab0fa2d47008fc45f600ff1613a Aug 06 12:46:24.254850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:24.254850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotTestJSON-1038996424-project Aug 06 12:46:24.254850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:46:24.254850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:46:24.254850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 3fc91d2e9cd24694a5aa62e9d579c8e0 Aug 06 12:46:24.254850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotTestJSON-1038996424-project Aug 06 12:46:24.254850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65bed123-a441-42ab-a6fd-8b83641a9111) Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'server_id': 'e5982553-7c7c-4d67-bb7e-13ac69cfc674', 'id': '66abc00e-688e-4559-8736-77410a760e11'} Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:24.255498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65bed123-a441-42ab-a6fd-8b83641a9111) Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:24.256629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65bed123-a441-42ab-a6fd-8b83641a9111) Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:24.258622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65bed123-a441-42ab-a6fd-8b83641a9111) Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:24.260641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65bed123-a441-42ab-a6fd-8b83641a9111) Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65bed123-a441-42ab-a6fd-8b83641a9111) Aug 06 12:46:24.262733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:24.265361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-65bed123-a441-42ab-a6fd-8b83641a9111) {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:46:24.265361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-562ab4b9-0926-4b50-8eb9-0e22dbbd0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11" status: 400 len: 269 microversion: 2.1 time: 0.207057 Aug 06 12:46:24.265361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 691/1385] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:46:24 2022] DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 => generated 269 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:46:24.265361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d22f6a4-8660-4c27-92fa-e9a89c9dd2d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:24.265905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3d22f6a4-8660-4c27-92fa-e9a89c9dd2d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:24.270085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d22f6a4-8660-4c27-92fa-e9a89c9dd2d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.270786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d22f6a4-8660-4c27-92fa-e9a89c9dd2d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.271478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d22f6a4-8660-4c27-92fa-e9a89c9dd2d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.272467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d22f6a4-8660-4c27-92fa-e9a89c9dd2d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.273073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d22f6a4-8660-4c27-92fa-e9a89c9dd2d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.273694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d22f6a4-8660-4c27-92fa-e9a89c9dd2d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.274525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a91202c6-6e93-4e63-a0b2-6eea57c8c35f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054395 Aug 06 12:46:24.275095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 695/1386] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:24.280053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f120d341-861b-49ab-a406-d6b1abf319bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:24.282342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f120d341-861b-49ab-a406-d6b1abf319bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:24.288159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f120d341-861b-49ab-a406-d6b1abf319bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.289129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f120d341-861b-49ab-a406-d6b1abf319bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.289297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f120d341-861b-49ab-a406-d6b1abf319bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.289972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f120d341-861b-49ab-a406-d6b1abf319bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.290432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f120d341-861b-49ab-a406-d6b1abf319bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.290853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f120d341-861b-49ab-a406-d6b1abf319bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.307851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3d22f6a4-8660-4c27-92fa-e9a89c9dd2d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050615 Aug 06 12:46:24.308980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 692/1387] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:46:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:46:24.313863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-79cb2939-b585-40d7-9060-133c1760403b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:24.314461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-79cb2939-b585-40d7-9060-133c1760403b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:24.321022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79cb2939-b585-40d7-9060-133c1760403b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.321506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79cb2939-b585-40d7-9060-133c1760403b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.321948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79cb2939-b585-40d7-9060-133c1760403b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.323589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79cb2939-b585-40d7-9060-133c1760403b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.323589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79cb2939-b585-40d7-9060-133c1760403b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.323808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f120d341-861b-49ab-a406-d6b1abf319bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047014 Aug 06 12:46:24.323898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79cb2939-b585-40d7-9060-133c1760403b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.324230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 696/1388] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:24 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:24.330660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:24.330660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:24.336820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.337405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.337917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.338759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.339284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.339721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.393772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-79cb2939-b585-40d7-9060-133c1760403b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:46:24.401228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-79cb2939-b585-40d7-9060-133c1760403b tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1226 microversion: 2.1 time: 0.091124 Aug 06 12:46:24.401780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 693/1389] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:46:24 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:46:24.406256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:24.406735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:24.412082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.412591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.413016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:24.413687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:24.414131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:24.414546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:34.332858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=10 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:46:34.357922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=34 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:46:34.410187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=12 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:46:34.432453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=36 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:46:45.690892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'services' on Instance uuid 7a8a8915-eeca-4909-aab7-6fe8381ced6e {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:46:45.734397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'services' on Instance uuid e5982553-7c7c-4d67-bb7e-13ac69cfc674 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:46:45.767721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bac9f042-dd50-4412-ba7a-bc7b29b571fc) Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa HTTP/1.1 Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:46:45.770004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:46:45.771307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:46:45.771307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:45.771307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:46:45.771307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:45.771307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:46:45.771307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:46:45.771307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:46:45.771307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 12:46:45.771307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:46:45.771307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bac9f042-dd50-4412-ba7a-bc7b29b571fc) Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': '7a8a8915-eeca-4909-aab7-6fe8381ced6e', 'id': 'd1b59212-9312-4893-97c3-6c27d1ef81aa'} Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:45.771908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bac9f042-dd50-4412-ba7a-bc7b29b571fc) Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:45.773389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bac9f042-dd50-4412-ba7a-bc7b29b571fc) Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:45.775340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bac9f042-dd50-4412-ba7a-bc7b29b571fc) Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:45.779345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bac9f042-dd50-4412-ba7a-bc7b29b571fc) Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bac9f042-dd50-4412-ba7a-bc7b29b571fc) Aug 06 12:46:45.782468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.784162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bac9f042-dd50-4412-ba7a-bc7b29b571fc) {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:46:45.784162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c6c6eea8-5ba6-46c2-9e6d-206fbf68e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa" status: 400 len: 269 microversion: 2.1 time: 21.446611 Aug 06 12:46:45.784162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 697/1390] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:46:24 2022] DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa => generated 269 bytes in 21448 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:46:45.784162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4b000249-53e4-4c41-9516-05bc0d17655d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:45.784540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4b000249-53e4-4c41-9516-05bc0d17655d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:45.790016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b000249-53e4-4c41-9516-05bc0d17655d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.790575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b000249-53e4-4c41-9516-05bc0d17655d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.791010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b000249-53e4-4c41-9516-05bc0d17655d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.791701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b000249-53e4-4c41-9516-05bc0d17655d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.792147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b000249-53e4-4c41-9516-05bc0d17655d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.792593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b000249-53e4-4c41-9516-05bc0d17655d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.808169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5bca440-df16-4127-b51b-8380c7272216) Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Request method failure captured: Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 HTTP/1.1 Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l963ks7Y3fjt37ybAlnEYdBJkWrtwFTWydRERg2t_6bOTX4B7a_gup8czlaU-40oPKqUTj-e042VO0Q93KC9u6lgBhkQcftj6bBUmCzh4rhn9qoXOerhdvlr7uGqcmyNjXwy_RqcZUzRWmFC57t7kl3pwMgOy4uOB7hnUq62U8lhWs Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 94cc3ab0fa2d47008fc45f600ff1613a Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:46:45.810336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:46:45.811698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:46:45.811698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:45.811698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 94cc3ab0fa2d47008fc45f600ff1613a Aug 06 12:46:45.811698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:45.811698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotTestJSON-1038996424-project Aug 06 12:46:45.811698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:46:45.811698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:46:45.811698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 3fc91d2e9cd24694a5aa62e9d579c8e0 Aug 06 12:46:45.811698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotTestJSON-1038996424-project Aug 06 12:46:45.811698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5bca440-df16-4127-b51b-8380c7272216) Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'server_id': 'e5982553-7c7c-4d67-bb7e-13ac69cfc674', 'id': '66abc00e-688e-4559-8736-77410a760e11'} Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:45.812345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5bca440-df16-4127-b51b-8380c7272216) Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:45.813338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5bca440-df16-4127-b51b-8380c7272216) Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:45.814406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5bca440-df16-4127-b51b-8380c7272216) Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:45.815413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5bca440-df16-4127-b51b-8380c7272216) Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5bca440-df16-4127-b51b-8380c7272216) Aug 06 12:46:45.817924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:45.819247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5bca440-df16-4127-b51b-8380c7272216) {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:46:45.819247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-244d2601-36b6-428b-a6f1-4132ee50276c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11" status: 400 len: 269 microversion: 2.1 time: 21.409072 Aug 06 12:46:45.819247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 694/1391] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:46:24 2022] DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 => generated 269 bytes in 21410 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:46:45.819247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9c2b4ec4-f0e1-4a13-9f0b-719528516d5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:45.819592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9c2b4ec4-f0e1-4a13-9f0b-719528516d5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:45.823141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4b000249-53e4-4c41-9516-05bc0d17655d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049818 Aug 06 12:46:45.823705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 698/1392] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:45.825974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c2b4ec4-f0e1-4a13-9f0b-719528516d5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.826453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c2b4ec4-f0e1-4a13-9f0b-719528516d5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.826883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c2b4ec4-f0e1-4a13-9f0b-719528516d5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.827563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c2b4ec4-f0e1-4a13-9f0b-719528516d5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.828009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c2b4ec4-f0e1-4a13-9f0b-719528516d5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.828218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c5019993-14d8-4f5d-a8f3-0616634ee239 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:45.828459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c2b4ec4-f0e1-4a13-9f0b-719528516d5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.830318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c5019993-14d8-4f5d-a8f3-0616634ee239 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:45.836069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5019993-14d8-4f5d-a8f3-0616634ee239 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.836581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5019993-14d8-4f5d-a8f3-0616634ee239 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.837013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5019993-14d8-4f5d-a8f3-0616634ee239 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.837696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5019993-14d8-4f5d-a8f3-0616634ee239 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.838143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5019993-14d8-4f5d-a8f3-0616634ee239 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.838561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5019993-14d8-4f5d-a8f3-0616634ee239 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.857996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9c2b4ec4-f0e1-4a13-9f0b-719528516d5d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044408 Aug 06 12:46:45.858746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 695/1393] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:46:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:46:45.863315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:45.864495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:45.869895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.870048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c5019993-14d8-4f5d-a8f3-0616634ee239 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045145 Aug 06 12:46:45.870366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.870476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 699/1394] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:45 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:45.870790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.871469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.871914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.872347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.874916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:45.875396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:45.880793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.881269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.881702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.882389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.882835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.883257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.903893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.904286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.904742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.905176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lazy-loading 'fault' on Instance uuid 5cc50006-2952-4463-9098-a8a944a259e3 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:46:45.949847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:46:45.957896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-de0bbd0b-3a9e-4df0-8434-05b453082396 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1231 microversion: 2.1 time: 0.097657 Aug 06 12:46:45.958482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 696/1395] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:46:45 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:46:45.962486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'services' on Instance uuid 7a8a8915-eeca-4909-aab7-6fe8381ced6e {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:46:45.962955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:45.963433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:45.968998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.969471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.969893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:45.970567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:45.971010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:45.971423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.021142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fa57d49-6bd5-4961-9c2c-22f98ae3396c) Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa HTTP/1.1 Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:46:46.023265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:46:46.024844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:46:46.024844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:46.024844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 12:46:46.024844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 12:46:46.024844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:46:46.024844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:46:46.024844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:46:46.024844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 12:46:46.024844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 12:46:46.024844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fa57d49-6bd5-4961-9c2c-22f98ae3396c) Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': '7a8a8915-eeca-4909-aab7-6fe8381ced6e', 'id': 'd1b59212-9312-4893-97c3-6c27d1ef81aa'} Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:46.025695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fa57d49-6bd5-4961-9c2c-22f98ae3396c) Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:46.026709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fa57d49-6bd5-4961-9c2c-22f98ae3396c) Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.027814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fa57d49-6bd5-4961-9c2c-22f98ae3396c) Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:46.029817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fa57d49-6bd5-4961-9c2c-22f98ae3396c) Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fa57d49-6bd5-4961-9c2c-22f98ae3396c) Aug 06 12:46:46.031746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.032989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fa57d49-6bd5-4961-9c2c-22f98ae3396c) {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:46:46.032989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-35b83581-dc19-4363-a072-557e58de488a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa" status: 400 len: 269 microversion: 2.1 time: 0.153252 Aug 06 12:46:46.032989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 700/1396] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:46:45 2022] DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments/d1b59212-9312-4893-97c3-6c27d1ef81aa => generated 269 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:46:46.032989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bcb268ef-e6ec-4b86-9b8b-87a311914dc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:46.033355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bcb268ef-e6ec-4b86-9b8b-87a311914dc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:46.040542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcb268ef-e6ec-4b86-9b8b-87a311914dc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.041024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcb268ef-e6ec-4b86-9b8b-87a311914dc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.041454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcb268ef-e6ec-4b86-9b8b-87a311914dc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.042141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcb268ef-e6ec-4b86-9b8b-87a311914dc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.042587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcb268ef-e6ec-4b86-9b8b-87a311914dc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.043006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcb268ef-e6ec-4b86-9b8b-87a311914dc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.073190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bcb268ef-e6ec-4b86-9b8b-87a311914dc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047019 Aug 06 12:46:46.073743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 701/1397] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:46.073985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lazy-loading 'services' on Instance uuid e5982553-7c7c-4d67-bb7e-13ac69cfc674 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:46:46.078266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a90ecced-876a-4a19-85c4-06dba6179a96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:46.080411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a90ecced-876a-4a19-85c4-06dba6179a96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:46.086592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a90ecced-876a-4a19-85c4-06dba6179a96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.087065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a90ecced-876a-4a19-85c4-06dba6179a96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.087693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a90ecced-876a-4a19-85c4-06dba6179a96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.088425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a90ecced-876a-4a19-85c4-06dba6179a96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.088867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a90ecced-876a-4a19-85c4-06dba6179a96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.089283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a90ecced-876a-4a19-85c4-06dba6179a96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.119995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a90ecced-876a-4a19-85c4-06dba6179a96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045205 Aug 06 12:46:46.121378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 702/1398] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 12:46:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:46:46.126260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c847fc60-1625-4c19-b1b5-78499ed9cefe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:46.128932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c847fc60-1625-4c19-b1b5-78499ed9cefe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:46.134429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-68e4dacb-f85e-486b-b7ef-d43baabcad50) Aug 06 12:46:46.135990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c847fc60-1625-4c19-b1b5-78499ed9cefe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.136511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c847fc60-1625-4c19-b1b5-78499ed9cefe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Request method failure captured: Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 HTTP/1.1 Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l963ks7Y3fjt37ybAlnEYdBJkWrtwFTWydRERg2t_6bOTX4B7a_gup8czlaU-40oPKqUTj-e042VO0Q93KC9u6lgBhkQcftj6bBUmCzh4rhn9qoXOerhdvlr7uGqcmyNjXwy_RqcZUzRWmFC57t7kl3pwMgOy4uOB7hnUq62U8lhWs Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 94cc3ab0fa2d47008fc45f600ff1613a Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:46:46.136630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:46:46.137891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/94cc3ab0fa2d47008fc45f600ff1613a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:46:46.137891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:46.137891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 94cc3ab0fa2d47008fc45f600ff1613a Aug 06 12:46:46.137891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1038996424 Aug 06 12:46:46.137891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotTestJSON-1038996424-project Aug 06 12:46:46.137891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:46:46.137891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:46:46.137891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 3fc91d2e9cd24694a5aa62e9d579c8e0 Aug 06 12:46:46.137891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotTestJSON-1038996424-project Aug 06 12:46:46.137891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-68e4dacb-f85e-486b-b7ef-d43baabcad50) Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'server_id': 'e5982553-7c7c-4d67-bb7e-13ac69cfc674', 'id': '66abc00e-688e-4559-8736-77410a760e11'} Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:46.138517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-68e4dacb-f85e-486b-b7ef-d43baabcad50) Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 12:46:46.139626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-68e4dacb-f85e-486b-b7ef-d43baabcad50) Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.140776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-68e4dacb-f85e-486b-b7ef-d43baabcad50) Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:46.141775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-68e4dacb-f85e-486b-b7ef-d43baabcad50) Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-68e4dacb-f85e-486b-b7ef-d43baabcad50) Aug 06 12:46:46.142825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.143861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c847fc60-1625-4c19-b1b5-78499ed9cefe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.143952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-68e4dacb-f85e-486b-b7ef-d43baabcad50) {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:46:46.144055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c847fc60-1625-4c19-b1b5-78499ed9cefe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.144136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61d8db86-47b3-4025-af90-da0115750729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11" status: 400 len: 269 microversion: 2.1 time: 0.178617 Aug 06 12:46:46.144220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c847fc60-1625-4c19-b1b5-78499ed9cefe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.144220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c847fc60-1625-4c19-b1b5-78499ed9cefe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.146301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 697/1399] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 12:46:45 2022] DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674/os-volume_attachments/66abc00e-688e-4559-8736-77410a760e11 => generated 269 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 12:46:46.148877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:46.149219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:46.155799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.156286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.156741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.157444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.157892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.158315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.170065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c847fc60-1625-4c19-b1b5-78499ed9cefe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047513 Aug 06 12:46:46.171007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 703/1400] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:46 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:46.175612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-960d2a26-8268-4756-ae1f-2466b93df9c4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:46.177884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-960d2a26-8268-4756-ae1f-2466b93df9c4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:46.183910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-960d2a26-8268-4756-ae1f-2466b93df9c4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.184524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-960d2a26-8268-4756-ae1f-2466b93df9c4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.185015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-960d2a26-8268-4756-ae1f-2466b93df9c4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.185771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-960d2a26-8268-4756-ae1f-2466b93df9c4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.186283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-960d2a26-8268-4756-ae1f-2466b93df9c4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.186713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-960d2a26-8268-4756-ae1f-2466b93df9c4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.191962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.192713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.193490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.194127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lazy-loading 'fault' on Instance uuid 5cc50006-2952-4463-9098-a8a944a259e3 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 12:46:46.217168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-960d2a26-8268-4756-ae1f-2466b93df9c4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Aug 06 12:46:46.218285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 704/1401] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:46.239876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '439c730ea489445998ec6fa480257b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cb1f1b37a34fedbd0db091e7e830ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:46:46.246679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c7f2fb33-2398-4d46-8ba4-87489741e658 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 200 len: 1185 microversion: 2.1 time: 0.102474 Aug 06 12:46:46.247229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 698/1402] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:46:46 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 1185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:46:46.691907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:46.692405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:46.699317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.699728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.700152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.700842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.701288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.701700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.714719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] HTTP exception thrown: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Request method failure captured: Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 HTTP/1.1 Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l9p9ra20XAJoFsSWXR_lBEJpPk57xReD7Fl-Ds-ne_rhz2jsPjL4nT5mr7cABBp1oB0orX-VUyLOizOsJoi6lkrG9QrnQzfAwC8eYczLi2KJaIR1IsHRiaR0oHfGK2a2wk-BKcrMfeK3s6yCE0nPRuVtid7RiK8dmBy7Db5-0TOdqM Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: c6cb1f1b37a34fedbd0db091e7e830ad Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-TestVolumeBootPattern-1615140679 Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 12:46:46.716233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6cb1f1b37a34fedbd0db091e7e830ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6cb1f1b37a34fedbd0db091e7e830ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6cb1f1b37a34fedbd0db091e7e830ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6cb1f1b37a34fedbd0db091e7e830ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-TestVolumeBootPattern-1615140679 Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: c6cb1f1b37a34fedbd0db091e7e830ad Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-TestVolumeBootPattern-1615140679 Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-TestVolumeBootPattern-1615140679-project Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 439c730ea489445998ec6fa480257b5e Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-TestVolumeBootPattern-1615140679-project Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. Aug 06 12:46:46.717858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '5cc50006-2952-4463-9098-a8a944a259e3'} Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:46:46.718732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. Aug 06 12:46:46.720185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.721840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Returning 404 to user: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:46:46.721840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a234ec57-079e-4ab0-bdcc-3971f0f412e2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 404 len: 111 microversion: 2.1 time: 0.029576 Aug 06 12:46:46.721840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 705/1403] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:46:46 2022] DELETE /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 12:46:46.726141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:46.726744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] [instance: 5cc50006-2952-4463-9098-a8a944a259e3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:46.732757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.733236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.733674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.734358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:46.734831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:46.735362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:46.748804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] HTTP exception thrown: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Request method failure captured: Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 HTTP/1.1 Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l9p9ra20XAJoFsSWXR_lBEJpPk57xReD7Fl-Ds-ne_rhz2jsPjL4nT5mr7cABBp1oB0orX-VUyLOizOsJoi6lkrG9QrnQzfAwC8eYczLi2KJaIR1IsHRiaR0oHfGK2a2wk-BKcrMfeK3s6yCE0nPRuVtid7RiK8dmBy7Db5-0TOdqM Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: c6cb1f1b37a34fedbd0db091e7e830ad Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestVolumeBootPattern-1615140679 Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 12:46:46.750292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6cb1f1b37a34fedbd0db091e7e830ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6cb1f1b37a34fedbd0db091e7e830ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6cb1f1b37a34fedbd0db091e7e830ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6cb1f1b37a34fedbd0db091e7e830ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestVolumeBootPattern-1615140679 Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: c6cb1f1b37a34fedbd0db091e7e830ad Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestVolumeBootPattern-1615140679 Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-TestVolumeBootPattern-1615140679-project Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 439c730ea489445998ec6fa480257b5e Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestVolumeBootPattern-1615140679-project Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. Aug 06 12:46:46.751832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '5cc50006-2952-4463-9098-a8a944a259e3'} Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 12:46:46.752747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. Aug 06 12:46:46.754154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 12:46:46.756106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Returning 404 to user: Instance 5cc50006-2952-4463-9098-a8a944a259e3 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 12:46:46.756106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1e9d3039-53da-4910-b8c7-14c7db7bfea7 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3" status: 404 len: 111 microversion: 2.1 time: 0.029483 Aug 06 12:46:46.756106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 699/1404] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:46:46 2022] GET /compute/v2.1/servers/5cc50006-2952-4463-9098-a8a944a259e3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 12:46:47.085997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e1dc627f-6aa7-400f-b80a-ad997281c002 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:46:47.088129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e1dc627f-6aa7-400f-b80a-ad997281c002 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:47.093973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1dc627f-6aa7-400f-b80a-ad997281c002 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:47.094445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1dc627f-6aa7-400f-b80a-ad997281c002 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:47.094870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1dc627f-6aa7-400f-b80a-ad997281c002 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:47.095536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1dc627f-6aa7-400f-b80a-ad997281c002 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:47.095977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1dc627f-6aa7-400f-b80a-ad997281c002 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:47.096419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1dc627f-6aa7-400f-b80a-ad997281c002 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:47.133249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f5b70114-8583-46e9-a762-d9b5d2bba893 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:46:47.135465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f5b70114-8583-46e9-a762-d9b5d2bba893 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:47.141734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5b70114-8583-46e9-a762-d9b5d2bba893 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:47.142207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5b70114-8583-46e9-a762-d9b5d2bba893 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:47.142649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5b70114-8583-46e9-a762-d9b5d2bba893 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:47.143329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5b70114-8583-46e9-a762-d9b5d2bba893 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:47.143780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5b70114-8583-46e9-a762-d9b5d2bba893 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:47.144202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5b70114-8583-46e9-a762-d9b5d2bba893 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:47.192406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e1dc627f-6aa7-400f-b80a-ad997281c002 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/action" status: 200 len: 41405 microversion: 2.1 time: 0.110654 Aug 06 12:46:47.196478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 706/1405] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 12:46:47 2022] POST /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867/action => generated 41405 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:46:47.198540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-034e60fe-9a99-45a9-a5f9-c05aa07bb729 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:47.201029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-034e60fe-9a99-45a9-a5f9-c05aa07bb729 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:47.209344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-034e60fe-9a99-45a9-a5f9-c05aa07bb729 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:47.209883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-034e60fe-9a99-45a9-a5f9-c05aa07bb729 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:47.210758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-034e60fe-9a99-45a9-a5f9-c05aa07bb729 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:47.211447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-034e60fe-9a99-45a9-a5f9-c05aa07bb729 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:47.211891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-034e60fe-9a99-45a9-a5f9-c05aa07bb729 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:47.212321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-034e60fe-9a99-45a9-a5f9-c05aa07bb729 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:47.243902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-034e60fe-9a99-45a9-a5f9-c05aa07bb729 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049193 Aug 06 12:46:47.244641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 707/1406] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:47 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:47.249084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5fcb8f58-78bc-4ab1-af7e-ef1dd3649b13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:47.251405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5fcb8f58-78bc-4ab1-af7e-ef1dd3649b13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:47.255863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f5b70114-8583-46e9-a762-d9b5d2bba893 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/action" status: 200 len: 37492 microversion: 2.20 time: 0.126374 Aug 06 12:46:47.257205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 700/1407] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Aug 6 12:46:47 2022] POST /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f/action => generated 37492 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 06 12:46:47.258889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f58-78bc-4ab1-af7e-ef1dd3649b13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:47.259445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f58-78bc-4ab1-af7e-ef1dd3649b13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:47.259947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f58-78bc-4ab1-af7e-ef1dd3649b13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:47.260742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f58-78bc-4ab1-af7e-ef1dd3649b13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:47.261262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f58-78bc-4ab1-af7e-ef1dd3649b13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:47.261754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f58-78bc-4ab1-af7e-ef1dd3649b13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:47.292241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5fcb8f58-78bc-4ab1-af7e-ef1dd3649b13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046612 Aug 06 12:46:47.296464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 708/1408] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:48.257190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7eab1a39-c3e3-4305-b2a9-047d5918787e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:48.259510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7eab1a39-c3e3-4305-b2a9-047d5918787e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:48.266537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eab1a39-c3e3-4305-b2a9-047d5918787e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:48.267019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eab1a39-c3e3-4305-b2a9-047d5918787e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:48.267461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eab1a39-c3e3-4305-b2a9-047d5918787e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:48.268157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eab1a39-c3e3-4305-b2a9-047d5918787e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:48.268711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eab1a39-c3e3-4305-b2a9-047d5918787e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:48.269142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eab1a39-c3e3-4305-b2a9-047d5918787e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:48.298989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7eab1a39-c3e3-4305-b2a9-047d5918787e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046749 Aug 06 12:46:48.299666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 701/1409] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:48 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:48.312856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27f2e87c-56f2-40bc-8d49-82e7d25be1ab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:48.312856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-27f2e87c-56f2-40bc-8d49-82e7d25be1ab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:48.316771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27f2e87c-56f2-40bc-8d49-82e7d25be1ab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:48.317329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27f2e87c-56f2-40bc-8d49-82e7d25be1ab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:48.318509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27f2e87c-56f2-40bc-8d49-82e7d25be1ab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:48.319271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27f2e87c-56f2-40bc-8d49-82e7d25be1ab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:48.319872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27f2e87c-56f2-40bc-8d49-82e7d25be1ab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:48.320414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27f2e87c-56f2-40bc-8d49-82e7d25be1ab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:48.349595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-27f2e87c-56f2-40bc-8d49-82e7d25be1ab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049060 Aug 06 12:46:48.354901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 709/1410] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:49.311268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c9b61581-fd0a-466f-b560-b88c2137ea42 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:49.313430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c9b61581-fd0a-466f-b560-b88c2137ea42 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:49.320178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b61581-fd0a-466f-b560-b88c2137ea42 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:49.320670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b61581-fd0a-466f-b560-b88c2137ea42 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:49.321097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b61581-fd0a-466f-b560-b88c2137ea42 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:49.321775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b61581-fd0a-466f-b560-b88c2137ea42 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:49.322222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b61581-fd0a-466f-b560-b88c2137ea42 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:49.322637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b61581-fd0a-466f-b560-b88c2137ea42 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:49.351493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c9b61581-fd0a-466f-b560-b88c2137ea42 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Aug 06 12:46:49.352050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 702/1411] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:49 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:49.362658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c5372f1b-6d3f-4cc1-84d9-a87149ea5971 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:49.364814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c5372f1b-6d3f-4cc1-84d9-a87149ea5971 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:49.371095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5372f1b-6d3f-4cc1-84d9-a87149ea5971 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:49.371604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5372f1b-6d3f-4cc1-84d9-a87149ea5971 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:49.372031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5372f1b-6d3f-4cc1-84d9-a87149ea5971 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:49.372909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5372f1b-6d3f-4cc1-84d9-a87149ea5971 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:49.373351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5372f1b-6d3f-4cc1-84d9-a87149ea5971 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:49.375306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5372f1b-6d3f-4cc1-84d9-a87149ea5971 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:49.405387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c5372f1b-6d3f-4cc1-84d9-a87149ea5971 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047242 Aug 06 12:46:49.406226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 710/1412] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:46:50.364037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8eeb3893-38df-4c79-be6c-14eaaadc65a0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:50.366684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8eeb3893-38df-4c79-be6c-14eaaadc65a0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:50.373004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8eeb3893-38df-4c79-be6c-14eaaadc65a0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:50.373569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8eeb3893-38df-4c79-be6c-14eaaadc65a0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:50.374010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8eeb3893-38df-4c79-be6c-14eaaadc65a0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:50.374695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8eeb3893-38df-4c79-be6c-14eaaadc65a0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:50.375149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8eeb3893-38df-4c79-be6c-14eaaadc65a0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:50.375576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8eeb3893-38df-4c79-be6c-14eaaadc65a0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:50.406950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8eeb3893-38df-4c79-be6c-14eaaadc65a0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047132 Aug 06 12:46:50.407512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 703/1413] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:50 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:50.429055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d8b278da-7f52-4400-b4b1-91fb1393086d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:50.431242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d8b278da-7f52-4400-b4b1-91fb1393086d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:50.437456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8b278da-7f52-4400-b4b1-91fb1393086d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:50.437936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8b278da-7f52-4400-b4b1-91fb1393086d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:50.438368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8b278da-7f52-4400-b4b1-91fb1393086d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:50.439053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8b278da-7f52-4400-b4b1-91fb1393086d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:50.439500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8b278da-7f52-4400-b4b1-91fb1393086d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:50.439922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8b278da-7f52-4400-b4b1-91fb1393086d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:50.469257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d8b278da-7f52-4400-b4b1-91fb1393086d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Aug 06 12:46:50.473724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 711/1414] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:51.420802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-85c47689-f9c7-4026-a1f7-f2a491e7f1e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:51.422999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-85c47689-f9c7-4026-a1f7-f2a491e7f1e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:51.429714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85c47689-f9c7-4026-a1f7-f2a491e7f1e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:51.430216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85c47689-f9c7-4026-a1f7-f2a491e7f1e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:51.430609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85c47689-f9c7-4026-a1f7-f2a491e7f1e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:51.431293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85c47689-f9c7-4026-a1f7-f2a491e7f1e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:51.431733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85c47689-f9c7-4026-a1f7-f2a491e7f1e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:51.432169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85c47689-f9c7-4026-a1f7-f2a491e7f1e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:51.461822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-85c47689-f9c7-4026-a1f7-f2a491e7f1e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046463 Aug 06 12:46:51.462375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 704/1415] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:51 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:51.481353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ff4d00f4-eb68-4a69-83f5-99b65c09c8db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:51.483623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ff4d00f4-eb68-4a69-83f5-99b65c09c8db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:51.490116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff4d00f4-eb68-4a69-83f5-99b65c09c8db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:51.490783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff4d00f4-eb68-4a69-83f5-99b65c09c8db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:51.491215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff4d00f4-eb68-4a69-83f5-99b65c09c8db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:51.491898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff4d00f4-eb68-4a69-83f5-99b65c09c8db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:51.492370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff4d00f4-eb68-4a69-83f5-99b65c09c8db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:51.492794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff4d00f4-eb68-4a69-83f5-99b65c09c8db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:51.522107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ff4d00f4-eb68-4a69-83f5-99b65c09c8db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Aug 06 12:46:51.526934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 712/1416] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:52.474084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b57bcaef-b8b0-4fee-810e-6ab121b9cb68 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:52.476228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b57bcaef-b8b0-4fee-810e-6ab121b9cb68 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:52.482497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b57bcaef-b8b0-4fee-810e-6ab121b9cb68 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:52.482970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b57bcaef-b8b0-4fee-810e-6ab121b9cb68 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:52.483399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b57bcaef-b8b0-4fee-810e-6ab121b9cb68 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:52.484072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b57bcaef-b8b0-4fee-810e-6ab121b9cb68 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:52.484570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b57bcaef-b8b0-4fee-810e-6ab121b9cb68 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:52.484985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b57bcaef-b8b0-4fee-810e-6ab121b9cb68 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:52.513775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b57bcaef-b8b0-4fee-810e-6ab121b9cb68 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Aug 06 12:46:52.514327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 705/1417] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:52 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:52.534728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-30582eb8-4f15-46fd-acac-f636552e818c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:52.537607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-30582eb8-4f15-46fd-acac-f636552e818c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:52.544043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30582eb8-4f15-46fd-acac-f636552e818c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:52.544540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30582eb8-4f15-46fd-acac-f636552e818c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:52.544972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30582eb8-4f15-46fd-acac-f636552e818c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:52.545650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30582eb8-4f15-46fd-acac-f636552e818c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:52.546097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30582eb8-4f15-46fd-acac-f636552e818c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:52.546511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30582eb8-4f15-46fd-acac-f636552e818c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:52.575998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-30582eb8-4f15-46fd-acac-f636552e818c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Aug 06 12:46:52.580359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 713/1418] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:53.526409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a54ee8e6-fbf6-4cb8-80a1-5beb3c4b4449 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:53.528547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a54ee8e6-fbf6-4cb8-80a1-5beb3c4b4449 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:53.534786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a54ee8e6-fbf6-4cb8-80a1-5beb3c4b4449 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:53.535250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a54ee8e6-fbf6-4cb8-80a1-5beb3c4b4449 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:53.535675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a54ee8e6-fbf6-4cb8-80a1-5beb3c4b4449 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:53.536371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a54ee8e6-fbf6-4cb8-80a1-5beb3c4b4449 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:53.536819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a54ee8e6-fbf6-4cb8-80a1-5beb3c4b4449 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:53.537234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a54ee8e6-fbf6-4cb8-80a1-5beb3c4b4449 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:53.567026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a54ee8e6-fbf6-4cb8-80a1-5beb3c4b4449 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Aug 06 12:46:53.567593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 706/1419] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:53 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:53.588002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fc1945a2-761c-43ac-9a5c-d0dd3ab58b01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:53.590034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fc1945a2-761c-43ac-9a5c-d0dd3ab58b01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:53.598331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc1945a2-761c-43ac-9a5c-d0dd3ab58b01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:53.598834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc1945a2-761c-43ac-9a5c-d0dd3ab58b01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:53.599274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc1945a2-761c-43ac-9a5c-d0dd3ab58b01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:53.599973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc1945a2-761c-43ac-9a5c-d0dd3ab58b01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:53.601108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc1945a2-761c-43ac-9a5c-d0dd3ab58b01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:53.601547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc1945a2-761c-43ac-9a5c-d0dd3ab58b01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:53.618603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:46:53.632771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fc1945a2-761c-43ac-9a5c-d0dd3ab58b01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049230 Aug 06 12:46:53.637004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 714/1420] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:54.579091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-64c0445d-17c8-4436-9c2f-c5d847078574 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:54.581240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-64c0445d-17c8-4436-9c2f-c5d847078574 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:54.587528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64c0445d-17c8-4436-9c2f-c5d847078574 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:54.588000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64c0445d-17c8-4436-9c2f-c5d847078574 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:54.588463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64c0445d-17c8-4436-9c2f-c5d847078574 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:54.589139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64c0445d-17c8-4436-9c2f-c5d847078574 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:54.589589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64c0445d-17c8-4436-9c2f-c5d847078574 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:54.590003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64c0445d-17c8-4436-9c2f-c5d847078574 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:54.619393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-64c0445d-17c8-4436-9c2f-c5d847078574 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Aug 06 12:46:54.619943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 707/1421] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:54 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:54.644907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1d28b331-3a8d-4c24-ba6d-3ff0eb3b5cae tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:54.647038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1d28b331-3a8d-4c24-ba6d-3ff0eb3b5cae tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:54.653467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d28b331-3a8d-4c24-ba6d-3ff0eb3b5cae tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:54.653947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d28b331-3a8d-4c24-ba6d-3ff0eb3b5cae tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:54.654379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d28b331-3a8d-4c24-ba6d-3ff0eb3b5cae tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:54.655094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d28b331-3a8d-4c24-ba6d-3ff0eb3b5cae tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:54.655550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d28b331-3a8d-4c24-ba6d-3ff0eb3b5cae tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:54.655969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d28b331-3a8d-4c24-ba6d-3ff0eb3b5cae tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:54.685477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1d28b331-3a8d-4c24-ba6d-3ff0eb3b5cae tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Aug 06 12:46:54.686057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 715/1422] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:55.630866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d6d59bae-db81-4744-ba82-8f8611e49783 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:55.633593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d6d59bae-db81-4744-ba82-8f8611e49783 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:55.644272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6d59bae-db81-4744-ba82-8f8611e49783 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:55.644787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6d59bae-db81-4744-ba82-8f8611e49783 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:55.645228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6d59bae-db81-4744-ba82-8f8611e49783 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:55.645928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6d59bae-db81-4744-ba82-8f8611e49783 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:55.646422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6d59bae-db81-4744-ba82-8f8611e49783 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:55.646793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6d59bae-db81-4744-ba82-8f8611e49783 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:55.675970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d6d59bae-db81-4744-ba82-8f8611e49783 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049001 Aug 06 12:46:55.676578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 708/1423] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:55 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:55.698358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-255201c8-43e1-49cc-b475-30304412cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:55.700548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-255201c8-43e1-49cc-b475-30304412cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:55.706819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255201c8-43e1-49cc-b475-30304412cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:55.707296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255201c8-43e1-49cc-b475-30304412cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:55.707724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255201c8-43e1-49cc-b475-30304412cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:55.709033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255201c8-43e1-49cc-b475-30304412cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:55.709492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255201c8-43e1-49cc-b475-30304412cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:55.709913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255201c8-43e1-49cc-b475-30304412cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:55.739124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-255201c8-43e1-49cc-b475-30304412cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045363 Aug 06 12:46:55.739681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 716/1424] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:56.688750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c27781de-6d18-4161-b94b-f2a9c536a0d6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:56.690887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c27781de-6d18-4161-b94b-f2a9c536a0d6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:56.697871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27781de-6d18-4161-b94b-f2a9c536a0d6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:56.698348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27781de-6d18-4161-b94b-f2a9c536a0d6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:56.698782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27781de-6d18-4161-b94b-f2a9c536a0d6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:56.699461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27781de-6d18-4161-b94b-f2a9c536a0d6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:56.699907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27781de-6d18-4161-b94b-f2a9c536a0d6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:56.700341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27781de-6d18-4161-b94b-f2a9c536a0d6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:56.729389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c27781de-6d18-4161-b94b-f2a9c536a0d6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044610 Aug 06 12:46:56.729954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 709/1425] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:56 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:56.751476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-def7351c-c4f2-4da0-bfc0-7c9d7188cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:56.753897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-def7351c-c4f2-4da0-bfc0-7c9d7188cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:56.760319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def7351c-c4f2-4da0-bfc0-7c9d7188cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:56.760923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def7351c-c4f2-4da0-bfc0-7c9d7188cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:56.761355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def7351c-c4f2-4da0-bfc0-7c9d7188cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:56.762033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def7351c-c4f2-4da0-bfc0-7c9d7188cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:56.762477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def7351c-c4f2-4da0-bfc0-7c9d7188cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:56.762976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def7351c-c4f2-4da0-bfc0-7c9d7188cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:56.793654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-def7351c-c4f2-4da0-bfc0-7c9d7188cb66 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Aug 06 12:46:56.794212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 717/1426] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:46:57.742574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f07ebe1b-10f8-4525-95b1-c67e64993816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:57.744636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f07ebe1b-10f8-4525-95b1-c67e64993816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:57.750946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f07ebe1b-10f8-4525-95b1-c67e64993816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:57.751436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f07ebe1b-10f8-4525-95b1-c67e64993816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:57.751865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f07ebe1b-10f8-4525-95b1-c67e64993816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:57.752577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f07ebe1b-10f8-4525-95b1-c67e64993816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:57.753026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f07ebe1b-10f8-4525-95b1-c67e64993816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:57.753447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f07ebe1b-10f8-4525-95b1-c67e64993816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:57.777830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:46:57.782991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f07ebe1b-10f8-4525-95b1-c67e64993816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Aug 06 12:46:57.787387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 710/1427] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:57 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:57.806361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-99091b9e-7d85-4db2-be5f-0bb3b7a82e4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:57.808614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-99091b9e-7d85-4db2-be5f-0bb3b7a82e4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:57.815029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99091b9e-7d85-4db2-be5f-0bb3b7a82e4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:57.815508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99091b9e-7d85-4db2-be5f-0bb3b7a82e4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:57.815938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99091b9e-7d85-4db2-be5f-0bb3b7a82e4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:57.816651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99091b9e-7d85-4db2-be5f-0bb3b7a82e4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:57.817122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99091b9e-7d85-4db2-be5f-0bb3b7a82e4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:57.817537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99091b9e-7d85-4db2-be5f-0bb3b7a82e4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:57.846473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-99091b9e-7d85-4db2-be5f-0bb3b7a82e4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Aug 06 12:46:57.847024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 718/1428] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:58.795322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-58a26f10-9257-4cca-82f6-18e9767083c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:58.797488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-58a26f10-9257-4cca-82f6-18e9767083c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:58.804484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a26f10-9257-4cca-82f6-18e9767083c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:58.804960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a26f10-9257-4cca-82f6-18e9767083c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:58.805387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a26f10-9257-4cca-82f6-18e9767083c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:58.806064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a26f10-9257-4cca-82f6-18e9767083c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:58.806505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a26f10-9257-4cca-82f6-18e9767083c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:58.806921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a26f10-9257-4cca-82f6-18e9767083c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:58.836189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-58a26f10-9257-4cca-82f6-18e9767083c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044776 Aug 06 12:46:58.836780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 711/1429] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:58 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:58.858952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-101fd42c-f7c8-4809-acfe-fa11606b407e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:58.861555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-101fd42c-f7c8-4809-acfe-fa11606b407e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:58.868381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-101fd42c-f7c8-4809-acfe-fa11606b407e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:58.868927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-101fd42c-f7c8-4809-acfe-fa11606b407e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:58.869436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-101fd42c-f7c8-4809-acfe-fa11606b407e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:58.870184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-101fd42c-f7c8-4809-acfe-fa11606b407e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:58.870695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-101fd42c-f7c8-4809-acfe-fa11606b407e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:58.871174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-101fd42c-f7c8-4809-acfe-fa11606b407e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:58.900242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-101fd42c-f7c8-4809-acfe-fa11606b407e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Aug 06 12:46:58.900811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 719/1430] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:46:59.848541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ee7b8b55-b298-4d4a-a4a1-42e2df3d6b0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:59.851160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ee7b8b55-b298-4d4a-a4a1-42e2df3d6b0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:59.857559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee7b8b55-b298-4d4a-a4a1-42e2df3d6b0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:59.858068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee7b8b55-b298-4d4a-a4a1-42e2df3d6b0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:59.858501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee7b8b55-b298-4d4a-a4a1-42e2df3d6b0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:59.859187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee7b8b55-b298-4d4a-a4a1-42e2df3d6b0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:59.859637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee7b8b55-b298-4d4a-a4a1-42e2df3d6b0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:59.860055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee7b8b55-b298-4d4a-a4a1-42e2df3d6b0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:59.889249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ee7b8b55-b298-4d4a-a4a1-42e2df3d6b0e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Aug 06 12:46:59.889804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 712/1431] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:46:59.912004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aaf753c1-e4a7-4a29-95bd-e9ccffc3b1cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:46:59.914671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aaf753c1-e4a7-4a29-95bd-e9ccffc3b1cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:46:59.920861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aaf753c1-e4a7-4a29-95bd-e9ccffc3b1cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:59.921337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aaf753c1-e4a7-4a29-95bd-e9ccffc3b1cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:59.921764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aaf753c1-e4a7-4a29-95bd-e9ccffc3b1cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:59.922460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aaf753c1-e4a7-4a29-95bd-e9ccffc3b1cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:46:59.923084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aaf753c1-e4a7-4a29-95bd-e9ccffc3b1cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:46:59.923296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aaf753c1-e4a7-4a29-95bd-e9ccffc3b1cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:46:59.952230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aaf753c1-e4a7-4a29-95bd-e9ccffc3b1cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Aug 06 12:46:59.952980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 720/1432] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:46:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:00.902149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2be93353-27b3-41a3-a0a3-26f90e980285 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:00.904244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2be93353-27b3-41a3-a0a3-26f90e980285 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:00.910866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be93353-27b3-41a3-a0a3-26f90e980285 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:00.911372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be93353-27b3-41a3-a0a3-26f90e980285 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:00.911809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be93353-27b3-41a3-a0a3-26f90e980285 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:00.912541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be93353-27b3-41a3-a0a3-26f90e980285 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:00.912994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be93353-27b3-41a3-a0a3-26f90e980285 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:00.913439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be93353-27b3-41a3-a0a3-26f90e980285 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:00.942195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2be93353-27b3-41a3-a0a3-26f90e980285 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044073 Aug 06 12:47:00.942751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 713/1433] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:00 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:00.964477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27e0b36c-8856-4409-9ccc-a82d41d127f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:00.966746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-27e0b36c-8856-4409-9ccc-a82d41d127f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:00.972905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27e0b36c-8856-4409-9ccc-a82d41d127f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:00.973384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27e0b36c-8856-4409-9ccc-a82d41d127f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:00.973818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27e0b36c-8856-4409-9ccc-a82d41d127f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:00.974508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27e0b36c-8856-4409-9ccc-a82d41d127f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:00.974966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27e0b36c-8856-4409-9ccc-a82d41d127f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:00.975391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27e0b36c-8856-4409-9ccc-a82d41d127f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:01.006155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-27e0b36c-8856-4409-9ccc-a82d41d127f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Aug 06 12:47:01.007087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 721/1434] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:01.061023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:47:01.061175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:47:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:47:01.954919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-62d66b2e-b9ee-4a87-8a7a-f591c1fe55de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:01.957104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-62d66b2e-b9ee-4a87-8a7a-f591c1fe55de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:01.964184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d66b2e-b9ee-4a87-8a7a-f591c1fe55de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:01.964700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d66b2e-b9ee-4a87-8a7a-f591c1fe55de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:01.965138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d66b2e-b9ee-4a87-8a7a-f591c1fe55de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:01.965825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d66b2e-b9ee-4a87-8a7a-f591c1fe55de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:01.966279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d66b2e-b9ee-4a87-8a7a-f591c1fe55de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:01.966710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62d66b2e-b9ee-4a87-8a7a-f591c1fe55de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:01.995186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-62d66b2e-b9ee-4a87-8a7a-f591c1fe55de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Aug 06 12:47:01.995958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 714/1435] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:01 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:02.017285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f605f483-8949-460a-a936-7efc8920501b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:02.019424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f605f483-8949-460a-a936-7efc8920501b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:02.026306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f605f483-8949-460a-a936-7efc8920501b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:02.026787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f605f483-8949-460a-a936-7efc8920501b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:02.027254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f605f483-8949-460a-a936-7efc8920501b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:02.027904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f605f483-8949-460a-a936-7efc8920501b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:02.028393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f605f483-8949-460a-a936-7efc8920501b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:02.028814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f605f483-8949-460a-a936-7efc8920501b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:02.057951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f605f483-8949-460a-a936-7efc8920501b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Aug 06 12:47:02.058562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 722/1436] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:03.008061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f2c02b94-fe38-4522-a467-eee7eea65d3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:03.010256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f2c02b94-fe38-4522-a467-eee7eea65d3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:03.016638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2c02b94-fe38-4522-a467-eee7eea65d3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:03.017121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2c02b94-fe38-4522-a467-eee7eea65d3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:03.017564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2c02b94-fe38-4522-a467-eee7eea65d3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:03.018251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2c02b94-fe38-4522-a467-eee7eea65d3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:03.018703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2c02b94-fe38-4522-a467-eee7eea65d3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:03.019126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2c02b94-fe38-4522-a467-eee7eea65d3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:03.049389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f2c02b94-fe38-4522-a467-eee7eea65d3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046082 Aug 06 12:47:03.049981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 715/1437] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:03 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:03.069872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-57872996-163b-4665-94d6-e7ee0b7de3d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:03.072672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-57872996-163b-4665-94d6-e7ee0b7de3d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:03.078916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57872996-163b-4665-94d6-e7ee0b7de3d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:03.079391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57872996-163b-4665-94d6-e7ee0b7de3d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:03.079817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57872996-163b-4665-94d6-e7ee0b7de3d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:03.080817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57872996-163b-4665-94d6-e7ee0b7de3d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:03.081846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57872996-163b-4665-94d6-e7ee0b7de3d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:03.082691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57872996-163b-4665-94d6-e7ee0b7de3d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:03.113879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-57872996-163b-4665-94d6-e7ee0b7de3d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047780 Aug 06 12:47:03.114430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 723/1438] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:04.061752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e652408c-8004-4b41-86c3-084011642070 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:04.063888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e652408c-8004-4b41-86c3-084011642070 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:04.070888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e652408c-8004-4b41-86c3-084011642070 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:04.071366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e652408c-8004-4b41-86c3-084011642070 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:04.071799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e652408c-8004-4b41-86c3-084011642070 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:04.072532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e652408c-8004-4b41-86c3-084011642070 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:04.072985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e652408c-8004-4b41-86c3-084011642070 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:04.073407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e652408c-8004-4b41-86c3-084011642070 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:04.101564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e652408c-8004-4b41-86c3-084011642070 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043716 Aug 06 12:47:04.102112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 716/1439] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:04 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:04.126068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-99b6840f-1330-4a15-885f-aa1647b5868a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:04.128219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-99b6840f-1330-4a15-885f-aa1647b5868a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:04.134919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99b6840f-1330-4a15-885f-aa1647b5868a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:04.135399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99b6840f-1330-4a15-885f-aa1647b5868a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:04.135828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99b6840f-1330-4a15-885f-aa1647b5868a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:04.136544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99b6840f-1330-4a15-885f-aa1647b5868a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:04.136993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99b6840f-1330-4a15-885f-aa1647b5868a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:04.137416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99b6840f-1330-4a15-885f-aa1647b5868a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:04.167213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-99b6840f-1330-4a15-885f-aa1647b5868a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044900 Aug 06 12:47:04.167898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 724/1440] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:05.114299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f378673e-65b1-43f9-b8bc-a7fe6ba03c1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:05.117466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f378673e-65b1-43f9-b8bc-a7fe6ba03c1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:05.125705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f378673e-65b1-43f9-b8bc-a7fe6ba03c1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:05.126186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f378673e-65b1-43f9-b8bc-a7fe6ba03c1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:05.126652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f378673e-65b1-43f9-b8bc-a7fe6ba03c1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:05.127347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f378673e-65b1-43f9-b8bc-a7fe6ba03c1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:05.127802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f378673e-65b1-43f9-b8bc-a7fe6ba03c1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:05.128227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f378673e-65b1-43f9-b8bc-a7fe6ba03c1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:05.156327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f378673e-65b1-43f9-b8bc-a7fe6ba03c1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046412 Aug 06 12:47:05.156883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 717/1441] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:05.178835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f8f302b2-de5d-4268-bfd4-6a714271acbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:05.181569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f8f302b2-de5d-4268-bfd4-6a714271acbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:05.189098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f302b2-de5d-4268-bfd4-6a714271acbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:05.189589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f302b2-de5d-4268-bfd4-6a714271acbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:05.190027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f302b2-de5d-4268-bfd4-6a714271acbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:05.190724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f302b2-de5d-4268-bfd4-6a714271acbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:05.191176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f302b2-de5d-4268-bfd4-6a714271acbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:05.191598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f302b2-de5d-4268-bfd4-6a714271acbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:05.219905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f8f302b2-de5d-4268-bfd4-6a714271acbb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Aug 06 12:47:05.220643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 725/1442] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:06.169003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0b4c761e-6914-47b6-83d4-9a3480a8f608 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:06.171139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0b4c761e-6914-47b6-83d4-9a3480a8f608 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:06.177632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4c761e-6914-47b6-83d4-9a3480a8f608 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:06.178107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4c761e-6914-47b6-83d4-9a3480a8f608 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:06.178573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4c761e-6914-47b6-83d4-9a3480a8f608 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:06.179267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4c761e-6914-47b6-83d4-9a3480a8f608 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:06.179718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4c761e-6914-47b6-83d4-9a3480a8f608 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:06.180138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b4c761e-6914-47b6-83d4-9a3480a8f608 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:06.207962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0b4c761e-6914-47b6-83d4-9a3480a8f608 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042937 Aug 06 12:47:06.208525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 718/1443] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:06.232797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-09b0035c-e426-482a-9278-44e1f961037f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:06.235044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-09b0035c-e426-482a-9278-44e1f961037f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:06.241588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09b0035c-e426-482a-9278-44e1f961037f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:06.242073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09b0035c-e426-482a-9278-44e1f961037f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:06.242499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09b0035c-e426-482a-9278-44e1f961037f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:06.243193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09b0035c-e426-482a-9278-44e1f961037f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:06.243641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09b0035c-e426-482a-9278-44e1f961037f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:06.244061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09b0035c-e426-482a-9278-44e1f961037f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:06.272290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-09b0035c-e426-482a-9278-44e1f961037f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043419 Aug 06 12:47:06.274656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 726/1444] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:07.220701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cb79d2ae-22be-4c33-9866-de0dce16e56f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:07.222750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cb79d2ae-22be-4c33-9866-de0dce16e56f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:07.229582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb79d2ae-22be-4c33-9866-de0dce16e56f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:07.230054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb79d2ae-22be-4c33-9866-de0dce16e56f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:07.230485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb79d2ae-22be-4c33-9866-de0dce16e56f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:07.231169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb79d2ae-22be-4c33-9866-de0dce16e56f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:07.231613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb79d2ae-22be-4c33-9866-de0dce16e56f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:07.232029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb79d2ae-22be-4c33-9866-de0dce16e56f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:07.261438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cb79d2ae-22be-4c33-9866-de0dce16e56f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044726 Aug 06 12:47:07.261990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 719/1445] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:07 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:07.284694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b13280b4-fecc-49f9-867d-d984c6a48993 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:07.286845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b13280b4-fecc-49f9-867d-d984c6a48993 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:07.293711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13280b4-fecc-49f9-867d-d984c6a48993 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:07.294200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13280b4-fecc-49f9-867d-d984c6a48993 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:07.294636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13280b4-fecc-49f9-867d-d984c6a48993 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:07.295337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13280b4-fecc-49f9-867d-d984c6a48993 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:07.295789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13280b4-fecc-49f9-867d-d984c6a48993 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:07.296217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13280b4-fecc-49f9-867d-d984c6a48993 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:07.325748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b13280b4-fecc-49f9-867d-d984c6a48993 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Aug 06 12:47:07.326328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 727/1446] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:08.274183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7eb7158d-32a1-4133-9ca3-fee051c17a91 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:08.276274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7eb7158d-32a1-4133-9ca3-fee051c17a91 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:08.282642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb7158d-32a1-4133-9ca3-fee051c17a91 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:08.283125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb7158d-32a1-4133-9ca3-fee051c17a91 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:08.283561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb7158d-32a1-4133-9ca3-fee051c17a91 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:08.284249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb7158d-32a1-4133-9ca3-fee051c17a91 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:08.284729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb7158d-32a1-4133-9ca3-fee051c17a91 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:08.285157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb7158d-32a1-4133-9ca3-fee051c17a91 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:08.313481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7eb7158d-32a1-4133-9ca3-fee051c17a91 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Aug 06 12:47:08.314024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 720/1447] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:08.338068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-446fdecc-59b2-4bb0-8c57-310be4308f2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:08.340487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-446fdecc-59b2-4bb0-8c57-310be4308f2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:08.346682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-446fdecc-59b2-4bb0-8c57-310be4308f2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:08.347164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-446fdecc-59b2-4bb0-8c57-310be4308f2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:08.347598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-446fdecc-59b2-4bb0-8c57-310be4308f2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:08.348289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-446fdecc-59b2-4bb0-8c57-310be4308f2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:08.348758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-446fdecc-59b2-4bb0-8c57-310be4308f2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:08.349180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-446fdecc-59b2-4bb0-8c57-310be4308f2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:08.379577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-446fdecc-59b2-4bb0-8c57-310be4308f2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045854 Aug 06 12:47:08.380145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 728/1448] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:08 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:09.326709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-221721a4-1272-4264-973a-ee001cefdbd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:09.328917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-221721a4-1272-4264-973a-ee001cefdbd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:09.335192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221721a4-1272-4264-973a-ee001cefdbd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:09.336159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221721a4-1272-4264-973a-ee001cefdbd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:09.336612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221721a4-1272-4264-973a-ee001cefdbd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:09.337292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221721a4-1272-4264-973a-ee001cefdbd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:09.337741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221721a4-1272-4264-973a-ee001cefdbd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:09.338161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221721a4-1272-4264-973a-ee001cefdbd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:09.366625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-221721a4-1272-4264-973a-ee001cefdbd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Aug 06 12:47:09.367162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 721/1449] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:09.390906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a61d8f0c-d575-48bd-a833-933e6cae82c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:09.393043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a61d8f0c-d575-48bd-a833-933e6cae82c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:09.399808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61d8f0c-d575-48bd-a833-933e6cae82c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:09.400321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61d8f0c-d575-48bd-a833-933e6cae82c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:09.400764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61d8f0c-d575-48bd-a833-933e6cae82c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:09.401444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61d8f0c-d575-48bd-a833-933e6cae82c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:09.401887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61d8f0c-d575-48bd-a833-933e6cae82c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:09.402300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a61d8f0c-d575-48bd-a833-933e6cae82c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:09.430644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a61d8f0c-d575-48bd-a833-933e6cae82c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Aug 06 12:47:09.431196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 729/1450] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:10.379423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7739fdc7-8c5d-435a-bcb5-323f3fcc84d3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:10.381581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7739fdc7-8c5d-435a-bcb5-323f3fcc84d3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:10.387919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7739fdc7-8c5d-435a-bcb5-323f3fcc84d3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:10.388433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7739fdc7-8c5d-435a-bcb5-323f3fcc84d3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:10.388875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7739fdc7-8c5d-435a-bcb5-323f3fcc84d3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:10.389564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7739fdc7-8c5d-435a-bcb5-323f3fcc84d3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:10.390019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7739fdc7-8c5d-435a-bcb5-323f3fcc84d3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:10.390444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7739fdc7-8c5d-435a-bcb5-323f3fcc84d3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:10.418960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7739fdc7-8c5d-435a-bcb5-323f3fcc84d3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043614 Aug 06 12:47:10.419498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 722/1451] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:10.442617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cc9d0574-0a4d-4714-bacb-02509e609633 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:10.444832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cc9d0574-0a4d-4714-bacb-02509e609633 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:10.451083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc9d0574-0a4d-4714-bacb-02509e609633 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:10.451563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc9d0574-0a4d-4714-bacb-02509e609633 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:10.451993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc9d0574-0a4d-4714-bacb-02509e609633 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:10.452711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc9d0574-0a4d-4714-bacb-02509e609633 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:10.453158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc9d0574-0a4d-4714-bacb-02509e609633 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:10.453577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc9d0574-0a4d-4714-bacb-02509e609633 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:10.482411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cc9d0574-0a4d-4714-bacb-02509e609633 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Aug 06 12:47:10.482980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 730/1452] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:11.430532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-813cf050-d35e-47b0-84ed-9b174f2c50dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:11.432707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-813cf050-d35e-47b0-84ed-9b174f2c50dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:11.439065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813cf050-d35e-47b0-84ed-9b174f2c50dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:11.439541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813cf050-d35e-47b0-84ed-9b174f2c50dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:11.439976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813cf050-d35e-47b0-84ed-9b174f2c50dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:11.440688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813cf050-d35e-47b0-84ed-9b174f2c50dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:11.441157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813cf050-d35e-47b0-84ed-9b174f2c50dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:11.441566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813cf050-d35e-47b0-84ed-9b174f2c50dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:11.470908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-813cf050-d35e-47b0-84ed-9b174f2c50dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Aug 06 12:47:11.471455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 723/1453] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:11.494205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c7c7f8e5-b586-4137-b5af-1e5fee8cd016 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:11.496387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c7c7f8e5-b586-4137-b5af-1e5fee8cd016 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:11.502707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7f8e5-b586-4137-b5af-1e5fee8cd016 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:11.503181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7f8e5-b586-4137-b5af-1e5fee8cd016 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:11.503611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7f8e5-b586-4137-b5af-1e5fee8cd016 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:11.504490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7f8e5-b586-4137-b5af-1e5fee8cd016 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:11.504944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7f8e5-b586-4137-b5af-1e5fee8cd016 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:11.505363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7f8e5-b586-4137-b5af-1e5fee8cd016 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:11.509164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:47:11.534679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c7c7f8e5-b586-4137-b5af-1e5fee8cd016 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Aug 06 12:47:11.535238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 731/1454] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:12.483024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d01fd848-09f4-4647-969d-209d9a0a69d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:12.485192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d01fd848-09f4-4647-969d-209d9a0a69d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:12.492407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d01fd848-09f4-4647-969d-209d9a0a69d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:12.492881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d01fd848-09f4-4647-969d-209d9a0a69d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:12.493308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d01fd848-09f4-4647-969d-209d9a0a69d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:12.493985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d01fd848-09f4-4647-969d-209d9a0a69d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:12.494429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d01fd848-09f4-4647-969d-209d9a0a69d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:12.494844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d01fd848-09f4-4647-969d-209d9a0a69d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:12.522501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d01fd848-09f4-4647-969d-209d9a0a69d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043382 Aug 06 12:47:12.523031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 724/1455] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:12.546953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f8f7f9e2-fd96-4be4-8349-66d9bfd6c189 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:12.549364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f8f7f9e2-fd96-4be4-8349-66d9bfd6c189 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:12.558156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f7f9e2-fd96-4be4-8349-66d9bfd6c189 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:12.559027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f7f9e2-fd96-4be4-8349-66d9bfd6c189 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:12.559839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f7f9e2-fd96-4be4-8349-66d9bfd6c189 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:12.560742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f7f9e2-fd96-4be4-8349-66d9bfd6c189 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:12.561234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f7f9e2-fd96-4be4-8349-66d9bfd6c189 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:12.561922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8f7f9e2-fd96-4be4-8349-66d9bfd6c189 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:12.595268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f8f7f9e2-fd96-4be4-8349-66d9bfd6c189 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052201 Aug 06 12:47:12.596043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 732/1456] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:13.534586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b09d055c-dda0-4ba8-9230-7850e72ea370 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:13.536739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b09d055c-dda0-4ba8-9230-7850e72ea370 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:13.543012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09d055c-dda0-4ba8-9230-7850e72ea370 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:13.543487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09d055c-dda0-4ba8-9230-7850e72ea370 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:13.543916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09d055c-dda0-4ba8-9230-7850e72ea370 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:13.544649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09d055c-dda0-4ba8-9230-7850e72ea370 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:13.545095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09d055c-dda0-4ba8-9230-7850e72ea370 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:13.545512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09d055c-dda0-4ba8-9230-7850e72ea370 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:13.574629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b09d055c-dda0-4ba8-9230-7850e72ea370 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Aug 06 12:47:13.575170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 725/1457] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:13 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:13.607029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8ab6f24a-491f-4feb-8881-91525af7b192 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:13.609176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8ab6f24a-491f-4feb-8881-91525af7b192 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:13.615701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ab6f24a-491f-4feb-8881-91525af7b192 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:13.616171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ab6f24a-491f-4feb-8881-91525af7b192 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:13.617144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ab6f24a-491f-4feb-8881-91525af7b192 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:13.617815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ab6f24a-491f-4feb-8881-91525af7b192 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:13.618263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ab6f24a-491f-4feb-8881-91525af7b192 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:13.618676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ab6f24a-491f-4feb-8881-91525af7b192 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:13.647926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8ab6f24a-491f-4feb-8881-91525af7b192 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Aug 06 12:47:13.648510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 733/1458] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:14.587125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6130e202-398e-4fcb-a37a-ee74a97a50f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:14.589295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6130e202-398e-4fcb-a37a-ee74a97a50f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:14.591569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=67 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:47:14.597083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6130e202-398e-4fcb-a37a-ee74a97a50f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:14.597560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6130e202-398e-4fcb-a37a-ee74a97a50f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:14.597992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6130e202-398e-4fcb-a37a-ee74a97a50f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:14.598677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6130e202-398e-4fcb-a37a-ee74a97a50f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:14.599128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6130e202-398e-4fcb-a37a-ee74a97a50f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:14.599849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6130e202-398e-4fcb-a37a-ee74a97a50f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:14.629166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6130e202-398e-4fcb-a37a-ee74a97a50f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046500 Aug 06 12:47:14.629711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 726/1459] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:14.659483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-37fa3acb-a5a9-4af5-b1c3-c2ee32df1e47 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:14.661679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-37fa3acb-a5a9-4af5-b1c3-c2ee32df1e47 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:14.664627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=73 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:47:14.669463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37fa3acb-a5a9-4af5-b1c3-c2ee32df1e47 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:14.669936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37fa3acb-a5a9-4af5-b1c3-c2ee32df1e47 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:14.670365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37fa3acb-a5a9-4af5-b1c3-c2ee32df1e47 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:14.671047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37fa3acb-a5a9-4af5-b1c3-c2ee32df1e47 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:14.671504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37fa3acb-a5a9-4af5-b1c3-c2ee32df1e47 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:14.671924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37fa3acb-a5a9-4af5-b1c3-c2ee32df1e47 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:14.701407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-37fa3acb-a5a9-4af5-b1c3-c2ee32df1e47 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Aug 06 12:47:14.701964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 734/1460] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:15.640272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eca62d9e-f909-40d5-b210-a699d5e301a9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:15.642448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eca62d9e-f909-40d5-b210-a699d5e301a9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:15.649468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca62d9e-f909-40d5-b210-a699d5e301a9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:15.649947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca62d9e-f909-40d5-b210-a699d5e301a9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:15.650382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca62d9e-f909-40d5-b210-a699d5e301a9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:15.651340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca62d9e-f909-40d5-b210-a699d5e301a9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:15.651794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca62d9e-f909-40d5-b210-a699d5e301a9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:15.652216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca62d9e-f909-40d5-b210-a699d5e301a9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:15.668991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:47:15.682158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eca62d9e-f909-40d5-b210-a699d5e301a9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045818 Aug 06 12:47:15.682715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 727/1461] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:15.714210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb1b4ab2-4515-4110-b762-2ba2e51f9d27 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:15.716412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb1b4ab2-4515-4110-b762-2ba2e51f9d27 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:15.722665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ab2-4515-4110-b762-2ba2e51f9d27 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:15.723135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ab2-4515-4110-b762-2ba2e51f9d27 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:15.723559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ab2-4515-4110-b762-2ba2e51f9d27 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:15.724228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ab2-4515-4110-b762-2ba2e51f9d27 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:15.724700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ab2-4515-4110-b762-2ba2e51f9d27 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:15.725114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ab2-4515-4110-b762-2ba2e51f9d27 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:15.753292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb1b4ab2-4515-4110-b762-2ba2e51f9d27 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Aug 06 12:47:15.754036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 735/1462] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:15 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:16.693990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b7e98b5-919f-445f-a958-2ab3ef985e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:16.696137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7b7e98b5-919f-445f-a958-2ab3ef985e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:16.702483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b7e98b5-919f-445f-a958-2ab3ef985e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:16.702964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b7e98b5-919f-445f-a958-2ab3ef985e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:16.703401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b7e98b5-919f-445f-a958-2ab3ef985e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:16.704090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b7e98b5-919f-445f-a958-2ab3ef985e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:16.704586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b7e98b5-919f-445f-a958-2ab3ef985e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:16.705017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b7e98b5-919f-445f-a958-2ab3ef985e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:16.734046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b7e98b5-919f-445f-a958-2ab3ef985e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Aug 06 12:47:16.734594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 728/1463] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:16.765782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e3f32b0a-846a-4265-bc31-d58fa4db8621 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:16.767914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e3f32b0a-846a-4265-bc31-d58fa4db8621 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:16.774645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3f32b0a-846a-4265-bc31-d58fa4db8621 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:16.775148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3f32b0a-846a-4265-bc31-d58fa4db8621 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:16.775577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3f32b0a-846a-4265-bc31-d58fa4db8621 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:16.776251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3f32b0a-846a-4265-bc31-d58fa4db8621 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:16.776716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3f32b0a-846a-4265-bc31-d58fa4db8621 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:16.777131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3f32b0a-846a-4265-bc31-d58fa4db8621 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:16.806523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e3f32b0a-846a-4265-bc31-d58fa4db8621 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Aug 06 12:47:16.807214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 736/1464] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:17.745833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-51108ed8-9e64-4d8f-8abf-307b50bb2666 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:17.747961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-51108ed8-9e64-4d8f-8abf-307b50bb2666 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:17.754254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51108ed8-9e64-4d8f-8abf-307b50bb2666 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:17.754728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51108ed8-9e64-4d8f-8abf-307b50bb2666 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:17.755158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51108ed8-9e64-4d8f-8abf-307b50bb2666 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:17.755832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51108ed8-9e64-4d8f-8abf-307b50bb2666 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:17.756276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51108ed8-9e64-4d8f-8abf-307b50bb2666 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:17.756716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51108ed8-9e64-4d8f-8abf-307b50bb2666 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:17.785440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-51108ed8-9e64-4d8f-8abf-307b50bb2666 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043503 Aug 06 12:47:17.785977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 729/1465] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:17.818431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8bd601e8-f187-45b5-aa5b-586220335288 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:17.821171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8bd601e8-f187-45b5-aa5b-586220335288 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:17.827681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bd601e8-f187-45b5-aa5b-586220335288 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:17.828163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bd601e8-f187-45b5-aa5b-586220335288 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:17.828629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bd601e8-f187-45b5-aa5b-586220335288 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:17.829317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bd601e8-f187-45b5-aa5b-586220335288 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:17.829772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bd601e8-f187-45b5-aa5b-586220335288 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:17.830197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bd601e8-f187-45b5-aa5b-586220335288 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:17.859382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8bd601e8-f187-45b5-aa5b-586220335288 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Aug 06 12:47:17.859881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 737/1466] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:18.797864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d4caac2-1b18-48f7-9114-b5d498b2af93 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:18.800069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3d4caac2-1b18-48f7-9114-b5d498b2af93 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:18.806931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4caac2-1b18-48f7-9114-b5d498b2af93 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:18.807412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4caac2-1b18-48f7-9114-b5d498b2af93 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:18.807864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4caac2-1b18-48f7-9114-b5d498b2af93 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:18.808557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4caac2-1b18-48f7-9114-b5d498b2af93 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:18.809034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4caac2-1b18-48f7-9114-b5d498b2af93 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:18.809438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d4caac2-1b18-48f7-9114-b5d498b2af93 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:18.838411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3d4caac2-1b18-48f7-9114-b5d498b2af93 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 06 12:47:18.838972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 730/1467] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:18 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:18.871960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d8822dea-2862-4ab8-ad28-d32ebd090398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:18.874102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d8822dea-2862-4ab8-ad28-d32ebd090398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:18.880267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8822dea-2862-4ab8-ad28-d32ebd090398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:18.880783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8822dea-2862-4ab8-ad28-d32ebd090398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:18.881209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8822dea-2862-4ab8-ad28-d32ebd090398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:18.881914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8822dea-2862-4ab8-ad28-d32ebd090398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:18.882930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8822dea-2862-4ab8-ad28-d32ebd090398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:18.883350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8822dea-2862-4ab8-ad28-d32ebd090398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:18.911945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d8822dea-2862-4ab8-ad28-d32ebd090398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043757 Aug 06 12:47:18.912660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 738/1468] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:18 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:19.849629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8d2b2a21-c3fd-437e-b36b-dba703b6917f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:19.851754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8d2b2a21-c3fd-437e-b36b-dba703b6917f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:19.857801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d2b2a21-c3fd-437e-b36b-dba703b6917f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:19.858280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d2b2a21-c3fd-437e-b36b-dba703b6917f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:19.858710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d2b2a21-c3fd-437e-b36b-dba703b6917f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:19.859394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d2b2a21-c3fd-437e-b36b-dba703b6917f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:19.859847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d2b2a21-c3fd-437e-b36b-dba703b6917f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:19.860270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d2b2a21-c3fd-437e-b36b-dba703b6917f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:19.889503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8d2b2a21-c3fd-437e-b36b-dba703b6917f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043800 Aug 06 12:47:19.890021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 731/1469] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:19.923814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ae441ae4-ab2e-49a9-b620-5e10f3b81462 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:19.925970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ae441ae4-ab2e-49a9-b620-5e10f3b81462 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:19.932778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae441ae4-ab2e-49a9-b620-5e10f3b81462 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:19.933254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae441ae4-ab2e-49a9-b620-5e10f3b81462 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:19.933673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae441ae4-ab2e-49a9-b620-5e10f3b81462 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:19.934345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae441ae4-ab2e-49a9-b620-5e10f3b81462 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:19.934788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae441ae4-ab2e-49a9-b620-5e10f3b81462 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:19.935200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae441ae4-ab2e-49a9-b620-5e10f3b81462 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:19.963029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ae441ae4-ab2e-49a9-b620-5e10f3b81462 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043043 Aug 06 12:47:19.963566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 739/1470] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:20.901831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1cda3aa7-b267-4cb0-9bdb-b83af563556c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:20.903945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1cda3aa7-b267-4cb0-9bdb-b83af563556c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:20.910660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cda3aa7-b267-4cb0-9bdb-b83af563556c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:20.911150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cda3aa7-b267-4cb0-9bdb-b83af563556c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:20.911585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cda3aa7-b267-4cb0-9bdb-b83af563556c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:20.912286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cda3aa7-b267-4cb0-9bdb-b83af563556c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:20.912760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cda3aa7-b267-4cb0-9bdb-b83af563556c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:20.913185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cda3aa7-b267-4cb0-9bdb-b83af563556c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:20.942411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1cda3aa7-b267-4cb0-9bdb-b83af563556c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Aug 06 12:47:20.942960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 732/1471] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:20.975926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f7d51575-71f8-499a-957b-1e1494674e89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:20.977630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f7d51575-71f8-499a-957b-1e1494674e89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:20.984269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d51575-71f8-499a-957b-1e1494674e89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:20.984779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d51575-71f8-499a-957b-1e1494674e89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:20.985217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d51575-71f8-499a-957b-1e1494674e89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:20.986310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d51575-71f8-499a-957b-1e1494674e89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:20.986765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d51575-71f8-499a-957b-1e1494674e89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:20.987212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d51575-71f8-499a-957b-1e1494674e89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:21.019031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f7d51575-71f8-499a-957b-1e1494674e89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047802 Aug 06 12:47:21.019793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 740/1472] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:21.954933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6565538d-b54e-42fc-b20c-375107c3be28 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:21.957092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6565538d-b54e-42fc-b20c-375107c3be28 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:21.963832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6565538d-b54e-42fc-b20c-375107c3be28 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:21.964327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6565538d-b54e-42fc-b20c-375107c3be28 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:21.964768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6565538d-b54e-42fc-b20c-375107c3be28 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:21.965454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6565538d-b54e-42fc-b20c-375107c3be28 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:21.965904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6565538d-b54e-42fc-b20c-375107c3be28 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:21.966324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6565538d-b54e-42fc-b20c-375107c3be28 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:21.995104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6565538d-b54e-42fc-b20c-375107c3be28 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Aug 06 12:47:21.995668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 733/1473] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:21 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:22.031527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-310ca31f-cabe-45cd-998e-ba4dd868671e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:22.033704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-310ca31f-cabe-45cd-998e-ba4dd868671e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:22.040595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310ca31f-cabe-45cd-998e-ba4dd868671e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:22.041064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310ca31f-cabe-45cd-998e-ba4dd868671e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:22.041490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310ca31f-cabe-45cd-998e-ba4dd868671e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:22.042169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310ca31f-cabe-45cd-998e-ba4dd868671e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:22.042602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310ca31f-cabe-45cd-998e-ba4dd868671e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:22.043016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310ca31f-cabe-45cd-998e-ba4dd868671e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:22.070799 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-310ca31f-cabe-45cd-998e-ba4dd868671e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043208 Aug 06 12:47:22.071337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 741/1474] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:23.007066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-58309117-4d92-4a0e-b698-022615f7df9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:23.009227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-58309117-4d92-4a0e-b698-022615f7df9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:23.015574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58309117-4d92-4a0e-b698-022615f7df9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:23.016049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58309117-4d92-4a0e-b698-022615f7df9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:23.016544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58309117-4d92-4a0e-b698-022615f7df9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:23.017205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58309117-4d92-4a0e-b698-022615f7df9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:23.017655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58309117-4d92-4a0e-b698-022615f7df9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:23.018070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58309117-4d92-4a0e-b698-022615f7df9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:23.046114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-58309117-4d92-4a0e-b698-022615f7df9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042981 Aug 06 12:47:23.046644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 734/1475] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:23 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:23.083046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7c5c6f42-067f-4d25-bc9a-7d920a122fde tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:23.085224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7c5c6f42-067f-4d25-bc9a-7d920a122fde tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:23.091461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c5c6f42-067f-4d25-bc9a-7d920a122fde tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:23.091935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c5c6f42-067f-4d25-bc9a-7d920a122fde tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:23.092396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c5c6f42-067f-4d25-bc9a-7d920a122fde tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:23.093076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c5c6f42-067f-4d25-bc9a-7d920a122fde tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:23.093523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c5c6f42-067f-4d25-bc9a-7d920a122fde tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:23.093941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c5c6f42-067f-4d25-bc9a-7d920a122fde tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:23.123421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7c5c6f42-067f-4d25-bc9a-7d920a122fde tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044223 Aug 06 12:47:23.123981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 742/1476] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:24.058099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7dd74f36-66a5-49b9-b2a2-c6e3bc843448 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:24.060342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7dd74f36-66a5-49b9-b2a2-c6e3bc843448 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:24.066769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dd74f36-66a5-49b9-b2a2-c6e3bc843448 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:24.067249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dd74f36-66a5-49b9-b2a2-c6e3bc843448 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:24.067678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dd74f36-66a5-49b9-b2a2-c6e3bc843448 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:24.068386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dd74f36-66a5-49b9-b2a2-c6e3bc843448 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:24.068836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dd74f36-66a5-49b9-b2a2-c6e3bc843448 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:24.069256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dd74f36-66a5-49b9-b2a2-c6e3bc843448 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:24.097721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7dd74f36-66a5-49b9-b2a2-c6e3bc843448 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 Aug 06 12:47:24.098266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 735/1477] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:24 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:24.135818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-88770bcf-f70e-4613-bc36-4e06b09a5f1b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:24.138027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-88770bcf-f70e-4613-bc36-4e06b09a5f1b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:24.144625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88770bcf-f70e-4613-bc36-4e06b09a5f1b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:24.145109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88770bcf-f70e-4613-bc36-4e06b09a5f1b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:24.145544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88770bcf-f70e-4613-bc36-4e06b09a5f1b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:24.146233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88770bcf-f70e-4613-bc36-4e06b09a5f1b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:24.146687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88770bcf-f70e-4613-bc36-4e06b09a5f1b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:24.147110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-88770bcf-f70e-4613-bc36-4e06b09a5f1b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:24.175108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-88770bcf-f70e-4613-bc36-4e06b09a5f1b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043897 Aug 06 12:47:24.175650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 743/1478] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:25.109904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-23ef58d7-2f97-459e-b910-0928bde5ab1d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:25.112273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-23ef58d7-2f97-459e-b910-0928bde5ab1d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:25.118563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23ef58d7-2f97-459e-b910-0928bde5ab1d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:25.119036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23ef58d7-2f97-459e-b910-0928bde5ab1d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:25.119462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23ef58d7-2f97-459e-b910-0928bde5ab1d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:25.120508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23ef58d7-2f97-459e-b910-0928bde5ab1d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:25.120957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23ef58d7-2f97-459e-b910-0928bde5ab1d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:25.121380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23ef58d7-2f97-459e-b910-0928bde5ab1d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:25.150679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-23ef58d7-2f97-459e-b910-0928bde5ab1d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Aug 06 12:47:25.151249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 736/1479] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:25 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:25.186968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-70ba0429-47f5-4825-850b-5a3629af770c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:25.189133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-70ba0429-47f5-4825-850b-5a3629af770c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:25.195407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70ba0429-47f5-4825-850b-5a3629af770c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:25.195885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70ba0429-47f5-4825-850b-5a3629af770c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:25.196860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70ba0429-47f5-4825-850b-5a3629af770c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:25.197537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70ba0429-47f5-4825-850b-5a3629af770c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:25.197983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70ba0429-47f5-4825-850b-5a3629af770c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:25.198399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70ba0429-47f5-4825-850b-5a3629af770c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:25.226375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-70ba0429-47f5-4825-850b-5a3629af770c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 Aug 06 12:47:25.227042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 744/1480] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:26.162915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9267488b-b7f9-4525-b31a-6a4aa9dba8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:26.166568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9267488b-b7f9-4525-b31a-6a4aa9dba8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:26.171503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9267488b-b7f9-4525-b31a-6a4aa9dba8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:26.171987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9267488b-b7f9-4525-b31a-6a4aa9dba8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:26.172454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9267488b-b7f9-4525-b31a-6a4aa9dba8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:26.173148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9267488b-b7f9-4525-b31a-6a4aa9dba8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:26.173598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9267488b-b7f9-4525-b31a-6a4aa9dba8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:26.174020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9267488b-b7f9-4525-b31a-6a4aa9dba8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:26.202275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9267488b-b7f9-4525-b31a-6a4aa9dba8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043310 Aug 06 12:47:26.202830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 737/1481] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:26 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:26.238134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a0817acd-3529-4d28-950f-2a56cf78502d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:26.240268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a0817acd-3529-4d28-950f-2a56cf78502d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:26.247087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0817acd-3529-4d28-950f-2a56cf78502d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:26.247565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0817acd-3529-4d28-950f-2a56cf78502d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:26.248000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0817acd-3529-4d28-950f-2a56cf78502d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:26.248713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0817acd-3529-4d28-950f-2a56cf78502d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:26.249172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0817acd-3529-4d28-950f-2a56cf78502d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:26.249595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0817acd-3529-4d28-950f-2a56cf78502d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:26.283372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a0817acd-3529-4d28-950f-2a56cf78502d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049292 Aug 06 12:47:26.283942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 745/1482] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:27.214675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f4b7ea8e-4d2b-4a40-aed2-06ad041b713b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:27.216823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f4b7ea8e-4d2b-4a40-aed2-06ad041b713b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:27.223560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4b7ea8e-4d2b-4a40-aed2-06ad041b713b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:27.224060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4b7ea8e-4d2b-4a40-aed2-06ad041b713b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:27.224524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4b7ea8e-4d2b-4a40-aed2-06ad041b713b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:27.225247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4b7ea8e-4d2b-4a40-aed2-06ad041b713b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:27.225696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4b7ea8e-4d2b-4a40-aed2-06ad041b713b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:27.226123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4b7ea8e-4d2b-4a40-aed2-06ad041b713b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:27.267496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f4b7ea8e-4d2b-4a40-aed2-06ad041b713b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056687 Aug 06 12:47:27.267971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 738/1483] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:27 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:27.295034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bc8ffe7a-cdd1-4adc-8c31-c10dc198ff6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:27.297236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bc8ffe7a-cdd1-4adc-8c31-c10dc198ff6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:27.303493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8ffe7a-cdd1-4adc-8c31-c10dc198ff6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:27.303967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8ffe7a-cdd1-4adc-8c31-c10dc198ff6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:27.304428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8ffe7a-cdd1-4adc-8c31-c10dc198ff6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:27.305106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8ffe7a-cdd1-4adc-8c31-c10dc198ff6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:27.306058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8ffe7a-cdd1-4adc-8c31-c10dc198ff6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:27.306478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8ffe7a-cdd1-4adc-8c31-c10dc198ff6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:27.334789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bc8ffe7a-cdd1-4adc-8c31-c10dc198ff6a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043743 Aug 06 12:47:27.335327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 746/1484] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:28.279312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e3ba62a8-afe4-4281-aff6-ce075a57f356 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:28.281392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e3ba62a8-afe4-4281-aff6-ce075a57f356 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:28.287626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3ba62a8-afe4-4281-aff6-ce075a57f356 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:28.288125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3ba62a8-afe4-4281-aff6-ce075a57f356 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:28.288587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3ba62a8-afe4-4281-aff6-ce075a57f356 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:28.289263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3ba62a8-afe4-4281-aff6-ce075a57f356 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:28.290199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3ba62a8-afe4-4281-aff6-ce075a57f356 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:28.290616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3ba62a8-afe4-4281-aff6-ce075a57f356 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:28.319742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e3ba62a8-afe4-4281-aff6-ce075a57f356 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Aug 06 12:47:28.320293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 739/1485] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:28 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:28.346668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7dc55549-a05c-4227-b7c4-aa818407cdac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:28.348833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7dc55549-a05c-4227-b7c4-aa818407cdac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:28.355518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7dc55549-a05c-4227-b7c4-aa818407cdac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:28.355994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7dc55549-a05c-4227-b7c4-aa818407cdac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:28.356469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7dc55549-a05c-4227-b7c4-aa818407cdac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:28.357135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7dc55549-a05c-4227-b7c4-aa818407cdac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:28.357581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7dc55549-a05c-4227-b7c4-aa818407cdac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:28.357998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7dc55549-a05c-4227-b7c4-aa818407cdac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:28.382524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:47:28.388173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7dc55549-a05c-4227-b7c4-aa818407cdac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Aug 06 12:47:28.388748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 747/1486] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:28 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:29.331457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ac3425ab-ee29-48d6-be7b-ecca2e777513 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:29.333635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ac3425ab-ee29-48d6-be7b-ecca2e777513 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:29.339818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac3425ab-ee29-48d6-be7b-ecca2e777513 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:29.340289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac3425ab-ee29-48d6-be7b-ecca2e777513 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:29.340751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac3425ab-ee29-48d6-be7b-ecca2e777513 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:29.341427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac3425ab-ee29-48d6-be7b-ecca2e777513 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:29.341870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac3425ab-ee29-48d6-be7b-ecca2e777513 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:29.342286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac3425ab-ee29-48d6-be7b-ecca2e777513 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:29.371042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ac3425ab-ee29-48d6-be7b-ecca2e777513 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Aug 06 12:47:29.371526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 740/1487] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:29 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:29.400120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-010fc549-2504-4244-a317-5d2d075f5de8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:29.402419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-010fc549-2504-4244-a317-5d2d075f5de8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:29.408986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-010fc549-2504-4244-a317-5d2d075f5de8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:29.409464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-010fc549-2504-4244-a317-5d2d075f5de8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:29.409894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-010fc549-2504-4244-a317-5d2d075f5de8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:29.410570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-010fc549-2504-4244-a317-5d2d075f5de8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:29.411045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-010fc549-2504-4244-a317-5d2d075f5de8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:29.411463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-010fc549-2504-4244-a317-5d2d075f5de8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:29.439733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-010fc549-2504-4244-a317-5d2d075f5de8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043535 Aug 06 12:47:29.440274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 748/1488] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:30.383000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2bb57bb9-4de4-468f-b159-3ebe2059116c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:30.385658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2bb57bb9-4de4-468f-b159-3ebe2059116c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:30.391932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb57bb9-4de4-468f-b159-3ebe2059116c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:30.392442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb57bb9-4de4-468f-b159-3ebe2059116c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:30.392871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb57bb9-4de4-468f-b159-3ebe2059116c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:30.393547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb57bb9-4de4-468f-b159-3ebe2059116c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:30.393993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb57bb9-4de4-468f-b159-3ebe2059116c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:30.394411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bb57bb9-4de4-468f-b159-3ebe2059116c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:30.423357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2bb57bb9-4de4-468f-b159-3ebe2059116c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Aug 06 12:47:30.423913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 741/1489] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:30 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:30.451396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a8faecb9-3749-4383-afe7-819b259add2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:30.453562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a8faecb9-3749-4383-afe7-819b259add2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:30.459878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8faecb9-3749-4383-afe7-819b259add2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:30.460396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8faecb9-3749-4383-afe7-819b259add2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:30.460832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8faecb9-3749-4383-afe7-819b259add2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:30.462160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8faecb9-3749-4383-afe7-819b259add2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:30.462619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8faecb9-3749-4383-afe7-819b259add2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:30.463046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a8faecb9-3749-4383-afe7-819b259add2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:30.491124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a8faecb9-3749-4383-afe7-819b259add2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Aug 06 12:47:30.491660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 749/1490] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:31.435474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bb75757b-2973-4202-882b-34ca6642914a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:31.437654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bb75757b-2973-4202-882b-34ca6642914a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:31.444044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb75757b-2973-4202-882b-34ca6642914a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:31.444553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb75757b-2973-4202-882b-34ca6642914a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:31.444977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb75757b-2973-4202-882b-34ca6642914a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:31.445661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb75757b-2973-4202-882b-34ca6642914a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:31.446111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb75757b-2973-4202-882b-34ca6642914a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:31.446531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb75757b-2973-4202-882b-34ca6642914a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:31.474611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bb75757b-2973-4202-882b-34ca6642914a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043084 Aug 06 12:47:31.475164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 742/1491] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:31 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:31.502989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2f81b447-e693-495c-a8e3-ce0e53e30cc9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:31.505136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2f81b447-e693-495c-a8e3-ce0e53e30cc9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:31.511508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f81b447-e693-495c-a8e3-ce0e53e30cc9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:31.511978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f81b447-e693-495c-a8e3-ce0e53e30cc9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:31.512434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f81b447-e693-495c-a8e3-ce0e53e30cc9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:31.513109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f81b447-e693-495c-a8e3-ce0e53e30cc9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:31.513551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f81b447-e693-495c-a8e3-ce0e53e30cc9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:31.513963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f81b447-e693-495c-a8e3-ce0e53e30cc9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:31.542491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2f81b447-e693-495c-a8e3-ce0e53e30cc9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043475 Aug 06 12:47:31.543026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 750/1492] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:32.487002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a5707ec2-dc6d-4f09-907c-7474e398af43 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:32.489149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a5707ec2-dc6d-4f09-907c-7474e398af43 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:32.495488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5707ec2-dc6d-4f09-907c-7474e398af43 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:32.495958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5707ec2-dc6d-4f09-907c-7474e398af43 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:32.496422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5707ec2-dc6d-4f09-907c-7474e398af43 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:32.497097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5707ec2-dc6d-4f09-907c-7474e398af43 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:32.497543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5707ec2-dc6d-4f09-907c-7474e398af43 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:32.497958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5707ec2-dc6d-4f09-907c-7474e398af43 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:32.526206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a5707ec2-dc6d-4f09-907c-7474e398af43 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Aug 06 12:47:32.526736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 743/1493] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:32 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:32.556559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ed0c926-220a-4194-bad2-8b7b45c25c01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:32.558748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2ed0c926-220a-4194-bad2-8b7b45c25c01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:32.565047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed0c926-220a-4194-bad2-8b7b45c25c01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:32.565558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed0c926-220a-4194-bad2-8b7b45c25c01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:32.565995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed0c926-220a-4194-bad2-8b7b45c25c01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:32.566677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed0c926-220a-4194-bad2-8b7b45c25c01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:32.567123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed0c926-220a-4194-bad2-8b7b45c25c01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:32.567541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed0c926-220a-4194-bad2-8b7b45c25c01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:32.595685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2ed0c926-220a-4194-bad2-8b7b45c25c01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Aug 06 12:47:32.596234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 751/1494] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:33.538237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d0fbd96-6e2b-4c69-8492-f7f372ecedf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:33.540884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1d0fbd96-6e2b-4c69-8492-f7f372ecedf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:33.547154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d0fbd96-6e2b-4c69-8492-f7f372ecedf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:33.547636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d0fbd96-6e2b-4c69-8492-f7f372ecedf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:33.548073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d0fbd96-6e2b-4c69-8492-f7f372ecedf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:33.548854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d0fbd96-6e2b-4c69-8492-f7f372ecedf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:33.549309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d0fbd96-6e2b-4c69-8492-f7f372ecedf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:33.549736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d0fbd96-6e2b-4c69-8492-f7f372ecedf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:33.553304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:47:33.581243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1d0fbd96-6e2b-4c69-8492-f7f372ecedf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Aug 06 12:47:33.581805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 744/1495] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:33 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:33.607448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98b55529-2380-4795-9168-4362acdde8dd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:33.609632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-98b55529-2380-4795-9168-4362acdde8dd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:33.616228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b55529-2380-4795-9168-4362acdde8dd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:33.616735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b55529-2380-4795-9168-4362acdde8dd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:33.617166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b55529-2380-4795-9168-4362acdde8dd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:33.618539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b55529-2380-4795-9168-4362acdde8dd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:33.618991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b55529-2380-4795-9168-4362acdde8dd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:33.619414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98b55529-2380-4795-9168-4362acdde8dd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:33.647878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98b55529-2380-4795-9168-4362acdde8dd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 06 12:47:33.648456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 752/1496] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:34.593370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-94195af6-c0db-470b-9089-41ce3aa4bcd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:34.595498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-94195af6-c0db-470b-9089-41ce3aa4bcd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:34.601845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94195af6-c0db-470b-9089-41ce3aa4bcd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:34.602360 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94195af6-c0db-470b-9089-41ce3aa4bcd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:34.602794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94195af6-c0db-470b-9089-41ce3aa4bcd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:34.603481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94195af6-c0db-470b-9089-41ce3aa4bcd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:34.603934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94195af6-c0db-470b-9089-41ce3aa4bcd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:34.604383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94195af6-c0db-470b-9089-41ce3aa4bcd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:34.634191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-94195af6-c0db-470b-9089-41ce3aa4bcd9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044068 Aug 06 12:47:34.634740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 745/1497] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:34 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:34.659887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-348452c7-85c0-4002-bae5-215aa5a8043b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:34.662088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-348452c7-85c0-4002-bae5-215aa5a8043b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:34.668627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-348452c7-85c0-4002-bae5-215aa5a8043b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:34.669106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-348452c7-85c0-4002-bae5-215aa5a8043b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:34.669536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-348452c7-85c0-4002-bae5-215aa5a8043b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:34.670214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-348452c7-85c0-4002-bae5-215aa5a8043b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:34.670661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-348452c7-85c0-4002-bae5-215aa5a8043b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:34.671076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-348452c7-85c0-4002-bae5-215aa5a8043b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:34.699864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-348452c7-85c0-4002-bae5-215aa5a8043b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Aug 06 12:47:34.700495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 753/1498] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:35.646417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4b668cc5-38e9-458b-b22d-5f8ba80a4d76 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:35.648549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4b668cc5-38e9-458b-b22d-5f8ba80a4d76 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:35.655453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b668cc5-38e9-458b-b22d-5f8ba80a4d76 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:35.655926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b668cc5-38e9-458b-b22d-5f8ba80a4d76 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:35.656379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b668cc5-38e9-458b-b22d-5f8ba80a4d76 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:35.657055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b668cc5-38e9-458b-b22d-5f8ba80a4d76 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:35.657499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b668cc5-38e9-458b-b22d-5f8ba80a4d76 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:35.657916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b668cc5-38e9-458b-b22d-5f8ba80a4d76 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:35.686635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4b668cc5-38e9-458b-b22d-5f8ba80a4d76 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Aug 06 12:47:35.687188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 746/1499] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:35 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:35.711641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ca0298f6-3227-4e3d-96ac-8df2e75bf507 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:35.714501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ca0298f6-3227-4e3d-96ac-8df2e75bf507 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:35.720731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca0298f6-3227-4e3d-96ac-8df2e75bf507 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:35.721203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca0298f6-3227-4e3d-96ac-8df2e75bf507 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:35.721631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca0298f6-3227-4e3d-96ac-8df2e75bf507 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:35.722300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca0298f6-3227-4e3d-96ac-8df2e75bf507 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:35.722746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca0298f6-3227-4e3d-96ac-8df2e75bf507 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:35.723158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca0298f6-3227-4e3d-96ac-8df2e75bf507 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:35.751060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ca0298f6-3227-4e3d-96ac-8df2e75bf507 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043308 Aug 06 12:47:35.751587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 754/1500] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:35 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:36.698658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d48904a-582c-4ab2-b416-bd78f5983171 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:36.700799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3d48904a-582c-4ab2-b416-bd78f5983171 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:36.706999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d48904a-582c-4ab2-b416-bd78f5983171 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:36.707469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d48904a-582c-4ab2-b416-bd78f5983171 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:36.707898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d48904a-582c-4ab2-b416-bd78f5983171 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:36.708599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d48904a-582c-4ab2-b416-bd78f5983171 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:36.709047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d48904a-582c-4ab2-b416-bd78f5983171 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:36.709464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d48904a-582c-4ab2-b416-bd78f5983171 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:36.738411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3d48904a-582c-4ab2-b416-bd78f5983171 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043627 Aug 06 12:47:36.738945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 747/1501] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:36 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:36.762896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-50dbb718-923a-4948-887f-16dc9785b067 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:36.765033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-50dbb718-923a-4948-887f-16dc9785b067 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:36.771278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50dbb718-923a-4948-887f-16dc9785b067 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:36.771754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50dbb718-923a-4948-887f-16dc9785b067 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:36.772189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50dbb718-923a-4948-887f-16dc9785b067 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:36.772898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50dbb718-923a-4948-887f-16dc9785b067 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:36.773348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50dbb718-923a-4948-887f-16dc9785b067 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:36.773768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50dbb718-923a-4948-887f-16dc9785b067 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:36.802654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-50dbb718-923a-4948-887f-16dc9785b067 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Aug 06 12:47:36.803189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 755/1502] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:37.750729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d2338b58-50bd-4df0-895b-7ec161838129 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:37.752888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d2338b58-50bd-4df0-895b-7ec161838129 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:37.759175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2338b58-50bd-4df0-895b-7ec161838129 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:37.759656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2338b58-50bd-4df0-895b-7ec161838129 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:37.760757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2338b58-50bd-4df0-895b-7ec161838129 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:37.761444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2338b58-50bd-4df0-895b-7ec161838129 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:37.761896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2338b58-50bd-4df0-895b-7ec161838129 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:37.762324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2338b58-50bd-4df0-895b-7ec161838129 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:37.790903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d2338b58-50bd-4df0-895b-7ec161838129 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Aug 06 12:47:37.791509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 748/1503] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:37 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:37.814443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-86ee5942-5614-4b4a-b0d3-7a103d8eca23 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:37.817174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-86ee5942-5614-4b4a-b0d3-7a103d8eca23 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:37.824355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86ee5942-5614-4b4a-b0d3-7a103d8eca23 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:37.824834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86ee5942-5614-4b4a-b0d3-7a103d8eca23 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:37.825259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86ee5942-5614-4b4a-b0d3-7a103d8eca23 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:37.825934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86ee5942-5614-4b4a-b0d3-7a103d8eca23 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:37.826378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86ee5942-5614-4b4a-b0d3-7a103d8eca23 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:37.826794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86ee5942-5614-4b4a-b0d3-7a103d8eca23 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:37.855046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-86ee5942-5614-4b4a-b0d3-7a103d8eca23 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 Aug 06 12:47:37.855588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 756/1504] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:37 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:38.802896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aaacaa99-fc7e-45a3-ae02-5e3bde7d4857 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:38.805142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aaacaa99-fc7e-45a3-ae02-5e3bde7d4857 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:38.811402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaacaa99-fc7e-45a3-ae02-5e3bde7d4857 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:38.811879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaacaa99-fc7e-45a3-ae02-5e3bde7d4857 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:38.812333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaacaa99-fc7e-45a3-ae02-5e3bde7d4857 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:38.813020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaacaa99-fc7e-45a3-ae02-5e3bde7d4857 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:38.813473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaacaa99-fc7e-45a3-ae02-5e3bde7d4857 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:38.813895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaacaa99-fc7e-45a3-ae02-5e3bde7d4857 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:38.842664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aaacaa99-fc7e-45a3-ae02-5e3bde7d4857 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Aug 06 12:47:38.843138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 749/1505] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:38 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:38.867206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f200ef53-19a5-4e11-9124-1cf147241928 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:38.869350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f200ef53-19a5-4e11-9124-1cf147241928 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:38.875865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f200ef53-19a5-4e11-9124-1cf147241928 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:38.876372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f200ef53-19a5-4e11-9124-1cf147241928 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:38.876802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f200ef53-19a5-4e11-9124-1cf147241928 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:38.877476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f200ef53-19a5-4e11-9124-1cf147241928 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:38.877917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f200ef53-19a5-4e11-9124-1cf147241928 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:38.878332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f200ef53-19a5-4e11-9124-1cf147241928 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:38.907782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f200ef53-19a5-4e11-9124-1cf147241928 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Aug 06 12:47:38.908342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 757/1506] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:39.854611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5ff14e13-ed08-43bc-a7ad-deff35d306de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:39.856798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5ff14e13-ed08-43bc-a7ad-deff35d306de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:39.863345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ff14e13-ed08-43bc-a7ad-deff35d306de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:39.863823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ff14e13-ed08-43bc-a7ad-deff35d306de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:39.864258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ff14e13-ed08-43bc-a7ad-deff35d306de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:39.864979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ff14e13-ed08-43bc-a7ad-deff35d306de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:39.865431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ff14e13-ed08-43bc-a7ad-deff35d306de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:39.865855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ff14e13-ed08-43bc-a7ad-deff35d306de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:39.893688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5ff14e13-ed08-43bc-a7ad-deff35d306de tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Aug 06 12:47:39.894233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 750/1507] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:39 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:39.920107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-33c535ad-1a2a-4255-bd8d-2f6f6a4495fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:39.922288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-33c535ad-1a2a-4255-bd8d-2f6f6a4495fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:39.928557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33c535ad-1a2a-4255-bd8d-2f6f6a4495fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:39.929027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33c535ad-1a2a-4255-bd8d-2f6f6a4495fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:39.929454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33c535ad-1a2a-4255-bd8d-2f6f6a4495fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:39.930127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33c535ad-1a2a-4255-bd8d-2f6f6a4495fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:39.930571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33c535ad-1a2a-4255-bd8d-2f6f6a4495fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:39.930983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33c535ad-1a2a-4255-bd8d-2f6f6a4495fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:39.958542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-33c535ad-1a2a-4255-bd8d-2f6f6a4495fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Aug 06 12:47:39.959080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 758/1508] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:40.905961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-82580029-3f87-440f-b509-d177df30aff1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:40.908198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-82580029-3f87-440f-b509-d177df30aff1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:40.914521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82580029-3f87-440f-b509-d177df30aff1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:40.915004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82580029-3f87-440f-b509-d177df30aff1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:40.915443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82580029-3f87-440f-b509-d177df30aff1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:40.916655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82580029-3f87-440f-b509-d177df30aff1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:40.917116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82580029-3f87-440f-b509-d177df30aff1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:40.917538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82580029-3f87-440f-b509-d177df30aff1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:40.946592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-82580029-3f87-440f-b509-d177df30aff1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Aug 06 12:47:40.947149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 751/1509] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:40 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:40.970422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2fe1b643-f04b-4c18-a493-449e475f212b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:40.972584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2fe1b643-f04b-4c18-a493-449e475f212b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:40.979324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fe1b643-f04b-4c18-a493-449e475f212b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:40.979793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fe1b643-f04b-4c18-a493-449e475f212b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:40.980222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fe1b643-f04b-4c18-a493-449e475f212b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:40.980917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fe1b643-f04b-4c18-a493-449e475f212b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:40.981362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fe1b643-f04b-4c18-a493-449e475f212b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:40.981776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fe1b643-f04b-4c18-a493-449e475f212b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:41.011399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2fe1b643-f04b-4c18-a493-449e475f212b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044831 Aug 06 12:47:41.011948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 759/1510] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:41.958410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a765f207-4748-4662-82c2-aa278fdb18c0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:41.960658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a765f207-4748-4662-82c2-aa278fdb18c0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:41.966943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a765f207-4748-4662-82c2-aa278fdb18c0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:41.967424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a765f207-4748-4662-82c2-aa278fdb18c0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:41.967858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a765f207-4748-4662-82c2-aa278fdb18c0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:41.968566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a765f207-4748-4662-82c2-aa278fdb18c0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:41.969016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a765f207-4748-4662-82c2-aa278fdb18c0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:41.969442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a765f207-4748-4662-82c2-aa278fdb18c0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:41.998429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a765f207-4748-4662-82c2-aa278fdb18c0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044169 Aug 06 12:47:41.999175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 752/1511] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:41 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:42.023333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d57668af-b3a3-41dd-b414-cfbcd1ee9049 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:42.025607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d57668af-b3a3-41dd-b414-cfbcd1ee9049 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:42.031878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d57668af-b3a3-41dd-b414-cfbcd1ee9049 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:42.032378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d57668af-b3a3-41dd-b414-cfbcd1ee9049 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:42.032805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d57668af-b3a3-41dd-b414-cfbcd1ee9049 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:42.033480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d57668af-b3a3-41dd-b414-cfbcd1ee9049 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:42.033922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d57668af-b3a3-41dd-b414-cfbcd1ee9049 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:42.034333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d57668af-b3a3-41dd-b414-cfbcd1ee9049 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:42.062611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d57668af-b3a3-41dd-b414-cfbcd1ee9049 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043445 Aug 06 12:47:42.063170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 760/1512] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:42 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:43.010784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1a7a020-f5e4-4fb7-884a-ff74c21f48cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:43.013034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b1a7a020-f5e4-4fb7-884a-ff74c21f48cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:43.019784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1a7a020-f5e4-4fb7-884a-ff74c21f48cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:43.020267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1a7a020-f5e4-4fb7-884a-ff74c21f48cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:43.020904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1a7a020-f5e4-4fb7-884a-ff74c21f48cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:43.021610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1a7a020-f5e4-4fb7-884a-ff74c21f48cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:43.022060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1a7a020-f5e4-4fb7-884a-ff74c21f48cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:43.022479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1a7a020-f5e4-4fb7-884a-ff74c21f48cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:43.058139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b1a7a020-f5e4-4fb7-884a-ff74c21f48cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052029 Aug 06 12:47:43.058714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 753/1513] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:43 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:43.075165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ccb9b021-bc81-4897-aa8d-bb0c3a3be6f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:43.077346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ccb9b021-bc81-4897-aa8d-bb0c3a3be6f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:43.083702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccb9b021-bc81-4897-aa8d-bb0c3a3be6f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:43.084179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccb9b021-bc81-4897-aa8d-bb0c3a3be6f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:43.084663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccb9b021-bc81-4897-aa8d-bb0c3a3be6f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:43.085355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccb9b021-bc81-4897-aa8d-bb0c3a3be6f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:43.085833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccb9b021-bc81-4897-aa8d-bb0c3a3be6f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:43.086254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccb9b021-bc81-4897-aa8d-bb0c3a3be6f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:43.115365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ccb9b021-bc81-4897-aa8d-bb0c3a3be6f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Aug 06 12:47:43.115915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 761/1514] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:44.070422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-da069276-145a-4c99-8e10-4fe1eb0bb11a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:44.072625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-da069276-145a-4c99-8e10-4fe1eb0bb11a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:44.079064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da069276-145a-4c99-8e10-4fe1eb0bb11a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:44.079547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da069276-145a-4c99-8e10-4fe1eb0bb11a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:44.079983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da069276-145a-4c99-8e10-4fe1eb0bb11a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:44.080703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da069276-145a-4c99-8e10-4fe1eb0bb11a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:44.081159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da069276-145a-4c99-8e10-4fe1eb0bb11a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:44.081585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da069276-145a-4c99-8e10-4fe1eb0bb11a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:44.110131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-da069276-145a-4c99-8e10-4fe1eb0bb11a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043616 Aug 06 12:47:44.110943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 754/1515] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:44 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:44.127041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c3c9bd33-49e1-4448-8aff-b91b0270b13b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:44.129195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c3c9bd33-49e1-4448-8aff-b91b0270b13b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:44.135428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd33-49e1-4448-8aff-b91b0270b13b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:44.135904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd33-49e1-4448-8aff-b91b0270b13b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:44.136365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd33-49e1-4448-8aff-b91b0270b13b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:44.137042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd33-49e1-4448-8aff-b91b0270b13b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:44.137486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd33-49e1-4448-8aff-b91b0270b13b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:44.137899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd33-49e1-4448-8aff-b91b0270b13b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:44.165336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c3c9bd33-49e1-4448-8aff-b91b0270b13b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042283 Aug 06 12:47:44.166348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 762/1516] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:45.123320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-35310ec4-2563-489a-85f2-a8497c71684f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:45.125498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-35310ec4-2563-489a-85f2-a8497c71684f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:45.127836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=58 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:47:45.133623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35310ec4-2563-489a-85f2-a8497c71684f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:45.134107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35310ec4-2563-489a-85f2-a8497c71684f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:45.134546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35310ec4-2563-489a-85f2-a8497c71684f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:45.135875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35310ec4-2563-489a-85f2-a8497c71684f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:45.136353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35310ec4-2563-489a-85f2-a8497c71684f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:45.136783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35310ec4-2563-489a-85f2-a8497c71684f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:45.165717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-35310ec4-2563-489a-85f2-a8497c71684f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047221 Aug 06 12:47:45.166271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 755/1517] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:45 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:45.177199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f5b927b5-4def-486c-932f-3805fc3fe614 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:45.179332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f5b927b5-4def-486c-932f-3805fc3fe614 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:45.182272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=58 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:47:45.188222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5b927b5-4def-486c-932f-3805fc3fe614 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:45.188844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5b927b5-4def-486c-932f-3805fc3fe614 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:45.189277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5b927b5-4def-486c-932f-3805fc3fe614 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:45.189959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5b927b5-4def-486c-932f-3805fc3fe614 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:45.190402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5b927b5-4def-486c-932f-3805fc3fe614 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:45.190847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5b927b5-4def-486c-932f-3805fc3fe614 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:45.219074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f5b927b5-4def-486c-932f-3805fc3fe614 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Aug 06 12:47:45.219609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 763/1518] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:46.177869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0b606dd2-8b01-45b7-a51f-2acdd13af181 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:46.180043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0b606dd2-8b01-45b7-a51f-2acdd13af181 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:46.186375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b606dd2-8b01-45b7-a51f-2acdd13af181 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:46.186854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b606dd2-8b01-45b7-a51f-2acdd13af181 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:46.187287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b606dd2-8b01-45b7-a51f-2acdd13af181 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:46.187977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b606dd2-8b01-45b7-a51f-2acdd13af181 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:46.188456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b606dd2-8b01-45b7-a51f-2acdd13af181 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:46.189018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b606dd2-8b01-45b7-a51f-2acdd13af181 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:46.218283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0b606dd2-8b01-45b7-a51f-2acdd13af181 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Aug 06 12:47:46.218822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 756/1519] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:46 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:46.231081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eb3a56b8-5ad2-4beb-a6de-0829c01f2346 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:46.233250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eb3a56b8-5ad2-4beb-a6de-0829c01f2346 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:46.239360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb3a56b8-5ad2-4beb-a6de-0829c01f2346 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:46.239828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb3a56b8-5ad2-4beb-a6de-0829c01f2346 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:46.240257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb3a56b8-5ad2-4beb-a6de-0829c01f2346 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:46.240967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb3a56b8-5ad2-4beb-a6de-0829c01f2346 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:46.241411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb3a56b8-5ad2-4beb-a6de-0829c01f2346 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:46.241825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb3a56b8-5ad2-4beb-a6de-0829c01f2346 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:46.258585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:47:46.271834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eb3a56b8-5ad2-4beb-a6de-0829c01f2346 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Aug 06 12:47:46.272400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 764/1520] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:47.230946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-95c860ce-8689-481f-9974-a54188fdeaec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:47.233103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-95c860ce-8689-481f-9974-a54188fdeaec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:47.239634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95c860ce-8689-481f-9974-a54188fdeaec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:47.240111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95c860ce-8689-481f-9974-a54188fdeaec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:47.240580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95c860ce-8689-481f-9974-a54188fdeaec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:47.248866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95c860ce-8689-481f-9974-a54188fdeaec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:47.253764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95c860ce-8689-481f-9974-a54188fdeaec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:47.253764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95c860ce-8689-481f-9974-a54188fdeaec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:47.279032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-95c860ce-8689-481f-9974-a54188fdeaec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052617 Aug 06 12:47:47.279675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 757/1521] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:47 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:47.284787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c9415027-8ad7-4089-9c28-e2c08ec49c74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:47.286901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c9415027-8ad7-4089-9c28-e2c08ec49c74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:47.294306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9415027-8ad7-4089-9c28-e2c08ec49c74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:47.294780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9415027-8ad7-4089-9c28-e2c08ec49c74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:47.295209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9415027-8ad7-4089-9c28-e2c08ec49c74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:47.295884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9415027-8ad7-4089-9c28-e2c08ec49c74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:47.296350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9415027-8ad7-4089-9c28-e2c08ec49c74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:47.296770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9415027-8ad7-4089-9c28-e2c08ec49c74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:47.324397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c9415027-8ad7-4089-9c28-e2c08ec49c74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043465 Aug 06 12:47:47.324933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 765/1522] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:48.291683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-23f124b3-cc4e-4cfc-8652-899ebdcd51b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:48.293941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-23f124b3-cc4e-4cfc-8652-899ebdcd51b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:48.300358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23f124b3-cc4e-4cfc-8652-899ebdcd51b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:48.300832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23f124b3-cc4e-4cfc-8652-899ebdcd51b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:48.301261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23f124b3-cc4e-4cfc-8652-899ebdcd51b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:48.301942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23f124b3-cc4e-4cfc-8652-899ebdcd51b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:48.302386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23f124b3-cc4e-4cfc-8652-899ebdcd51b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:48.302798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23f124b3-cc4e-4cfc-8652-899ebdcd51b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:48.331264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-23f124b3-cc4e-4cfc-8652-899ebdcd51b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Aug 06 12:47:48.331816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 758/1523] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:48 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:48.336574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a4e1d2ff-8f9f-44dd-9914-007b0f99b9aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:48.339390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a4e1d2ff-8f9f-44dd-9914-007b0f99b9aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:48.345665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4e1d2ff-8f9f-44dd-9914-007b0f99b9aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:48.346139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4e1d2ff-8f9f-44dd-9914-007b0f99b9aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:48.346568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4e1d2ff-8f9f-44dd-9914-007b0f99b9aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:48.347245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4e1d2ff-8f9f-44dd-9914-007b0f99b9aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:48.347692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4e1d2ff-8f9f-44dd-9914-007b0f99b9aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:48.348115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4e1d2ff-8f9f-44dd-9914-007b0f99b9aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:48.376235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a4e1d2ff-8f9f-44dd-9914-007b0f99b9aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Aug 06 12:47:48.376806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 766/1524] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:49.343647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fbe371ff-fddb-44ab-86f1-d1ca063e756a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:49.346030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fbe371ff-fddb-44ab-86f1-d1ca063e756a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:49.352679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbe371ff-fddb-44ab-86f1-d1ca063e756a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:49.353159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbe371ff-fddb-44ab-86f1-d1ca063e756a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:49.353593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbe371ff-fddb-44ab-86f1-d1ca063e756a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:49.354278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbe371ff-fddb-44ab-86f1-d1ca063e756a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:49.354726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbe371ff-fddb-44ab-86f1-d1ca063e756a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:49.355179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbe371ff-fddb-44ab-86f1-d1ca063e756a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:49.383556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fbe371ff-fddb-44ab-86f1-d1ca063e756a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Aug 06 12:47:49.384133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 759/1525] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:49 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:49.388032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1ebe1020-7258-472b-8b76-ce3ced8fd267 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:49.390182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1ebe1020-7258-472b-8b76-ce3ced8fd267 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:49.396470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe1020-7258-472b-8b76-ce3ced8fd267 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:49.396954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe1020-7258-472b-8b76-ce3ced8fd267 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:49.397385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe1020-7258-472b-8b76-ce3ced8fd267 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:49.398066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe1020-7258-472b-8b76-ce3ced8fd267 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:49.398511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe1020-7258-472b-8b76-ce3ced8fd267 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:49.398928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe1020-7258-472b-8b76-ce3ced8fd267 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:49.427321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1ebe1020-7258-472b-8b76-ce3ced8fd267 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043645 Aug 06 12:47:49.427868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 767/1526] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:47:50.395294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-12fd967d-7546-4d3a-b771-87299cd223f3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:50.397465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-12fd967d-7546-4d3a-b771-87299cd223f3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:50.404212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12fd967d-7546-4d3a-b771-87299cd223f3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:50.405022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12fd967d-7546-4d3a-b771-87299cd223f3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:50.405459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12fd967d-7546-4d3a-b771-87299cd223f3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:50.406150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12fd967d-7546-4d3a-b771-87299cd223f3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:50.406605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12fd967d-7546-4d3a-b771-87299cd223f3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:50.407354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12fd967d-7546-4d3a-b771-87299cd223f3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:50.431723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:47:50.437734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-12fd967d-7546-4d3a-b771-87299cd223f3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 Aug 06 12:47:50.438296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 760/1527] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:50 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:50.439174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-06cee4a4-df04-432a-8034-41cd5c9b560e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:50.441355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-06cee4a4-df04-432a-8034-41cd5c9b560e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:50.447526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06cee4a4-df04-432a-8034-41cd5c9b560e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:50.447995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06cee4a4-df04-432a-8034-41cd5c9b560e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:50.448453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06cee4a4-df04-432a-8034-41cd5c9b560e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:50.449131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06cee4a4-df04-432a-8034-41cd5c9b560e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:50.449572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06cee4a4-df04-432a-8034-41cd5c9b560e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:50.449986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06cee4a4-df04-432a-8034-41cd5c9b560e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:50.477896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-06cee4a4-df04-432a-8034-41cd5c9b560e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042647 Aug 06 12:47:50.478433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 768/1528] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:47:51.449894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9d3013c-ebdb-4eac-9de5-96873b5f0a67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:51.452014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9d3013c-ebdb-4eac-9de5-96873b5f0a67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:51.458268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9d3013c-ebdb-4eac-9de5-96873b5f0a67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:51.458747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9d3013c-ebdb-4eac-9de5-96873b5f0a67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:51.459193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9d3013c-ebdb-4eac-9de5-96873b5f0a67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:51.459889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9d3013c-ebdb-4eac-9de5-96873b5f0a67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:51.460364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9d3013c-ebdb-4eac-9de5-96873b5f0a67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:51.460792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9d3013c-ebdb-4eac-9de5-96873b5f0a67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:51.490165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9d3013c-ebdb-4eac-9de5-96873b5f0a67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044419 Aug 06 12:47:51.490845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 761/1529] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:51 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:51.490982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-84b0d7ed-8911-4199-9024-82af1e99cff6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:51.493090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-84b0d7ed-8911-4199-9024-82af1e99cff6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:51.500096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84b0d7ed-8911-4199-9024-82af1e99cff6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:51.500609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84b0d7ed-8911-4199-9024-82af1e99cff6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:51.501041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84b0d7ed-8911-4199-9024-82af1e99cff6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:51.501721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84b0d7ed-8911-4199-9024-82af1e99cff6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:51.502164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84b0d7ed-8911-4199-9024-82af1e99cff6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:51.502580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84b0d7ed-8911-4199-9024-82af1e99cff6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:51.530307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-84b0d7ed-8911-4199-9024-82af1e99cff6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Aug 06 12:47:51.530784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 769/1530] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:47:52.502512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d4e5a979-7693-4562-b8e7-1dd0c7146b2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:52.504698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d4e5a979-7693-4562-b8e7-1dd0c7146b2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:52.511589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4e5a979-7693-4562-b8e7-1dd0c7146b2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:52.512066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4e5a979-7693-4562-b8e7-1dd0c7146b2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:52.512537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4e5a979-7693-4562-b8e7-1dd0c7146b2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:52.513237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4e5a979-7693-4562-b8e7-1dd0c7146b2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:52.513687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4e5a979-7693-4562-b8e7-1dd0c7146b2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:52.514105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4e5a979-7693-4562-b8e7-1dd0c7146b2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:52.542276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f7096565-1e1e-4618-b2f1-67c77673600b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:52.543612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d4e5a979-7693-4562-b8e7-1dd0c7146b2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Aug 06 12:47:52.544406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 762/1531] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:52 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:52.544545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f7096565-1e1e-4618-b2f1-67c77673600b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:52.550653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7096565-1e1e-4618-b2f1-67c77673600b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:52.551125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7096565-1e1e-4618-b2f1-67c77673600b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:52.551550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7096565-1e1e-4618-b2f1-67c77673600b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:52.552228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7096565-1e1e-4618-b2f1-67c77673600b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:52.552705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7096565-1e1e-4618-b2f1-67c77673600b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:52.553120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7096565-1e1e-4618-b2f1-67c77673600b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:52.583875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f7096565-1e1e-4618-b2f1-67c77673600b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045469 Aug 06 12:47:52.584445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 770/1532] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:47:53.555636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-034cca5e-7e04-40c1-8717-6b9b7f896f13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:53.557846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-034cca5e-7e04-40c1-8717-6b9b7f896f13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:53.564204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-034cca5e-7e04-40c1-8717-6b9b7f896f13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:53.564723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-034cca5e-7e04-40c1-8717-6b9b7f896f13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:53.565153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-034cca5e-7e04-40c1-8717-6b9b7f896f13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:53.565837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-034cca5e-7e04-40c1-8717-6b9b7f896f13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:53.566280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-034cca5e-7e04-40c1-8717-6b9b7f896f13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:53.566699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-034cca5e-7e04-40c1-8717-6b9b7f896f13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:53.596187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-52f183f4-48c8-4753-becb-dd5e2ea139ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:53.598631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-52f183f4-48c8-4753-becb-dd5e2ea139ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:53.598983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-034cca5e-7e04-40c1-8717-6b9b7f896f13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047230 Aug 06 12:47:53.599720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 763/1533] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:53 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:53.606432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52f183f4-48c8-4753-becb-dd5e2ea139ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:53.606936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52f183f4-48c8-4753-becb-dd5e2ea139ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:53.607388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52f183f4-48c8-4753-becb-dd5e2ea139ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:53.608077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52f183f4-48c8-4753-becb-dd5e2ea139ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:53.608555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52f183f4-48c8-4753-becb-dd5e2ea139ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:53.608966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52f183f4-48c8-4753-becb-dd5e2ea139ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:53.637604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-52f183f4-48c8-4753-becb-dd5e2ea139ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 Aug 06 12:47:53.638154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 771/1534] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:47:54.611294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6cadff25-4ddb-4cfc-9f5f-39f22ddfe64e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:54.613470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6cadff25-4ddb-4cfc-9f5f-39f22ddfe64e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:54.620055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cadff25-4ddb-4cfc-9f5f-39f22ddfe64e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:54.621143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cadff25-4ddb-4cfc-9f5f-39f22ddfe64e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:54.621582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cadff25-4ddb-4cfc-9f5f-39f22ddfe64e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:54.622285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cadff25-4ddb-4cfc-9f5f-39f22ddfe64e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:54.622735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cadff25-4ddb-4cfc-9f5f-39f22ddfe64e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:54.623158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cadff25-4ddb-4cfc-9f5f-39f22ddfe64e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:54.648804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bcd181ff-b261-4229-9ea9-c7391eef24ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:54.651824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bcd181ff-b261-4229-9ea9-c7391eef24ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:54.653119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6cadff25-4ddb-4cfc-9f5f-39f22ddfe64e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045693 Aug 06 12:47:54.654395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 764/1535] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:54 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:54.658401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcd181ff-b261-4229-9ea9-c7391eef24ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:54.658882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcd181ff-b261-4229-9ea9-c7391eef24ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:54.659314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcd181ff-b261-4229-9ea9-c7391eef24ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:54.660038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcd181ff-b261-4229-9ea9-c7391eef24ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:54.660687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcd181ff-b261-4229-9ea9-c7391eef24ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:54.661111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcd181ff-b261-4229-9ea9-c7391eef24ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:54.689791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bcd181ff-b261-4229-9ea9-c7391eef24ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044862 Aug 06 12:47:54.690329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 772/1536] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:47:55.664961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-85972ca2-6b0f-4368-980b-3fb403726603 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:55.667113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-85972ca2-6b0f-4368-980b-3fb403726603 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:55.673606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85972ca2-6b0f-4368-980b-3fb403726603 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:55.674087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85972ca2-6b0f-4368-980b-3fb403726603 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:55.674527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85972ca2-6b0f-4368-980b-3fb403726603 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:55.675217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85972ca2-6b0f-4368-980b-3fb403726603 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:55.675664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85972ca2-6b0f-4368-980b-3fb403726603 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:55.676093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85972ca2-6b0f-4368-980b-3fb403726603 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:55.702536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4556899b-9567-42f9-b57f-253121f29654 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:55.705012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4556899b-9567-42f9-b57f-253121f29654 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:55.705786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-85972ca2-6b0f-4368-980b-3fb403726603 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Aug 06 12:47:55.706531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 765/1537] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:55 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:55.711422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4556899b-9567-42f9-b57f-253121f29654 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:55.711903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4556899b-9567-42f9-b57f-253121f29654 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:55.712349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4556899b-9567-42f9-b57f-253121f29654 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:55.713039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4556899b-9567-42f9-b57f-253121f29654 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:55.713481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4556899b-9567-42f9-b57f-253121f29654 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:55.714109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4556899b-9567-42f9-b57f-253121f29654 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:55.742366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4556899b-9567-42f9-b57f-253121f29654 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044427 Aug 06 12:47:55.742902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 773/1538] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:47:56.718786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f14ab138-11d1-4c70-806e-eb9e8264b48d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:56.721037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f14ab138-11d1-4c70-806e-eb9e8264b48d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:56.727568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f14ab138-11d1-4c70-806e-eb9e8264b48d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:56.728036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f14ab138-11d1-4c70-806e-eb9e8264b48d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:56.728509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f14ab138-11d1-4c70-806e-eb9e8264b48d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:56.729212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f14ab138-11d1-4c70-806e-eb9e8264b48d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:56.729671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f14ab138-11d1-4c70-806e-eb9e8264b48d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:56.730097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f14ab138-11d1-4c70-806e-eb9e8264b48d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:56.755801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a2c6f0b8-aeb3-4bac-9433-6226302788d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:56.758044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a2c6f0b8-aeb3-4bac-9433-6226302788d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:56.762650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f14ab138-11d1-4c70-806e-eb9e8264b48d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047790 Aug 06 12:47:56.763686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 766/1539] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:56 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:56.765718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2c6f0b8-aeb3-4bac-9433-6226302788d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:56.766262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2c6f0b8-aeb3-4bac-9433-6226302788d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:56.766688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2c6f0b8-aeb3-4bac-9433-6226302788d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:56.767376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2c6f0b8-aeb3-4bac-9433-6226302788d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:56.767822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2c6f0b8-aeb3-4bac-9433-6226302788d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:56.768234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2c6f0b8-aeb3-4bac-9433-6226302788d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:56.798815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a2c6f0b8-aeb3-4bac-9433-6226302788d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047217 Aug 06 12:47:56.799357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 774/1540] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:57.775492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-02967bc3-6f58-4513-a4ac-516365ee094f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:57.778123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-02967bc3-6f58-4513-a4ac-516365ee094f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:57.784403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02967bc3-6f58-4513-a4ac-516365ee094f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:57.784875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02967bc3-6f58-4513-a4ac-516365ee094f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:57.785305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02967bc3-6f58-4513-a4ac-516365ee094f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:57.785977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02967bc3-6f58-4513-a4ac-516365ee094f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:57.786422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02967bc3-6f58-4513-a4ac-516365ee094f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:57.786837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02967bc3-6f58-4513-a4ac-516365ee094f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:57.810676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1f676dbd-aad9-4661-bcfb-d2bf0b33c011 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:57.813412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f676dbd-aad9-4661-bcfb-d2bf0b33c011 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:57.818272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-02967bc3-6f58-4513-a4ac-516365ee094f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046674 Aug 06 12:47:57.819000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 767/1541] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:57 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:57.819736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f676dbd-aad9-4661-bcfb-d2bf0b33c011 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:57.820208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f676dbd-aad9-4661-bcfb-d2bf0b33c011 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:57.820659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f676dbd-aad9-4661-bcfb-d2bf0b33c011 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:57.821402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f676dbd-aad9-4661-bcfb-d2bf0b33c011 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:57.821852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f676dbd-aad9-4661-bcfb-d2bf0b33c011 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:57.822268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f676dbd-aad9-4661-bcfb-d2bf0b33c011 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:57.850889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1f676dbd-aad9-4661-bcfb-d2bf0b33c011 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Aug 06 12:47:57.851428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 775/1542] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:47:58.830500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d4745033-d673-4134-a994-14053ef0c801 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:58.832714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d4745033-d673-4134-a994-14053ef0c801 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:58.839619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4745033-d673-4134-a994-14053ef0c801 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:58.840092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4745033-d673-4134-a994-14053ef0c801 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:58.840556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4745033-d673-4134-a994-14053ef0c801 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:58.841235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4745033-d673-4134-a994-14053ef0c801 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:58.841682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4745033-d673-4134-a994-14053ef0c801 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:58.842096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4745033-d673-4134-a994-14053ef0c801 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:58.863554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fa840006-caa0-4490-8037-58ebce36047f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:58.866096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fa840006-caa0-4490-8037-58ebce36047f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:58.872540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa840006-caa0-4490-8037-58ebce36047f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:58.873023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa840006-caa0-4490-8037-58ebce36047f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:58.873359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d4745033-d673-4134-a994-14053ef0c801 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046769 Aug 06 12:47:58.873481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa840006-caa0-4490-8037-58ebce36047f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:58.874113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 768/1543] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:58 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:58.874243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa840006-caa0-4490-8037-58ebce36047f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:58.874576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa840006-caa0-4490-8037-58ebce36047f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:58.874996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa840006-caa0-4490-8037-58ebce36047f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:58.905438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fa840006-caa0-4490-8037-58ebce36047f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 Aug 06 12:47:58.906002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 776/1544] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:47:59.885951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ab7521eb-a0e7-4794-9ea5-5466f928693e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:59.888081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ab7521eb-a0e7-4794-9ea5-5466f928693e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:59.894486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab7521eb-a0e7-4794-9ea5-5466f928693e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:59.894966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab7521eb-a0e7-4794-9ea5-5466f928693e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:59.895402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab7521eb-a0e7-4794-9ea5-5466f928693e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:59.896097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab7521eb-a0e7-4794-9ea5-5466f928693e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:59.896577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab7521eb-a0e7-4794-9ea5-5466f928693e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:59.897000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab7521eb-a0e7-4794-9ea5-5466f928693e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:59.918591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dc492ad7-a66c-42f8-9fa5-11ffb677a4fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:47:59.920880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dc492ad7-a66c-42f8-9fa5-11ffb677a4fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:47:59.927207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc492ad7-a66c-42f8-9fa5-11ffb677a4fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:59.928240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ab7521eb-a0e7-4794-9ea5-5466f928693e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046352 Aug 06 12:47:59.929029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 769/1545] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:47:59.929238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc492ad7-a66c-42f8-9fa5-11ffb677a4fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:59.929683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc492ad7-a66c-42f8-9fa5-11ffb677a4fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:59.930391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc492ad7-a66c-42f8-9fa5-11ffb677a4fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:47:59.930850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc492ad7-a66c-42f8-9fa5-11ffb677a4fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:47:59.931273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc492ad7-a66c-42f8-9fa5-11ffb677a4fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:47:59.960426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dc492ad7-a66c-42f8-9fa5-11ffb677a4fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046711 Aug 06 12:47:59.960894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 777/1546] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:47:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:00.939658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e274c9f6-485f-4a4b-a9b2-0f6f2fb85c3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:00.941757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e274c9f6-485f-4a4b-a9b2-0f6f2fb85c3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:00.949011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e274c9f6-485f-4a4b-a9b2-0f6f2fb85c3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:00.949483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e274c9f6-485f-4a4b-a9b2-0f6f2fb85c3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:00.949912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e274c9f6-485f-4a4b-a9b2-0f6f2fb85c3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:00.950586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e274c9f6-485f-4a4b-a9b2-0f6f2fb85c3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:00.951028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e274c9f6-485f-4a4b-a9b2-0f6f2fb85c3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:00.951441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e274c9f6-485f-4a4b-a9b2-0f6f2fb85c3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:00.972907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3a03be5f-1565-48b8-921b-630629e27ba6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:00.975242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3a03be5f-1565-48b8-921b-630629e27ba6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:00.979724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e274c9f6-485f-4a4b-a9b2-0f6f2fb85c3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Aug 06 12:48:00.981662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a03be5f-1565-48b8-921b-630629e27ba6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:00.982228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a03be5f-1565-48b8-921b-630629e27ba6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:00.982583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a03be5f-1565-48b8-921b-630629e27ba6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:00.983286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a03be5f-1565-48b8-921b-630629e27ba6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:00.985262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a03be5f-1565-48b8-921b-630629e27ba6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:00.985428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 770/1547] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:00 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:00.985539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a03be5f-1565-48b8-921b-630629e27ba6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:01.015869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3a03be5f-1565-48b8-921b-630629e27ba6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046841 Aug 06 12:48:01.016454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 778/1548] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:01.991391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5b7302fa-2ffb-4c98-8199-f68ee4533c65 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:01.993484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5b7302fa-2ffb-4c98-8199-f68ee4533c65 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:02.000570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b7302fa-2ffb-4c98-8199-f68ee4533c65 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:02.001060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b7302fa-2ffb-4c98-8199-f68ee4533c65 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:02.001471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b7302fa-2ffb-4c98-8199-f68ee4533c65 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:02.002154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b7302fa-2ffb-4c98-8199-f68ee4533c65 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:02.002600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b7302fa-2ffb-4c98-8199-f68ee4533c65 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:02.003015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b7302fa-2ffb-4c98-8199-f68ee4533c65 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:02.027085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6e730ed5-728c-4bb9-8f7d-b6ca56d488c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:02.029249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6e730ed5-728c-4bb9-8f7d-b6ca56d488c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:02.031717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5b7302fa-2ffb-4c98-8199-f68ee4533c65 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044316 Aug 06 12:48:02.032276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 771/1549] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:01 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:02.035399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e730ed5-728c-4bb9-8f7d-b6ca56d488c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:02.035875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e730ed5-728c-4bb9-8f7d-b6ca56d488c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:02.036417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e730ed5-728c-4bb9-8f7d-b6ca56d488c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:02.037113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e730ed5-728c-4bb9-8f7d-b6ca56d488c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:02.037564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e730ed5-728c-4bb9-8f7d-b6ca56d488c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:02.038455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e730ed5-728c-4bb9-8f7d-b6ca56d488c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:02.068588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6e730ed5-728c-4bb9-8f7d-b6ca56d488c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045374 Aug 06 12:48:02.069152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 779/1550] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:03.043277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8d75b5b4-fac6-4887-861b-9d3a03a5b42b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:03.045457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8d75b5b4-fac6-4887-861b-9d3a03a5b42b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:03.051386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d75b5b4-fac6-4887-861b-9d3a03a5b42b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:03.051869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d75b5b4-fac6-4887-861b-9d3a03a5b42b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:03.052325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d75b5b4-fac6-4887-861b-9d3a03a5b42b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:03.053015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d75b5b4-fac6-4887-861b-9d3a03a5b42b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:03.053479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d75b5b4-fac6-4887-861b-9d3a03a5b42b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:03.053903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d75b5b4-fac6-4887-861b-9d3a03a5b42b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:03.080758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-84820d86-e3d4-48be-bcae-9b2623432236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:03.082929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-84820d86-e3d4-48be-bcae-9b2623432236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:03.083201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8d75b5b4-fac6-4887-861b-9d3a03a5b42b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Aug 06 12:48:03.083767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 772/1551] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:03 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:03.089370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84820d86-e3d4-48be-bcae-9b2623432236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:03.089849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84820d86-e3d4-48be-bcae-9b2623432236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:03.090282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84820d86-e3d4-48be-bcae-9b2623432236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:03.090972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84820d86-e3d4-48be-bcae-9b2623432236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:03.091418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84820d86-e3d4-48be-bcae-9b2623432236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:03.091839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84820d86-e3d4-48be-bcae-9b2623432236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:03.121120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-84820d86-e3d4-48be-bcae-9b2623432236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044224 Aug 06 12:48:03.121677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 780/1552] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:04.095909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fe26ddce-70e6-45a6-b137-bbe94284f64d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:04.098064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fe26ddce-70e6-45a6-b137-bbe94284f64d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:04.104445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe26ddce-70e6-45a6-b137-bbe94284f64d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:04.104921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe26ddce-70e6-45a6-b137-bbe94284f64d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:04.105350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe26ddce-70e6-45a6-b137-bbe94284f64d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:04.106026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe26ddce-70e6-45a6-b137-bbe94284f64d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:04.106474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe26ddce-70e6-45a6-b137-bbe94284f64d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:04.106891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe26ddce-70e6-45a6-b137-bbe94284f64d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:04.133354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-30138008-09b9-42e7-8908-d6314167304c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:04.135166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fe26ddce-70e6-45a6-b137-bbe94284f64d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043207 Aug 06 12:48:04.135926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-30138008-09b9-42e7-8908-d6314167304c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:04.136222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 773/1553] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:04 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:04.142183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30138008-09b9-42e7-8908-d6314167304c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:04.142658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30138008-09b9-42e7-8908-d6314167304c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:04.143085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30138008-09b9-42e7-8908-d6314167304c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:04.143762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30138008-09b9-42e7-8908-d6314167304c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:04.144204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30138008-09b9-42e7-8908-d6314167304c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:04.144641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30138008-09b9-42e7-8908-d6314167304c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:04.148119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:04.173816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-30138008-09b9-42e7-8908-d6314167304c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044341 Aug 06 12:48:04.174367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 781/1554] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:05.147127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-95d4f167-bc3b-43d1-a29d-a8d735f21869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:05.149274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-95d4f167-bc3b-43d1-a29d-a8d735f21869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:05.156334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95d4f167-bc3b-43d1-a29d-a8d735f21869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:05.156809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95d4f167-bc3b-43d1-a29d-a8d735f21869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:05.157243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95d4f167-bc3b-43d1-a29d-a8d735f21869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:05.157924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95d4f167-bc3b-43d1-a29d-a8d735f21869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:05.158375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95d4f167-bc3b-43d1-a29d-a8d735f21869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:05.158797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95d4f167-bc3b-43d1-a29d-a8d735f21869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:05.186219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a46ef03-6ae3-445b-b015-bfc8b80d496c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:05.187845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-95d4f167-bc3b-43d1-a29d-a8d735f21869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044680 Aug 06 12:48:05.188400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a46ef03-6ae3-445b-b015-bfc8b80d496c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:05.188521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 774/1555] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:05.194764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a46ef03-6ae3-445b-b015-bfc8b80d496c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:05.195242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a46ef03-6ae3-445b-b015-bfc8b80d496c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:05.195676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a46ef03-6ae3-445b-b015-bfc8b80d496c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:05.196449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a46ef03-6ae3-445b-b015-bfc8b80d496c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:05.196907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a46ef03-6ae3-445b-b015-bfc8b80d496c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:05.197327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a46ef03-6ae3-445b-b015-bfc8b80d496c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:05.226336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a46ef03-6ae3-445b-b015-bfc8b80d496c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Aug 06 12:48:05.226888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 782/1556] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:06.199934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-10a9cfa6-33de-4eef-9cf7-707179cc6c97 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:06.202129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-10a9cfa6-33de-4eef-9cf7-707179cc6c97 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:06.208422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10a9cfa6-33de-4eef-9cf7-707179cc6c97 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:06.208894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10a9cfa6-33de-4eef-9cf7-707179cc6c97 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:06.209322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10a9cfa6-33de-4eef-9cf7-707179cc6c97 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:06.209994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10a9cfa6-33de-4eef-9cf7-707179cc6c97 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:06.210439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10a9cfa6-33de-4eef-9cf7-707179cc6c97 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:06.210852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10a9cfa6-33de-4eef-9cf7-707179cc6c97 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:06.238673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bd70ee6f-21da-4fd1-a170-6a97ffd24af8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:06.240822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bd70ee6f-21da-4fd1-a170-6a97ffd24af8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:06.240984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-10a9cfa6-33de-4eef-9cf7-707179cc6c97 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044999 Aug 06 12:48:06.241541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 775/1557] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:06.247319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd70ee6f-21da-4fd1-a170-6a97ffd24af8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:06.247792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd70ee6f-21da-4fd1-a170-6a97ffd24af8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:06.248221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd70ee6f-21da-4fd1-a170-6a97ffd24af8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:06.248931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd70ee6f-21da-4fd1-a170-6a97ffd24af8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:06.249380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd70ee6f-21da-4fd1-a170-6a97ffd24af8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:06.249859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd70ee6f-21da-4fd1-a170-6a97ffd24af8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:06.278736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bd70ee6f-21da-4fd1-a170-6a97ffd24af8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Aug 06 12:48:06.279295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 783/1558] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:07.253077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-65d56b28-d9f8-43c0-9415-f2f9caec9fc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:07.255171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-65d56b28-d9f8-43c0-9415-f2f9caec9fc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:07.261917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65d56b28-d9f8-43c0-9415-f2f9caec9fc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:07.262402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65d56b28-d9f8-43c0-9415-f2f9caec9fc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:07.262841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65d56b28-d9f8-43c0-9415-f2f9caec9fc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:07.263543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65d56b28-d9f8-43c0-9415-f2f9caec9fc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:07.263998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65d56b28-d9f8-43c0-9415-f2f9caec9fc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:07.264459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65d56b28-d9f8-43c0-9415-f2f9caec9fc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:07.290874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-10f20959-970a-4380-af9f-236a9b5320aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:07.293296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-65d56b28-d9f8-43c0-9415-f2f9caec9fc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Aug 06 12:48:07.293518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-10f20959-970a-4380-af9f-236a9b5320aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:07.293858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 776/1559] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:07 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:07.299716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10f20959-970a-4380-af9f-236a9b5320aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:07.300190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10f20959-970a-4380-af9f-236a9b5320aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:07.300663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10f20959-970a-4380-af9f-236a9b5320aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:07.301348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10f20959-970a-4380-af9f-236a9b5320aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:07.301788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10f20959-970a-4380-af9f-236a9b5320aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:07.302202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10f20959-970a-4380-af9f-236a9b5320aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:07.331048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-10f20959-970a-4380-af9f-236a9b5320aa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 Aug 06 12:48:07.331605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 784/1560] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:08.305469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c2d3a5ce-7365-4ac0-97a2-83cf9cbd146c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:08.307628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c2d3a5ce-7365-4ac0-97a2-83cf9cbd146c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:08.313909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2d3a5ce-7365-4ac0-97a2-83cf9cbd146c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:08.314381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2d3a5ce-7365-4ac0-97a2-83cf9cbd146c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:08.314809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2d3a5ce-7365-4ac0-97a2-83cf9cbd146c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:08.315481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2d3a5ce-7365-4ac0-97a2-83cf9cbd146c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:08.315929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2d3a5ce-7365-4ac0-97a2-83cf9cbd146c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:08.316365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2d3a5ce-7365-4ac0-97a2-83cf9cbd146c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:08.332429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:08.343551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-06914e8d-3f55-4723-8e85-a7765a5aa80b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:08.345699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-06914e8d-3f55-4723-8e85-a7765a5aa80b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:08.345931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c2d3a5ce-7365-4ac0-97a2-83cf9cbd146c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044401 Aug 06 12:48:08.346498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 777/1561] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:08.351914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06914e8d-3f55-4723-8e85-a7765a5aa80b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:08.352420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06914e8d-3f55-4723-8e85-a7765a5aa80b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:08.352850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06914e8d-3f55-4723-8e85-a7765a5aa80b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:08.353532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06914e8d-3f55-4723-8e85-a7765a5aa80b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:08.354634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06914e8d-3f55-4723-8e85-a7765a5aa80b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:08.355060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06914e8d-3f55-4723-8e85-a7765a5aa80b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:08.383135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-06914e8d-3f55-4723-8e85-a7765a5aa80b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Aug 06 12:48:08.383684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 785/1562] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:08 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:09.358990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8bca46f2-dda2-47f4-aa4d-e51285a690c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:09.361391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8bca46f2-dda2-47f4-aa4d-e51285a690c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:09.367690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bca46f2-dda2-47f4-aa4d-e51285a690c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:09.368158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bca46f2-dda2-47f4-aa4d-e51285a690c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:09.368614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bca46f2-dda2-47f4-aa4d-e51285a690c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:09.369288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bca46f2-dda2-47f4-aa4d-e51285a690c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:09.370349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bca46f2-dda2-47f4-aa4d-e51285a690c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:09.370765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bca46f2-dda2-47f4-aa4d-e51285a690c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:09.395279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8647ec44-2de6-4d5c-a5c2-7c13783c971a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:09.397549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8647ec44-2de6-4d5c-a5c2-7c13783c971a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:09.398790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8bca46f2-dda2-47f4-aa4d-e51285a690c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Aug 06 12:48:09.399341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 778/1563] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:09.403936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8647ec44-2de6-4d5c-a5c2-7c13783c971a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:09.404434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8647ec44-2de6-4d5c-a5c2-7c13783c971a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:09.404872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8647ec44-2de6-4d5c-a5c2-7c13783c971a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:09.405568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8647ec44-2de6-4d5c-a5c2-7c13783c971a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:09.406022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8647ec44-2de6-4d5c-a5c2-7c13783c971a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:09.406448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8647ec44-2de6-4d5c-a5c2-7c13783c971a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:09.435491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8647ec44-2de6-4d5c-a5c2-7c13783c971a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Aug 06 12:48:09.436046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 786/1564] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:10.411065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3e585a8c-1d79-4659-a6ac-7002751cf8a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:10.413325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3e585a8c-1d79-4659-a6ac-7002751cf8a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:10.419719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e585a8c-1d79-4659-a6ac-7002751cf8a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:10.420195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e585a8c-1d79-4659-a6ac-7002751cf8a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:10.420661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e585a8c-1d79-4659-a6ac-7002751cf8a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:10.421351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e585a8c-1d79-4659-a6ac-7002751cf8a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:10.421806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e585a8c-1d79-4659-a6ac-7002751cf8a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:10.422228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e585a8c-1d79-4659-a6ac-7002751cf8a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:10.448897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5fb295a9-e283-4510-9be9-d8d6f7c96463 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:10.451088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5fb295a9-e283-4510-9be9-d8d6f7c96463 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:10.457545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3e585a8c-1d79-4659-a6ac-7002751cf8a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050449 Aug 06 12:48:10.458328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 779/1565] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:10.459376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fb295a9-e283-4510-9be9-d8d6f7c96463 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:10.460008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fb295a9-e283-4510-9be9-d8d6f7c96463 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:10.460701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fb295a9-e283-4510-9be9-d8d6f7c96463 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:10.461395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fb295a9-e283-4510-9be9-d8d6f7c96463 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:10.461879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fb295a9-e283-4510-9be9-d8d6f7c96463 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:10.462294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fb295a9-e283-4510-9be9-d8d6f7c96463 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:10.490816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5fb295a9-e283-4510-9be9-d8d6f7c96463 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047280 Aug 06 12:48:10.491647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 787/1566] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:11.470183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-52f3758d-1436-4914-8f55-bb8bb69b73aa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:11.472362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-52f3758d-1436-4914-8f55-bb8bb69b73aa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:11.478673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52f3758d-1436-4914-8f55-bb8bb69b73aa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:11.479719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52f3758d-1436-4914-8f55-bb8bb69b73aa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:11.480152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52f3758d-1436-4914-8f55-bb8bb69b73aa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:11.480873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52f3758d-1436-4914-8f55-bb8bb69b73aa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:11.481328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52f3758d-1436-4914-8f55-bb8bb69b73aa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:11.481755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52f3758d-1436-4914-8f55-bb8bb69b73aa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:11.503091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-05591040-f11f-4be4-80ac-de42f43b6e2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:11.505329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-05591040-f11f-4be4-80ac-de42f43b6e2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:11.510134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-52f3758d-1436-4914-8f55-bb8bb69b73aa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Aug 06 12:48:11.510692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 780/1567] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:11.511563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05591040-f11f-4be4-80ac-de42f43b6e2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:11.512040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05591040-f11f-4be4-80ac-de42f43b6e2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:11.512507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05591040-f11f-4be4-80ac-de42f43b6e2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:11.513244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05591040-f11f-4be4-80ac-de42f43b6e2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:11.513689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05591040-f11f-4be4-80ac-de42f43b6e2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:11.514108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05591040-f11f-4be4-80ac-de42f43b6e2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:11.543913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-05591040-f11f-4be4-80ac-de42f43b6e2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Aug 06 12:48:11.544691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 788/1568] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:12.522358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5876f59-8118-433d-a11b-88e1a17f3efc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:12.524501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5876f59-8118-433d-a11b-88e1a17f3efc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:12.530804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5876f59-8118-433d-a11b-88e1a17f3efc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:12.531276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5876f59-8118-433d-a11b-88e1a17f3efc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:12.531711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5876f59-8118-433d-a11b-88e1a17f3efc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:12.532416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5876f59-8118-433d-a11b-88e1a17f3efc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:12.532860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5876f59-8118-433d-a11b-88e1a17f3efc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:12.533277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5876f59-8118-433d-a11b-88e1a17f3efc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:12.556009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b09429dd-d42e-4e2a-83de-4dff7648921d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:12.558819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b09429dd-d42e-4e2a-83de-4dff7648921d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:12.562486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5876f59-8118-433d-a11b-88e1a17f3efc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Aug 06 12:48:12.563030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 781/1569] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:12.565221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b09429dd-d42e-4e2a-83de-4dff7648921d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:12.565701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b09429dd-d42e-4e2a-83de-4dff7648921d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:12.566130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b09429dd-d42e-4e2a-83de-4dff7648921d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:12.566818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b09429dd-d42e-4e2a-83de-4dff7648921d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:12.567267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b09429dd-d42e-4e2a-83de-4dff7648921d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:12.567687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b09429dd-d42e-4e2a-83de-4dff7648921d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:12.595520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b09429dd-d42e-4e2a-83de-4dff7648921d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043513 Aug 06 12:48:12.596064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 789/1570] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:13.574346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-733c21df-d3e8-4db4-b0f2-d0acd85b007b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:13.576488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-733c21df-d3e8-4db4-b0f2-d0acd85b007b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:13.583014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-733c21df-d3e8-4db4-b0f2-d0acd85b007b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:13.583493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-733c21df-d3e8-4db4-b0f2-d0acd85b007b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:13.583917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-733c21df-d3e8-4db4-b0f2-d0acd85b007b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:13.584618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-733c21df-d3e8-4db4-b0f2-d0acd85b007b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:13.585065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-733c21df-d3e8-4db4-b0f2-d0acd85b007b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:13.585479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-733c21df-d3e8-4db4-b0f2-d0acd85b007b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:13.609712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1ca215a3-6d2e-438d-8807-24c5f3ddf8e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:13.612096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1ca215a3-6d2e-438d-8807-24c5f3ddf8e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:13.615583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-733c21df-d3e8-4db4-b0f2-d0acd85b007b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Aug 06 12:48:13.616148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 782/1571] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:13 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:13.618397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ca215a3-6d2e-438d-8807-24c5f3ddf8e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:13.618871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ca215a3-6d2e-438d-8807-24c5f3ddf8e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:13.619301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ca215a3-6d2e-438d-8807-24c5f3ddf8e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:13.620036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ca215a3-6d2e-438d-8807-24c5f3ddf8e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:13.620504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ca215a3-6d2e-438d-8807-24c5f3ddf8e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:13.620923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ca215a3-6d2e-438d-8807-24c5f3ddf8e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:13.648697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1ca215a3-6d2e-438d-8807-24c5f3ddf8e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042939 Aug 06 12:48:13.649240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 790/1572] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:14.627717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f186d96b-1122-47a0-b87c-e64df4869584 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:14.629925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f186d96b-1122-47a0-b87c-e64df4869584 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:14.636279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f186d96b-1122-47a0-b87c-e64df4869584 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:14.636847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f186d96b-1122-47a0-b87c-e64df4869584 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:14.637274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f186d96b-1122-47a0-b87c-e64df4869584 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:14.637951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f186d96b-1122-47a0-b87c-e64df4869584 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:14.638394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f186d96b-1122-47a0-b87c-e64df4869584 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:14.638807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f186d96b-1122-47a0-b87c-e64df4869584 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:14.661309 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-25df65a2-d666-4e36-b783-b568eb4642a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:14.663571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-25df65a2-d666-4e36-b783-b568eb4642a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:14.667115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f186d96b-1122-47a0-b87c-e64df4869584 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042783 Aug 06 12:48:14.667672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 783/1573] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:14.670659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25df65a2-d666-4e36-b783-b568eb4642a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:14.671146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25df65a2-d666-4e36-b783-b568eb4642a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:14.671727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25df65a2-d666-4e36-b783-b568eb4642a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:14.672381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25df65a2-d666-4e36-b783-b568eb4642a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:14.672847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25df65a2-d666-4e36-b783-b568eb4642a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:14.673288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25df65a2-d666-4e36-b783-b568eb4642a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:14.702112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-25df65a2-d666-4e36-b783-b568eb4642a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Aug 06 12:48:14.702661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 791/1574] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:15.679091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-903e44a6-e026-40d3-8662-ee11b31107d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:15.681250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-903e44a6-e026-40d3-8662-ee11b31107d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:15.684185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=58 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:15.689391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-903e44a6-e026-40d3-8662-ee11b31107d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:15.689870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-903e44a6-e026-40d3-8662-ee11b31107d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:15.690304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-903e44a6-e026-40d3-8662-ee11b31107d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:15.690991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-903e44a6-e026-40d3-8662-ee11b31107d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:15.691443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-903e44a6-e026-40d3-8662-ee11b31107d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:15.691869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-903e44a6-e026-40d3-8662-ee11b31107d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:15.715310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2c804f1a-ce8d-47c7-848c-e219537d9813 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:15.717558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2c804f1a-ce8d-47c7-848c-e219537d9813 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:15.719729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=58 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:15.720649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-903e44a6-e026-40d3-8662-ee11b31107d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Aug 06 12:48:15.721209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 784/1575] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:15.725235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c804f1a-ce8d-47c7-848c-e219537d9813 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:15.725710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c804f1a-ce8d-47c7-848c-e219537d9813 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:15.726140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c804f1a-ce8d-47c7-848c-e219537d9813 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:15.726823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c804f1a-ce8d-47c7-848c-e219537d9813 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:15.727272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c804f1a-ce8d-47c7-848c-e219537d9813 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:15.727689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c804f1a-ce8d-47c7-848c-e219537d9813 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:15.756525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2c804f1a-ce8d-47c7-848c-e219537d9813 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Aug 06 12:48:15.757075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 792/1576] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:15 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:16.733491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e2d9a9a5-8f91-4f27-b9ba-67fa0ce6b561 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:16.735626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e2d9a9a5-8f91-4f27-b9ba-67fa0ce6b561 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:16.742266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2d9a9a5-8f91-4f27-b9ba-67fa0ce6b561 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:16.742752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2d9a9a5-8f91-4f27-b9ba-67fa0ce6b561 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:16.743194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2d9a9a5-8f91-4f27-b9ba-67fa0ce6b561 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:16.744855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2d9a9a5-8f91-4f27-b9ba-67fa0ce6b561 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:16.745334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2d9a9a5-8f91-4f27-b9ba-67fa0ce6b561 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:16.745836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2d9a9a5-8f91-4f27-b9ba-67fa0ce6b561 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:16.768624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5de42875-98c8-4fad-9ea5-f0b8a574d571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:16.770775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5de42875-98c8-4fad-9ea5-f0b8a574d571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:16.774015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e2d9a9a5-8f91-4f27-b9ba-67fa0ce6b561 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Aug 06 12:48:16.774574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 785/1577] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:16.777561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5de42875-98c8-4fad-9ea5-f0b8a574d571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:16.778158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5de42875-98c8-4fad-9ea5-f0b8a574d571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:16.778458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5de42875-98c8-4fad-9ea5-f0b8a574d571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:16.779140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5de42875-98c8-4fad-9ea5-f0b8a574d571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:16.779580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5de42875-98c8-4fad-9ea5-f0b8a574d571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:16.779994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5de42875-98c8-4fad-9ea5-f0b8a574d571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:16.808874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5de42875-98c8-4fad-9ea5-f0b8a574d571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Aug 06 12:48:16.809424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 793/1578] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:17.787418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-21067512-37b7-4b2c-9cab-fa6dccdd4532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:17.789627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-21067512-37b7-4b2c-9cab-fa6dccdd4532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:17.796524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21067512-37b7-4b2c-9cab-fa6dccdd4532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:17.797006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21067512-37b7-4b2c-9cab-fa6dccdd4532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:17.797447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21067512-37b7-4b2c-9cab-fa6dccdd4532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:17.798139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21067512-37b7-4b2c-9cab-fa6dccdd4532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:17.798595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21067512-37b7-4b2c-9cab-fa6dccdd4532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:17.799017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21067512-37b7-4b2c-9cab-fa6dccdd4532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:17.821056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-42b05001-f1f7-4ad5-879e-d109f2783af2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:17.823183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-42b05001-f1f7-4ad5-879e-d109f2783af2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:17.828170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-21067512-37b7-4b2c-9cab-fa6dccdd4532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Aug 06 12:48:17.828759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 786/1579] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:17.829584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42b05001-f1f7-4ad5-879e-d109f2783af2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:17.830064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42b05001-f1f7-4ad5-879e-d109f2783af2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:17.830495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42b05001-f1f7-4ad5-879e-d109f2783af2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:17.831183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42b05001-f1f7-4ad5-879e-d109f2783af2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:17.831631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42b05001-f1f7-4ad5-879e-d109f2783af2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:17.832050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42b05001-f1f7-4ad5-879e-d109f2783af2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:17.860583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-42b05001-f1f7-4ad5-879e-d109f2783af2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Aug 06 12:48:17.861392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 794/1580] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:18.839845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7b21298-01ec-4d1f-9cdd-ab75a6f5a890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:18.841996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7b21298-01ec-4d1f-9cdd-ab75a6f5a890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:18.848405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7b21298-01ec-4d1f-9cdd-ab75a6f5a890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:18.848889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7b21298-01ec-4d1f-9cdd-ab75a6f5a890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:18.849324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7b21298-01ec-4d1f-9cdd-ab75a6f5a890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:18.850010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7b21298-01ec-4d1f-9cdd-ab75a6f5a890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:18.850459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7b21298-01ec-4d1f-9cdd-ab75a6f5a890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:18.850881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7b21298-01ec-4d1f-9cdd-ab75a6f5a890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:18.873259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c475a02b-b577-4291-8806-3d2389f46a2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:18.875721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c475a02b-b577-4291-8806-3d2389f46a2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:18.880740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7b21298-01ec-4d1f-9cdd-ab75a6f5a890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 06 12:48:18.881308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 787/1581] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:18 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:18.881965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c475a02b-b577-4291-8806-3d2389f46a2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:18.882443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c475a02b-b577-4291-8806-3d2389f46a2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:18.882873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c475a02b-b577-4291-8806-3d2389f46a2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:18.883556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c475a02b-b577-4291-8806-3d2389f46a2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:18.884001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c475a02b-b577-4291-8806-3d2389f46a2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:18.884444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c475a02b-b577-4291-8806-3d2389f46a2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:18.913808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c475a02b-b577-4291-8806-3d2389f46a2c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044994 Aug 06 12:48:18.914352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 795/1582] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:18 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:19.892616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4158c870-3cbb-4eb9-a66d-3ebb157eaf07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:19.894733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4158c870-3cbb-4eb9-a66d-3ebb157eaf07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:19.901764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4158c870-3cbb-4eb9-a66d-3ebb157eaf07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:19.902231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4158c870-3cbb-4eb9-a66d-3ebb157eaf07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:19.902660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4158c870-3cbb-4eb9-a66d-3ebb157eaf07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:19.903333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4158c870-3cbb-4eb9-a66d-3ebb157eaf07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:19.903779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4158c870-3cbb-4eb9-a66d-3ebb157eaf07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:19.904194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4158c870-3cbb-4eb9-a66d-3ebb157eaf07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:19.925702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb516b69-fd68-4705-837b-7019aefdb0ba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:19.927825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb516b69-fd68-4705-837b-7019aefdb0ba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:19.932686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4158c870-3cbb-4eb9-a66d-3ebb157eaf07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Aug 06 12:48:19.933255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 788/1583] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:19.934122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb516b69-fd68-4705-837b-7019aefdb0ba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:19.934628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb516b69-fd68-4705-837b-7019aefdb0ba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:19.935059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb516b69-fd68-4705-837b-7019aefdb0ba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:19.935745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb516b69-fd68-4705-837b-7019aefdb0ba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:19.936188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb516b69-fd68-4705-837b-7019aefdb0ba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:19.936625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb516b69-fd68-4705-837b-7019aefdb0ba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:19.965581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb516b69-fd68-4705-837b-7019aefdb0ba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043716 Aug 06 12:48:19.966126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 796/1584] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:20.944536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-79825465-4d4d-4358-b974-c7a221e1d2ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:20.946734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-79825465-4d4d-4358-b974-c7a221e1d2ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:20.953065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79825465-4d4d-4358-b974-c7a221e1d2ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:20.953546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79825465-4d4d-4358-b974-c7a221e1d2ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:20.953978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79825465-4d4d-4358-b974-c7a221e1d2ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:20.954659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79825465-4d4d-4358-b974-c7a221e1d2ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:20.955109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79825465-4d4d-4358-b974-c7a221e1d2ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:20.955532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79825465-4d4d-4358-b974-c7a221e1d2ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:20.977572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-20c0fa64-35c3-4ce5-85ab-e3f05d8180ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:20.980395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-20c0fa64-35c3-4ce5-85ab-e3f05d8180ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:20.986206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-79825465-4d4d-4358-b974-c7a221e1d2ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Aug 06 12:48:20.986768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 789/1585] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:20.986918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20c0fa64-35c3-4ce5-85ab-e3f05d8180ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:20.987419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20c0fa64-35c3-4ce5-85ab-e3f05d8180ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:20.987910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20c0fa64-35c3-4ce5-85ab-e3f05d8180ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:20.988623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20c0fa64-35c3-4ce5-85ab-e3f05d8180ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:20.989072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20c0fa64-35c3-4ce5-85ab-e3f05d8180ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:20.989494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20c0fa64-35c3-4ce5-85ab-e3f05d8180ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:21.014426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:21.019452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-20c0fa64-35c3-4ce5-85ab-e3f05d8180ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Aug 06 12:48:21.020010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 797/1586] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:21.999017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-85065ad5-847f-4a81-b9e0-8562b7856b5f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:22.001260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-85065ad5-847f-4a81-b9e0-8562b7856b5f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:22.007844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85065ad5-847f-4a81-b9e0-8562b7856b5f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:22.008352 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85065ad5-847f-4a81-b9e0-8562b7856b5f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:22.008796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85065ad5-847f-4a81-b9e0-8562b7856b5f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:22.009487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85065ad5-847f-4a81-b9e0-8562b7856b5f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:22.010586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85065ad5-847f-4a81-b9e0-8562b7856b5f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:22.011010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85065ad5-847f-4a81-b9e0-8562b7856b5f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:22.031530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-61843da3-6263-4e60-9a81-28b708df0b30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:22.033830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-61843da3-6263-4e60-9a81-28b708df0b30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:22.043004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61843da3-6263-4e60-9a81-28b708df0b30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:22.043493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61843da3-6263-4e60-9a81-28b708df0b30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:22.043939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61843da3-6263-4e60-9a81-28b708df0b30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:22.044665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61843da3-6263-4e60-9a81-28b708df0b30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:22.045020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-85065ad5-847f-4a81-b9e0-8562b7856b5f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050472 Aug 06 12:48:22.045184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61843da3-6263-4e60-9a81-28b708df0b30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:22.045517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61843da3-6263-4e60-9a81-28b708df0b30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:22.045621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 790/1587] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:21 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:22.077018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-61843da3-6263-4e60-9a81-28b708df0b30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049718 Aug 06 12:48:22.077562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 798/1588] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:23.057524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6c36a6b9-e694-4d23-9d70-bf8ceeb12a83 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:23.059793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6c36a6b9-e694-4d23-9d70-bf8ceeb12a83 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:23.066226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36a6b9-e694-4d23-9d70-bf8ceeb12a83 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:23.066708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36a6b9-e694-4d23-9d70-bf8ceeb12a83 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:23.067148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36a6b9-e694-4d23-9d70-bf8ceeb12a83 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:23.067839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36a6b9-e694-4d23-9d70-bf8ceeb12a83 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:23.068310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36a6b9-e694-4d23-9d70-bf8ceeb12a83 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:23.068744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c36a6b9-e694-4d23-9d70-bf8ceeb12a83 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:23.089047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-faf12133-7c62-460e-b1cd-ec7952d99603 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:23.091783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-faf12133-7c62-460e-b1cd-ec7952d99603 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:23.097954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faf12133-7c62-460e-b1cd-ec7952d99603 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:23.098111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6c36a6b9-e694-4d23-9d70-bf8ceeb12a83 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Aug 06 12:48:23.098426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faf12133-7c62-460e-b1cd-ec7952d99603 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:23.098665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 791/1589] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:23 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:23.098855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faf12133-7c62-460e-b1cd-ec7952d99603 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:23.099535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faf12133-7c62-460e-b1cd-ec7952d99603 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:23.099983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faf12133-7c62-460e-b1cd-ec7952d99603 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:23.100432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faf12133-7c62-460e-b1cd-ec7952d99603 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:23.129184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-faf12133-7c62-460e-b1cd-ec7952d99603 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Aug 06 12:48:23.129724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 799/1590] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:24.110755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2f5f9158-4e1d-4c45-bea7-5a77352dcc67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:24.113193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2f5f9158-4e1d-4c45-bea7-5a77352dcc67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:24.119547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f5f9158-4e1d-4c45-bea7-5a77352dcc67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:24.120369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f5f9158-4e1d-4c45-bea7-5a77352dcc67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:24.120801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f5f9158-4e1d-4c45-bea7-5a77352dcc67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:24.121473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f5f9158-4e1d-4c45-bea7-5a77352dcc67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:24.121917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f5f9158-4e1d-4c45-bea7-5a77352dcc67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:24.122337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f5f9158-4e1d-4c45-bea7-5a77352dcc67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:24.140569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3bd60a34-b7e4-42e7-b9e4-1fce0ee9e13c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:24.142767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3bd60a34-b7e4-42e7-b9e4-1fce0ee9e13c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:24.149037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bd60a34-b7e4-42e7-b9e4-1fce0ee9e13c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:24.149516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bd60a34-b7e4-42e7-b9e4-1fce0ee9e13c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:24.149945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bd60a34-b7e4-42e7-b9e4-1fce0ee9e13c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:24.150655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bd60a34-b7e4-42e7-b9e4-1fce0ee9e13c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:24.150752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2f5f9158-4e1d-4c45-bea7-5a77352dcc67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Aug 06 12:48:24.151104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bd60a34-b7e4-42e7-b9e4-1fce0ee9e13c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:24.151223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 792/1591] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:24 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:24.151601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bd60a34-b7e4-42e7-b9e4-1fce0ee9e13c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:24.181277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3bd60a34-b7e4-42e7-b9e4-1fce0ee9e13c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044597 Aug 06 12:48:24.181826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 800/1592] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:25.163167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e66df8b2-4d11-470f-b5b5-52c9bd1b3308 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:25.165331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e66df8b2-4d11-470f-b5b5-52c9bd1b3308 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:25.172130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e66df8b2-4d11-470f-b5b5-52c9bd1b3308 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:25.172637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e66df8b2-4d11-470f-b5b5-52c9bd1b3308 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:25.173070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e66df8b2-4d11-470f-b5b5-52c9bd1b3308 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:25.173743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e66df8b2-4d11-470f-b5b5-52c9bd1b3308 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:25.174186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e66df8b2-4d11-470f-b5b5-52c9bd1b3308 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:25.174602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e66df8b2-4d11-470f-b5b5-52c9bd1b3308 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:25.193354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2d724d74-0582-4bc3-84cd-4c75cc4988ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:25.195522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2d724d74-0582-4bc3-84cd-4c75cc4988ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:25.201753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d724d74-0582-4bc3-84cd-4c75cc4988ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:25.202232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d724d74-0582-4bc3-84cd-4c75cc4988ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:25.202666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d724d74-0582-4bc3-84cd-4c75cc4988ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:25.203353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d724d74-0582-4bc3-84cd-4c75cc4988ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:25.203693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e66df8b2-4d11-470f-b5b5-52c9bd1b3308 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Aug 06 12:48:25.203810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d724d74-0582-4bc3-84cd-4c75cc4988ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:25.204238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d724d74-0582-4bc3-84cd-4c75cc4988ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:25.204392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 793/1593] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:25 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:25.233105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2d724d74-0582-4bc3-84cd-4c75cc4988ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043615 Aug 06 12:48:25.233661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 801/1594] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:26.216667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-390862bd-b6d5-4b80-8954-51c45fab8e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:26.218793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-390862bd-b6d5-4b80-8954-51c45fab8e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:26.225229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390862bd-b6d5-4b80-8954-51c45fab8e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:26.225702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390862bd-b6d5-4b80-8954-51c45fab8e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:26.226131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390862bd-b6d5-4b80-8954-51c45fab8e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:26.226814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390862bd-b6d5-4b80-8954-51c45fab8e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:26.227255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390862bd-b6d5-4b80-8954-51c45fab8e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:26.227671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390862bd-b6d5-4b80-8954-51c45fab8e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:26.231820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:26.244625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cfe044de-3a2a-4fa4-a16f-f71f4aa264ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:26.246879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cfe044de-3a2a-4fa4-a16f-f71f4aa264ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:26.253537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfe044de-3a2a-4fa4-a16f-f71f4aa264ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:26.253694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfe044de-3a2a-4fa4-a16f-f71f4aa264ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:26.254071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfe044de-3a2a-4fa4-a16f-f71f4aa264ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:26.254749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfe044de-3a2a-4fa4-a16f-f71f4aa264ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:26.255199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfe044de-3a2a-4fa4-a16f-f71f4aa264ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:26.255615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfe044de-3a2a-4fa4-a16f-f71f4aa264ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:26.257599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-390862bd-b6d5-4b80-8954-51c45fab8e36 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Aug 06 12:48:26.258159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 794/1595] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:26 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:26.283954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cfe044de-3a2a-4fa4-a16f-f71f4aa264ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043241 Aug 06 12:48:26.284539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 802/1596] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:27.269920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-230e9a43-3dfa-44e5-876b-89f15b74e049 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:27.271974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-230e9a43-3dfa-44e5-876b-89f15b74e049 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:27.278515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-230e9a43-3dfa-44e5-876b-89f15b74e049 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:27.279005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-230e9a43-3dfa-44e5-876b-89f15b74e049 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:27.279439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-230e9a43-3dfa-44e5-876b-89f15b74e049 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:27.280125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-230e9a43-3dfa-44e5-876b-89f15b74e049 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:27.280600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-230e9a43-3dfa-44e5-876b-89f15b74e049 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:27.281021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-230e9a43-3dfa-44e5-876b-89f15b74e049 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:27.295981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-00ccc6a8-7cce-4267-879e-20fbe6035172 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:27.298321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-00ccc6a8-7cce-4267-879e-20fbe6035172 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:27.304741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00ccc6a8-7cce-4267-879e-20fbe6035172 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:27.305215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00ccc6a8-7cce-4267-879e-20fbe6035172 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:27.305640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00ccc6a8-7cce-4267-879e-20fbe6035172 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:27.306314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00ccc6a8-7cce-4267-879e-20fbe6035172 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:27.306758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00ccc6a8-7cce-4267-879e-20fbe6035172 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:27.307175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00ccc6a8-7cce-4267-879e-20fbe6035172 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:27.310932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-230e9a43-3dfa-44e5-876b-89f15b74e049 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Aug 06 12:48:27.311501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 795/1597] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:27 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:27.336333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-00ccc6a8-7cce-4267-879e-20fbe6035172 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Aug 06 12:48:27.336872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 803/1598] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:28.324844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-685370c6-9353-416a-b0b4-76d6aa6bb6af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:28.327048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-685370c6-9353-416a-b0b4-76d6aa6bb6af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:28.334771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-685370c6-9353-416a-b0b4-76d6aa6bb6af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:28.335560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-685370c6-9353-416a-b0b4-76d6aa6bb6af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:28.336054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-685370c6-9353-416a-b0b4-76d6aa6bb6af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:28.336838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-685370c6-9353-416a-b0b4-76d6aa6bb6af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:28.337314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-685370c6-9353-416a-b0b4-76d6aa6bb6af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:28.337851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-685370c6-9353-416a-b0b4-76d6aa6bb6af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:28.349386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-64c12b8a-f615-496e-b86f-3f6a34f4d61f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:28.351528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-64c12b8a-f615-496e-b86f-3f6a34f4d61f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:28.357791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64c12b8a-f615-496e-b86f-3f6a34f4d61f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:28.358263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64c12b8a-f615-496e-b86f-3f6a34f4d61f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:28.358696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64c12b8a-f615-496e-b86f-3f6a34f4d61f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:28.359379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64c12b8a-f615-496e-b86f-3f6a34f4d61f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:28.359822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64c12b8a-f615-496e-b86f-3f6a34f4d61f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:28.360234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-64c12b8a-f615-496e-b86f-3f6a34f4d61f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:28.369040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-685370c6-9353-416a-b0b4-76d6aa6bb6af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049764 Aug 06 12:48:28.369602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 796/1599] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:28 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:28.390049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-64c12b8a-f615-496e-b86f-3f6a34f4d61f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Aug 06 12:48:28.390631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 804/1600] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:28 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:29.382469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-17cc0067-c1c6-4115-bf48-94ec605e1f03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:29.384662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-17cc0067-c1c6-4115-bf48-94ec605e1f03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:29.391613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc0067-c1c6-4115-bf48-94ec605e1f03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:29.392088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc0067-c1c6-4115-bf48-94ec605e1f03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:29.392554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc0067-c1c6-4115-bf48-94ec605e1f03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:29.394105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc0067-c1c6-4115-bf48-94ec605e1f03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:29.394604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc0067-c1c6-4115-bf48-94ec605e1f03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:29.395059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc0067-c1c6-4115-bf48-94ec605e1f03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:29.403437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f306429c-a30a-4177-828d-0dbeec8d7075 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:29.405674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f306429c-a30a-4177-828d-0dbeec8d7075 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:29.412058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f306429c-a30a-4177-828d-0dbeec8d7075 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:29.412592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f306429c-a30a-4177-828d-0dbeec8d7075 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:29.413029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f306429c-a30a-4177-828d-0dbeec8d7075 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:29.413720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f306429c-a30a-4177-828d-0dbeec8d7075 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:29.414167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f306429c-a30a-4177-828d-0dbeec8d7075 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:29.414594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f306429c-a30a-4177-828d-0dbeec8d7075 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:29.428255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-17cc0067-c1c6-4115-bf48-94ec605e1f03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049712 Aug 06 12:48:29.428862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 797/1601] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:29 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:29.443760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f306429c-a30a-4177-828d-0dbeec8d7075 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Aug 06 12:48:29.444321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 805/1602] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:30.440085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7d32e79a-a1c6-463e-9017-93098deb6f80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:30.442412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7d32e79a-a1c6-463e-9017-93098deb6f80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:30.448777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d32e79a-a1c6-463e-9017-93098deb6f80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:30.449256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d32e79a-a1c6-463e-9017-93098deb6f80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:30.449721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d32e79a-a1c6-463e-9017-93098deb6f80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:30.450402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d32e79a-a1c6-463e-9017-93098deb6f80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:30.450971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d32e79a-a1c6-463e-9017-93098deb6f80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:30.451401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d32e79a-a1c6-463e-9017-93098deb6f80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:30.456147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-741f3314-98c7-4023-8813-707a9e8f2269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:30.458286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-741f3314-98c7-4023-8813-707a9e8f2269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:30.464484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-741f3314-98c7-4023-8813-707a9e8f2269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:30.464957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-741f3314-98c7-4023-8813-707a9e8f2269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:30.465382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-741f3314-98c7-4023-8813-707a9e8f2269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:30.466058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-741f3314-98c7-4023-8813-707a9e8f2269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:30.466500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-741f3314-98c7-4023-8813-707a9e8f2269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:30.466912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-741f3314-98c7-4023-8813-707a9e8f2269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:30.479579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7d32e79a-a1c6-463e-9017-93098deb6f80 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043435 Aug 06 12:48:30.480666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 798/1603] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:30 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:30.496632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-741f3314-98c7-4023-8813-707a9e8f2269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Aug 06 12:48:30.497171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 806/1604] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:31.492674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-900b564b-e5ad-4a74-8249-fbf3594aae14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:31.494833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-900b564b-e5ad-4a74-8249-fbf3594aae14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:31.501689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-900b564b-e5ad-4a74-8249-fbf3594aae14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:31.502171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-900b564b-e5ad-4a74-8249-fbf3594aae14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:31.502598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-900b564b-e5ad-4a74-8249-fbf3594aae14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:31.503286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-900b564b-e5ad-4a74-8249-fbf3594aae14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:31.503753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-900b564b-e5ad-4a74-8249-fbf3594aae14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:31.504186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-900b564b-e5ad-4a74-8249-fbf3594aae14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:31.507870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ddb432be-88d7-4dfd-8a41-a456f55b55e6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:31.510006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ddb432be-88d7-4dfd-8a41-a456f55b55e6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:31.517059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddb432be-88d7-4dfd-8a41-a456f55b55e6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:31.517537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddb432be-88d7-4dfd-8a41-a456f55b55e6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:31.517969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddb432be-88d7-4dfd-8a41-a456f55b55e6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:31.518653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddb432be-88d7-4dfd-8a41-a456f55b55e6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:31.519104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddb432be-88d7-4dfd-8a41-a456f55b55e6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:31.519524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddb432be-88d7-4dfd-8a41-a456f55b55e6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:31.534408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-900b564b-e5ad-4a74-8249-fbf3594aae14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Aug 06 12:48:31.535001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 799/1605] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:31 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:31.547736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ddb432be-88d7-4dfd-8a41-a456f55b55e6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043710 Aug 06 12:48:31.548283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 807/1606] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:32.546639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-740bd725-1c11-4284-9304-00792c2d68c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:32.548790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-740bd725-1c11-4284-9304-00792c2d68c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:32.555204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-740bd725-1c11-4284-9304-00792c2d68c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:32.555675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-740bd725-1c11-4284-9304-00792c2d68c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:32.556107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-740bd725-1c11-4284-9304-00792c2d68c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:32.556819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-740bd725-1c11-4284-9304-00792c2d68c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:32.557266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-740bd725-1c11-4284-9304-00792c2d68c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:32.557704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-740bd725-1c11-4284-9304-00792c2d68c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:32.558829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e344cb73-8599-4036-8a52-7978b3d558db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:32.560987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e344cb73-8599-4036-8a52-7978b3d558db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:32.567161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e344cb73-8599-4036-8a52-7978b3d558db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:32.567631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e344cb73-8599-4036-8a52-7978b3d558db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:32.568059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e344cb73-8599-4036-8a52-7978b3d558db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:32.568764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e344cb73-8599-4036-8a52-7978b3d558db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:32.569215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e344cb73-8599-4036-8a52-7978b3d558db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:32.569632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e344cb73-8599-4036-8a52-7978b3d558db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:32.587276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-740bd725-1c11-4284-9304-00792c2d68c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Aug 06 12:48:32.587841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 800/1607] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:32 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:32.599013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e344cb73-8599-4036-8a52-7978b3d558db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Aug 06 12:48:32.599564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 808/1608] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:33.600232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16e8e1fc-80d1-44f5-a2b4-ae4b02962b70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:33.602477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16e8e1fc-80d1-44f5-a2b4-ae4b02962b70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:33.609232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16e8e1fc-80d1-44f5-a2b4-ae4b02962b70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:33.609720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16e8e1fc-80d1-44f5-a2b4-ae4b02962b70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:33.610208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16e8e1fc-80d1-44f5-a2b4-ae4b02962b70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:33.611169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16e8e1fc-80d1-44f5-a2b4-ae4b02962b70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:33.611620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16e8e1fc-80d1-44f5-a2b4-ae4b02962b70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:33.611722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f7572c59-afd3-4c83-a975-601ac739912e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:33.612116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16e8e1fc-80d1-44f5-a2b4-ae4b02962b70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:33.613822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f7572c59-afd3-4c83-a975-601ac739912e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:33.621082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7572c59-afd3-4c83-a975-601ac739912e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:33.621562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7572c59-afd3-4c83-a975-601ac739912e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:33.621994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7572c59-afd3-4c83-a975-601ac739912e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:33.622690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7572c59-afd3-4c83-a975-601ac739912e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:33.623139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7572c59-afd3-4c83-a975-601ac739912e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:33.623559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7572c59-afd3-4c83-a975-601ac739912e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:33.641648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16e8e1fc-80d1-44f5-a2b4-ae4b02962b70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045389 Aug 06 12:48:33.642215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 801/1609] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:33 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:33.652765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f7572c59-afd3-4c83-a975-601ac739912e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Aug 06 12:48:33.653309 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 809/1610] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:34.653865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-050b2d5b-a5c9-40d9-8cb3-9ba7ac0a9e07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:34.655968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-050b2d5b-a5c9-40d9-8cb3-9ba7ac0a9e07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:34.662421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-050b2d5b-a5c9-40d9-8cb3-9ba7ac0a9e07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:34.662896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-050b2d5b-a5c9-40d9-8cb3-9ba7ac0a9e07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:34.663322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-050b2d5b-a5c9-40d9-8cb3-9ba7ac0a9e07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:34.664006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-050b2d5b-a5c9-40d9-8cb3-9ba7ac0a9e07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:34.664486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-050b2d5b-a5c9-40d9-8cb3-9ba7ac0a9e07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:34.664641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-100dec8c-b360-4c60-a4f2-77d7c7ec77a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:34.665071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-050b2d5b-a5c9-40d9-8cb3-9ba7ac0a9e07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:34.666762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-100dec8c-b360-4c60-a4f2-77d7c7ec77a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:34.673337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-100dec8c-b360-4c60-a4f2-77d7c7ec77a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:34.673817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-100dec8c-b360-4c60-a4f2-77d7c7ec77a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:34.674248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-100dec8c-b360-4c60-a4f2-77d7c7ec77a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:34.674935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-100dec8c-b360-4c60-a4f2-77d7c7ec77a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:34.675383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-100dec8c-b360-4c60-a4f2-77d7c7ec77a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:34.675807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-100dec8c-b360-4c60-a4f2-77d7c7ec77a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:34.694358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-050b2d5b-a5c9-40d9-8cb3-9ba7ac0a9e07 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Aug 06 12:48:34.694913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 802/1611] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:34 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:34.705458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-100dec8c-b360-4c60-a4f2-77d7c7ec77a1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Aug 06 12:48:34.706002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 810/1612] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:35.707290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c132e9a3-2deb-44c6-91b1-633bccec0598 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:35.709408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c132e9a3-2deb-44c6-91b1-633bccec0598 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:35.716349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c132e9a3-2deb-44c6-91b1-633bccec0598 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:35.716832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c132e9a3-2deb-44c6-91b1-633bccec0598 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:35.717265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c132e9a3-2deb-44c6-91b1-633bccec0598 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:35.717949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c132e9a3-2deb-44c6-91b1-633bccec0598 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:35.718050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-89151106-e76e-4e28-8c7d-6281678786fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:35.718431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c132e9a3-2deb-44c6-91b1-633bccec0598 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:35.718804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c132e9a3-2deb-44c6-91b1-633bccec0598 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:35.720151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-89151106-e76e-4e28-8c7d-6281678786fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:35.726628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89151106-e76e-4e28-8c7d-6281678786fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:35.727118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89151106-e76e-4e28-8c7d-6281678786fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:35.727579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89151106-e76e-4e28-8c7d-6281678786fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:35.728277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89151106-e76e-4e28-8c7d-6281678786fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:35.728754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89151106-e76e-4e28-8c7d-6281678786fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:35.729206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89151106-e76e-4e28-8c7d-6281678786fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:35.747682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c132e9a3-2deb-44c6-91b1-633bccec0598 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044390 Aug 06 12:48:35.748236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 803/1613] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:35 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:35.758069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-89151106-e76e-4e28-8c7d-6281678786fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Aug 06 12:48:35.758616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 811/1614] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:35 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:36.745009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:48:36.745650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:48:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:48:36.758934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-05dbf9d0-1d2d-4f9d-9d3c-53eeb9ca613d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:36.761107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-05dbf9d0-1d2d-4f9d-9d3c-53eeb9ca613d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:36.767592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05dbf9d0-1d2d-4f9d-9d3c-53eeb9ca613d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:36.768079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05dbf9d0-1d2d-4f9d-9d3c-53eeb9ca613d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:36.768550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05dbf9d0-1d2d-4f9d-9d3c-53eeb9ca613d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:36.769248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05dbf9d0-1d2d-4f9d-9d3c-53eeb9ca613d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:36.769703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05dbf9d0-1d2d-4f9d-9d3c-53eeb9ca613d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:36.770134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05dbf9d0-1d2d-4f9d-9d3c-53eeb9ca613d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:36.770739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5854be18-311d-4c07-85da-ec6dc86a0edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:36.772879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5854be18-311d-4c07-85da-ec6dc86a0edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:36.779538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5854be18-311d-4c07-85da-ec6dc86a0edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:36.780005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5854be18-311d-4c07-85da-ec6dc86a0edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:36.780544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5854be18-311d-4c07-85da-ec6dc86a0edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:36.781482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5854be18-311d-4c07-85da-ec6dc86a0edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:36.781931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5854be18-311d-4c07-85da-ec6dc86a0edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:36.782348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5854be18-311d-4c07-85da-ec6dc86a0edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:36.799950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-05dbf9d0-1d2d-4f9d-9d3c-53eeb9ca613d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Aug 06 12:48:36.800537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 804/1615] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:36 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:36.812480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5854be18-311d-4c07-85da-ec6dc86a0edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046063 Aug 06 12:48:36.813027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 812/1616] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:37.704967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:48:37.705179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:48:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:48:37.812975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cfb3136e-9b6a-4488-a45d-5bbd1b12ab56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:37.815135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cfb3136e-9b6a-4488-a45d-5bbd1b12ab56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:37.821589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfb3136e-9b6a-4488-a45d-5bbd1b12ab56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:37.822067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfb3136e-9b6a-4488-a45d-5bbd1b12ab56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:37.822505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfb3136e-9b6a-4488-a45d-5bbd1b12ab56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:37.823197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfb3136e-9b6a-4488-a45d-5bbd1b12ab56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:37.823668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfb3136e-9b6a-4488-a45d-5bbd1b12ab56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:37.824073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfb3136e-9b6a-4488-a45d-5bbd1b12ab56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:37.824334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e35b4016-62c4-4d77-9779-492029e71482 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:37.826507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e35b4016-62c4-4d77-9779-492029e71482 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:37.832768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e35b4016-62c4-4d77-9779-492029e71482 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:37.833235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e35b4016-62c4-4d77-9779-492029e71482 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:37.833660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e35b4016-62c4-4d77-9779-492029e71482 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:37.834334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e35b4016-62c4-4d77-9779-492029e71482 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:37.834776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e35b4016-62c4-4d77-9779-492029e71482 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:37.835194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e35b4016-62c4-4d77-9779-492029e71482 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:37.853074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cfb3136e-9b6a-4488-a45d-5bbd1b12ab56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Aug 06 12:48:37.853646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 805/1617] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:37 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:37.864376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e35b4016-62c4-4d77-9779-492029e71482 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Aug 06 12:48:37.864921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 813/1618] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:37 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:38.866171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e12a7522-7a5c-4f95-9ad7-1bfb66ac9f4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:38.868324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e12a7522-7a5c-4f95-9ad7-1bfb66ac9f4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:38.875436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e12a7522-7a5c-4f95-9ad7-1bfb66ac9f4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:38.875917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e12a7522-7a5c-4f95-9ad7-1bfb66ac9f4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:38.876569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e12a7522-7a5c-4f95-9ad7-1bfb66ac9f4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:38.877217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3e70b900-73c8-42be-b384-80f98ead5370 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:38.877661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e12a7522-7a5c-4f95-9ad7-1bfb66ac9f4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:38.877750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e12a7522-7a5c-4f95-9ad7-1bfb66ac9f4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:38.878109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e12a7522-7a5c-4f95-9ad7-1bfb66ac9f4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:38.879457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e70b900-73c8-42be-b384-80f98ead5370 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:38.886043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e70b900-73c8-42be-b384-80f98ead5370 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:38.886524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e70b900-73c8-42be-b384-80f98ead5370 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:38.886955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e70b900-73c8-42be-b384-80f98ead5370 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:38.887648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e70b900-73c8-42be-b384-80f98ead5370 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:38.888092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e70b900-73c8-42be-b384-80f98ead5370 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:38.888539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e70b900-73c8-42be-b384-80f98ead5370 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:38.908160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:38.908694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e12a7522-7a5c-4f95-9ad7-1bfb66ac9f4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046506 Aug 06 12:48:38.913224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 806/1619] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:38 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:38.922621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3e70b900-73c8-42be-b384-80f98ead5370 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049537 Aug 06 12:48:38.923178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 814/1620] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:39.921299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f91448d3-49c6-42a2-a49b-64656fb318c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:39.923411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f91448d3-49c6-42a2-a49b-64656fb318c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:39.930103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f91448d3-49c6-42a2-a49b-64656fb318c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:39.930577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f91448d3-49c6-42a2-a49b-64656fb318c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:39.931057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f91448d3-49c6-42a2-a49b-64656fb318c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:39.931744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f91448d3-49c6-42a2-a49b-64656fb318c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:39.932187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f91448d3-49c6-42a2-a49b-64656fb318c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:39.933137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f91448d3-49c6-42a2-a49b-64656fb318c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:39.934999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7e844a85-bbbf-4593-a632-88a1e727da04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:39.937162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7e844a85-bbbf-4593-a632-88a1e727da04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:39.943321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e844a85-bbbf-4593-a632-88a1e727da04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:39.943795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e844a85-bbbf-4593-a632-88a1e727da04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:39.944237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e844a85-bbbf-4593-a632-88a1e727da04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:39.944965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e844a85-bbbf-4593-a632-88a1e727da04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:39.945393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e844a85-bbbf-4593-a632-88a1e727da04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:39.945807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e844a85-bbbf-4593-a632-88a1e727da04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:39.962376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f91448d3-49c6-42a2-a49b-64656fb318c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045314 Aug 06 12:48:39.962933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 807/1621] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:39 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:39.974379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7e844a85-bbbf-4593-a632-88a1e727da04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043739 Aug 06 12:48:39.974923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 815/1622] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:40.974542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-125610de-cc74-4193-aa00-d3c001708a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:40.976711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-125610de-cc74-4193-aa00-d3c001708a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:40.983016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-125610de-cc74-4193-aa00-d3c001708a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:40.983491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-125610de-cc74-4193-aa00-d3c001708a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:40.983917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-125610de-cc74-4193-aa00-d3c001708a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:40.984633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-125610de-cc74-4193-aa00-d3c001708a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:40.985095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-125610de-cc74-4193-aa00-d3c001708a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:40.985494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-125610de-cc74-4193-aa00-d3c001708a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:40.986562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b20f1f02-21ee-463c-99c7-45b3cb6b4f7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:40.988711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b20f1f02-21ee-463c-99c7-45b3cb6b4f7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:40.995172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b20f1f02-21ee-463c-99c7-45b3cb6b4f7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:40.995875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b20f1f02-21ee-463c-99c7-45b3cb6b4f7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:40.996510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b20f1f02-21ee-463c-99c7-45b3cb6b4f7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:40.997381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b20f1f02-21ee-463c-99c7-45b3cb6b4f7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:40.997837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b20f1f02-21ee-463c-99c7-45b3cb6b4f7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:40.998262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b20f1f02-21ee-463c-99c7-45b3cb6b4f7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:41.015885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-125610de-cc74-4193-aa00-d3c001708a63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045232 Aug 06 12:48:41.016660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 808/1623] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:40 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:41.028200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b20f1f02-21ee-463c-99c7-45b3cb6b4f7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Aug 06 12:48:41.028832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 816/1624] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:42.028434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6e3d07e2-8fea-46dd-95e1-53023c0f2fb6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:42.030574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6e3d07e2-8fea-46dd-95e1-53023c0f2fb6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:42.036956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e3d07e2-8fea-46dd-95e1-53023c0f2fb6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:42.037436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e3d07e2-8fea-46dd-95e1-53023c0f2fb6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:42.037865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e3d07e2-8fea-46dd-95e1-53023c0f2fb6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:42.038544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e3d07e2-8fea-46dd-95e1-53023c0f2fb6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:42.039014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e3d07e2-8fea-46dd-95e1-53023c0f2fb6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:42.039434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e3d07e2-8fea-46dd-95e1-53023c0f2fb6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:42.040375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-13fa3c22-93a8-4d24-940b-f199bc43c308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:42.043151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-13fa3c22-93a8-4d24-940b-f199bc43c308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:42.049394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13fa3c22-93a8-4d24-940b-f199bc43c308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:42.049998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13fa3c22-93a8-4d24-940b-f199bc43c308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:42.050427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13fa3c22-93a8-4d24-940b-f199bc43c308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:42.051145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13fa3c22-93a8-4d24-940b-f199bc43c308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:42.051589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13fa3c22-93a8-4d24-940b-f199bc43c308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:42.052004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13fa3c22-93a8-4d24-940b-f199bc43c308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:42.068373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6e3d07e2-8fea-46dd-95e1-53023c0f2fb6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Aug 06 12:48:42.068930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 809/1625] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:42 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:42.080814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-13fa3c22-93a8-4d24-940b-f199bc43c308 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Aug 06 12:48:42.081359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 817/1626] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:42 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:43.079962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d59a2a43-e227-4035-870d-c688d22b4a2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:43.082118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d59a2a43-e227-4035-870d-c688d22b4a2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:43.088526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d59a2a43-e227-4035-870d-c688d22b4a2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:43.089022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d59a2a43-e227-4035-870d-c688d22b4a2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:43.089436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d59a2a43-e227-4035-870d-c688d22b4a2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:43.090125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d59a2a43-e227-4035-870d-c688d22b4a2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:43.090575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d59a2a43-e227-4035-870d-c688d22b4a2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:43.091000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d59a2a43-e227-4035-870d-c688d22b4a2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:43.092614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0c72a682-b9e1-4eb5-bd77-6247e911827b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:43.094898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0c72a682-b9e1-4eb5-bd77-6247e911827b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:43.101084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c72a682-b9e1-4eb5-bd77-6247e911827b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:43.101545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c72a682-b9e1-4eb5-bd77-6247e911827b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:43.101970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c72a682-b9e1-4eb5-bd77-6247e911827b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:43.102651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c72a682-b9e1-4eb5-bd77-6247e911827b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:43.103148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c72a682-b9e1-4eb5-bd77-6247e911827b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:43.103572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c72a682-b9e1-4eb5-bd77-6247e911827b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:43.117864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:43.123479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d59a2a43-e227-4035-870d-c688d22b4a2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047475 Aug 06 12:48:43.124050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 810/1627] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:43 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:43.134459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0c72a682-b9e1-4eb5-bd77-6247e911827b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 Aug 06 12:48:43.135025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 818/1628] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:43.519778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:48:43.519990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:48:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:48:44.136653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27d6548c-deaa-49cc-a357-48da0adee5e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:44.138793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27d6548c-deaa-49cc-a357-48da0adee5e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:44.145427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27d6548c-deaa-49cc-a357-48da0adee5e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:44.145907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27d6548c-deaa-49cc-a357-48da0adee5e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:44.146332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27d6548c-deaa-49cc-a357-48da0adee5e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:44.146738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2359e97e-9d99-4a5b-a184-bb3b5cd3daed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:44.147148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27d6548c-deaa-49cc-a357-48da0adee5e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:44.147453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27d6548c-deaa-49cc-a357-48da0adee5e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:44.147868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27d6548c-deaa-49cc-a357-48da0adee5e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:44.148924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2359e97e-9d99-4a5b-a184-bb3b5cd3daed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:44.155227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2359e97e-9d99-4a5b-a184-bb3b5cd3daed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:44.155703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2359e97e-9d99-4a5b-a184-bb3b5cd3daed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:44.156132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2359e97e-9d99-4a5b-a184-bb3b5cd3daed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:44.156842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2359e97e-9d99-4a5b-a184-bb3b5cd3daed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:44.157291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2359e97e-9d99-4a5b-a184-bb3b5cd3daed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:44.157726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2359e97e-9d99-4a5b-a184-bb3b5cd3daed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:44.176682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27d6548c-deaa-49cc-a357-48da0adee5e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045210 Aug 06 12:48:44.177239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 811/1629] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:44 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:44.186741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2359e97e-9d99-4a5b-a184-bb3b5cd3daed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Aug 06 12:48:44.187295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 819/1630] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:45.188665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2e26a474-7fc3-46a4-abd0-efa2dbd90207 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:45.190789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2e26a474-7fc3-46a4-abd0-efa2dbd90207 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:45.197174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e26a474-7fc3-46a4-abd0-efa2dbd90207 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:45.197656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e26a474-7fc3-46a4-abd0-efa2dbd90207 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:45.198089 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e26a474-7fc3-46a4-abd0-efa2dbd90207 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:45.198513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c1c8150e-86a0-4bbf-b4a2-936a682f05ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:45.198925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e26a474-7fc3-46a4-abd0-efa2dbd90207 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:45.199213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e26a474-7fc3-46a4-abd0-efa2dbd90207 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:45.199635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e26a474-7fc3-46a4-abd0-efa2dbd90207 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:45.200626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c1c8150e-86a0-4bbf-b4a2-936a682f05ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:45.206821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1c8150e-86a0-4bbf-b4a2-936a682f05ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:45.207292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1c8150e-86a0-4bbf-b4a2-936a682f05ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:45.207720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1c8150e-86a0-4bbf-b4a2-936a682f05ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:45.208444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1c8150e-86a0-4bbf-b4a2-936a682f05ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:45.208887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1c8150e-86a0-4bbf-b4a2-936a682f05ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:45.209300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1c8150e-86a0-4bbf-b4a2-936a682f05ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:45.228425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2e26a474-7fc3-46a4-abd0-efa2dbd90207 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043733 Aug 06 12:48:45.228983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 812/1631] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:45 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:45.239014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c1c8150e-86a0-4bbf-b4a2-936a682f05ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Aug 06 12:48:45.239557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 820/1632] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:46.241536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c86293e3-1312-4fcc-8643-88c6025a5ca9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:46.243647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c86293e3-1312-4fcc-8643-88c6025a5ca9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:46.246571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=58 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:46.251491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8d694223-233c-4953-bd94-6365690a1796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:46.252020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86293e3-1312-4fcc-8643-88c6025a5ca9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:46.252531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86293e3-1312-4fcc-8643-88c6025a5ca9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:46.252961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86293e3-1312-4fcc-8643-88c6025a5ca9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:46.253577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8d694223-233c-4953-bd94-6365690a1796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:46.253695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86293e3-1312-4fcc-8643-88c6025a5ca9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:46.254077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86293e3-1312-4fcc-8643-88c6025a5ca9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:46.254492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86293e3-1312-4fcc-8643-88c6025a5ca9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:46.255554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=58 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:46.260941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d694223-233c-4953-bd94-6365690a1796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:46.261560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d694223-233c-4953-bd94-6365690a1796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:46.262026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d694223-233c-4953-bd94-6365690a1796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:46.262718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d694223-233c-4953-bd94-6365690a1796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:46.263169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d694223-233c-4953-bd94-6365690a1796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:46.263589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d694223-233c-4953-bd94-6365690a1796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:46.283840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c86293e3-1312-4fcc-8643-88c6025a5ca9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Aug 06 12:48:46.284490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 813/1633] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:46 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:46.292934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8d694223-233c-4953-bd94-6365690a1796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Aug 06 12:48:46.293477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 821/1634] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:47.296368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-31ad03e6-2e81-4265-9970-1536208672ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:47.298546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-31ad03e6-2e81-4265-9970-1536208672ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:47.304980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31ad03e6-2e81-4265-9970-1536208672ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:47.305161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-96a39726-7873-4f08-93c8-9250790c4a04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:47.305543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31ad03e6-2e81-4265-9970-1536208672ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:47.305869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31ad03e6-2e81-4265-9970-1536208672ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:47.306579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31ad03e6-2e81-4265-9970-1536208672ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:47.307024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31ad03e6-2e81-4265-9970-1536208672ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:47.307499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31ad03e6-2e81-4265-9970-1536208672ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:47.307602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-96a39726-7873-4f08-93c8-9250790c4a04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:47.313818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96a39726-7873-4f08-93c8-9250790c4a04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:47.314294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96a39726-7873-4f08-93c8-9250790c4a04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:47.314725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96a39726-7873-4f08-93c8-9250790c4a04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:47.315414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96a39726-7873-4f08-93c8-9250790c4a04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:47.315891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96a39726-7873-4f08-93c8-9250790c4a04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:47.316337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-96a39726-7873-4f08-93c8-9250790c4a04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:47.335843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-31ad03e6-2e81-4265-9970-1536208672ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044145 Aug 06 12:48:47.336415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 814/1635] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:47 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:47.345686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-96a39726-7873-4f08-93c8-9250790c4a04 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Aug 06 12:48:47.346236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 822/1636] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:48.348802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cef3e7ef-9146-4260-ae74-5dbd955374d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:48.350914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cef3e7ef-9146-4260-ae74-5dbd955374d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:48.357792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cef3e7ef-9146-4260-ae74-5dbd955374d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:48.358140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-35989790-7200-4da3-923f-352b6a293e86 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:48.358544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cef3e7ef-9146-4260-ae74-5dbd955374d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:48.358684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cef3e7ef-9146-4260-ae74-5dbd955374d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:48.359362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cef3e7ef-9146-4260-ae74-5dbd955374d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:48.359807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cef3e7ef-9146-4260-ae74-5dbd955374d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:48.360219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cef3e7ef-9146-4260-ae74-5dbd955374d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:48.360349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-35989790-7200-4da3-923f-352b6a293e86 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:48.366823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35989790-7200-4da3-923f-352b6a293e86 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:48.367301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35989790-7200-4da3-923f-352b6a293e86 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:48.367734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35989790-7200-4da3-923f-352b6a293e86 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:48.368442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35989790-7200-4da3-923f-352b6a293e86 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:48.368892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35989790-7200-4da3-923f-352b6a293e86 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:48.369312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35989790-7200-4da3-923f-352b6a293e86 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:48.389201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cef3e7ef-9146-4260-ae74-5dbd955374d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Aug 06 12:48:48.389768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 815/1637] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:48 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:48.399340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-35989790-7200-4da3-923f-352b6a293e86 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045436 Aug 06 12:48:48.399882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 823/1638] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:49.401288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-99376c46-3b90-46a3-b189-a0f268034904 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:49.403423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-99376c46-3b90-46a3-b189-a0f268034904 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:49.410060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99376c46-3b90-46a3-b189-a0f268034904 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:49.410531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-acbeff7c-b101-45e1-be34-481e8219f53a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:49.410940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99376c46-3b90-46a3-b189-a0f268034904 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:49.410940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99376c46-3b90-46a3-b189-a0f268034904 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:49.411627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99376c46-3b90-46a3-b189-a0f268034904 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:49.412071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99376c46-3b90-46a3-b189-a0f268034904 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:49.412513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99376c46-3b90-46a3-b189-a0f268034904 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:49.412661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-acbeff7c-b101-45e1-be34-481e8219f53a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:49.419030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbeff7c-b101-45e1-be34-481e8219f53a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:49.419501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbeff7c-b101-45e1-be34-481e8219f53a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:49.419933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbeff7c-b101-45e1-be34-481e8219f53a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:49.420642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbeff7c-b101-45e1-be34-481e8219f53a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:49.421090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbeff7c-b101-45e1-be34-481e8219f53a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:49.421506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbeff7c-b101-45e1-be34-481e8219f53a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:49.441050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-99376c46-3b90-46a3-b189-a0f268034904 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Aug 06 12:48:49.441609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 816/1639] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:49 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:49.451075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-acbeff7c-b101-45e1-be34-481e8219f53a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Aug 06 12:48:49.451637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 824/1640] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:50.453246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f60fd405-d43d-47f0-8b8a-f3803ac1eef3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:50.455305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f60fd405-d43d-47f0-8b8a-f3803ac1eef3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:50.461659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f60fd405-d43d-47f0-8b8a-f3803ac1eef3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:50.462131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f60fd405-d43d-47f0-8b8a-f3803ac1eef3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:50.462559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f60fd405-d43d-47f0-8b8a-f3803ac1eef3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:50.462868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-44ff51aa-2363-4e6d-8460-0c1acf9d2dd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:50.463258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f60fd405-d43d-47f0-8b8a-f3803ac1eef3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:50.463696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f60fd405-d43d-47f0-8b8a-f3803ac1eef3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:50.464893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f60fd405-d43d-47f0-8b8a-f3803ac1eef3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:50.465645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-44ff51aa-2363-4e6d-8460-0c1acf9d2dd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:50.471942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ff51aa-2363-4e6d-8460-0c1acf9d2dd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:50.472455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ff51aa-2363-4e6d-8460-0c1acf9d2dd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:50.472884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ff51aa-2363-4e6d-8460-0c1acf9d2dd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:50.473569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ff51aa-2363-4e6d-8460-0c1acf9d2dd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:50.474013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ff51aa-2363-4e6d-8460-0c1acf9d2dd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:50.474425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ff51aa-2363-4e6d-8460-0c1acf9d2dd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:50.495419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f60fd405-d43d-47f0-8b8a-f3803ac1eef3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Aug 06 12:48:50.496002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 817/1641] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:50 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:50.503722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-44ff51aa-2363-4e6d-8460-0c1acf9d2dd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Aug 06 12:48:50.504273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 825/1642] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:51.507093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-944bf8bd-61ae-4650-80dd-d1d2754c1148 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:51.509222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-944bf8bd-61ae-4650-80dd-d1d2754c1148 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:51.515638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-944bf8bd-61ae-4650-80dd-d1d2754c1148 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:51.515791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2a789a28-3c11-4efe-abda-a7068a4284c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:51.516192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-944bf8bd-61ae-4650-80dd-d1d2754c1148 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:51.516568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-944bf8bd-61ae-4650-80dd-d1d2754c1148 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:51.517248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-944bf8bd-61ae-4650-80dd-d1d2754c1148 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:51.517690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-944bf8bd-61ae-4650-80dd-d1d2754c1148 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:51.517835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2a789a28-3c11-4efe-abda-a7068a4284c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:51.518107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-944bf8bd-61ae-4650-80dd-d1d2754c1148 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:51.524083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a789a28-3c11-4efe-abda-a7068a4284c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:51.524588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a789a28-3c11-4efe-abda-a7068a4284c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:51.525021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a789a28-3c11-4efe-abda-a7068a4284c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:51.525698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a789a28-3c11-4efe-abda-a7068a4284c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:51.526144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a789a28-3c11-4efe-abda-a7068a4284c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:51.526561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a789a28-3c11-4efe-abda-a7068a4284c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:51.546494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-944bf8bd-61ae-4650-80dd-d1d2754c1148 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043315 Aug 06 12:48:51.547246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 818/1643] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:51 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:51.555149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2a789a28-3c11-4efe-abda-a7068a4284c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043381 Aug 06 12:48:51.555693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 826/1644] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:52.559030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b86e3733-8248-4c17-9fd3-fb1e8946a9af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:52.561223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b86e3733-8248-4c17-9fd3-fb1e8946a9af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:52.567542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b266406e-bda1-481b-8d21-e490bdbcfa08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:52.568012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b86e3733-8248-4c17-9fd3-fb1e8946a9af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:52.568119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b86e3733-8248-4c17-9fd3-fb1e8946a9af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:52.568525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b86e3733-8248-4c17-9fd3-fb1e8946a9af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:52.569214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b86e3733-8248-4c17-9fd3-fb1e8946a9af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:52.569661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b86e3733-8248-4c17-9fd3-fb1e8946a9af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:52.569778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b266406e-bda1-481b-8d21-e490bdbcfa08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:52.570085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b86e3733-8248-4c17-9fd3-fb1e8946a9af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:52.576619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b266406e-bda1-481b-8d21-e490bdbcfa08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:52.577099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b266406e-bda1-481b-8d21-e490bdbcfa08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:52.577536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b266406e-bda1-481b-8d21-e490bdbcfa08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:52.578224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b266406e-bda1-481b-8d21-e490bdbcfa08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:52.578673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b266406e-bda1-481b-8d21-e490bdbcfa08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:52.579094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b266406e-bda1-481b-8d21-e490bdbcfa08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:52.598990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b86e3733-8248-4c17-9fd3-fb1e8946a9af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044359 Aug 06 12:48:52.599551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 819/1645] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:52 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:52.607206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b266406e-bda1-481b-8d21-e490bdbcfa08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043536 Aug 06 12:48:52.607754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 827/1646] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:53.611441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f50abfa1-a75b-4e7b-8498-4f3580b64044 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:53.613609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f50abfa1-a75b-4e7b-8498-4f3580b64044 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:53.618860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-526f8634-931f-409f-9e74-f571403b4347 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:53.620049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f50abfa1-a75b-4e7b-8498-4f3580b64044 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:53.620568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f50abfa1-a75b-4e7b-8498-4f3580b64044 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:53.621006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f50abfa1-a75b-4e7b-8498-4f3580b64044 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:53.621136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-526f8634-931f-409f-9e74-f571403b4347 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:53.621713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f50abfa1-a75b-4e7b-8498-4f3580b64044 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:53.622170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f50abfa1-a75b-4e7b-8498-4f3580b64044 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:53.622593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f50abfa1-a75b-4e7b-8498-4f3580b64044 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:53.627340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-526f8634-931f-409f-9e74-f571403b4347 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:53.627812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-526f8634-931f-409f-9e74-f571403b4347 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:53.628237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-526f8634-931f-409f-9e74-f571403b4347 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:53.628946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-526f8634-931f-409f-9e74-f571403b4347 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:53.629390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-526f8634-931f-409f-9e74-f571403b4347 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:53.629808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-526f8634-931f-409f-9e74-f571403b4347 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:53.652263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f50abfa1-a75b-4e7b-8498-4f3580b64044 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044390 Aug 06 12:48:53.652849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 820/1647] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:53 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:53.659127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-526f8634-931f-409f-9e74-f571403b4347 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Aug 06 12:48:53.659664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 828/1648] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:54.664551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-80b90b6c-4d2f-40ae-899b-5178af43e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:54.666661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-80b90b6c-4d2f-40ae-899b-5178af43e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:54.671722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ae203f3a-6bff-452c-95ad-517d42b51240 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:54.673689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80b90b6c-4d2f-40ae-899b-5178af43e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:54.673890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ae203f3a-6bff-452c-95ad-517d42b51240 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:54.674166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80b90b6c-4d2f-40ae-899b-5178af43e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:54.674596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80b90b6c-4d2f-40ae-899b-5178af43e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:54.675277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80b90b6c-4d2f-40ae-899b-5178af43e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:54.675724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80b90b6c-4d2f-40ae-899b-5178af43e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:54.676139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80b90b6c-4d2f-40ae-899b-5178af43e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:54.680042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae203f3a-6bff-452c-95ad-517d42b51240 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:54.680558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae203f3a-6bff-452c-95ad-517d42b51240 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:54.680989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae203f3a-6bff-452c-95ad-517d42b51240 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:54.681674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae203f3a-6bff-452c-95ad-517d42b51240 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:54.682123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae203f3a-6bff-452c-95ad-517d42b51240 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:54.682543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae203f3a-6bff-452c-95ad-517d42b51240 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:54.705748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-80b90b6c-4d2f-40ae-899b-5178af43e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Aug 06 12:48:54.706321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 821/1649] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:54 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:54.710726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ae203f3a-6bff-452c-95ad-517d42b51240 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 Aug 06 12:48:54.711278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 829/1650] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:55.717983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1b1260f6-0c08-4573-9491-0e0eadff9893 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:55.720612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1b1260f6-0c08-4573-9491-0e0eadff9893 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:55.722997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-71744c14-711e-42db-ad13-73257b31bc52 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:55.725126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-71744c14-711e-42db-ad13-73257b31bc52 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:55.726966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b1260f6-0c08-4573-9491-0e0eadff9893 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:55.727441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b1260f6-0c08-4573-9491-0e0eadff9893 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:55.727868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b1260f6-0c08-4573-9491-0e0eadff9893 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:55.728579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b1260f6-0c08-4573-9491-0e0eadff9893 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:55.729020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b1260f6-0c08-4573-9491-0e0eadff9893 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:55.729937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b1260f6-0c08-4573-9491-0e0eadff9893 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:55.731768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71744c14-711e-42db-ad13-73257b31bc52 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:55.732242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71744c14-711e-42db-ad13-73257b31bc52 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:55.732699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71744c14-711e-42db-ad13-73257b31bc52 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:55.733382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71744c14-711e-42db-ad13-73257b31bc52 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:55.733828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71744c14-711e-42db-ad13-73257b31bc52 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:55.734243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71744c14-711e-42db-ad13-73257b31bc52 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:55.758890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1b1260f6-0c08-4573-9491-0e0eadff9893 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Aug 06 12:48:55.759438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 822/1651] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:55 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:55.763166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-71744c14-711e-42db-ad13-73257b31bc52 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044046 Aug 06 12:48:55.763709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 830/1652] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:56.770283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-84cf353b-0a9c-47a8-85a7-732b73b2de51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:56.772424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-84cf353b-0a9c-47a8-85a7-732b73b2de51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:56.774879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1662ba1d-ac6c-41c2-bfaf-ce47f406a7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:56.777599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1662ba1d-ac6c-41c2-bfaf-ce47f406a7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:56.779393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84cf353b-0a9c-47a8-85a7-732b73b2de51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:56.779872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84cf353b-0a9c-47a8-85a7-732b73b2de51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:56.780317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84cf353b-0a9c-47a8-85a7-732b73b2de51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:56.781002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84cf353b-0a9c-47a8-85a7-732b73b2de51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:56.781514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84cf353b-0a9c-47a8-85a7-732b73b2de51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:56.782022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84cf353b-0a9c-47a8-85a7-732b73b2de51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:56.783813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1662ba1d-ac6c-41c2-bfaf-ce47f406a7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:56.784313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1662ba1d-ac6c-41c2-bfaf-ce47f406a7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:56.784743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1662ba1d-ac6c-41c2-bfaf-ce47f406a7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:56.785423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1662ba1d-ac6c-41c2-bfaf-ce47f406a7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:56.785961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1662ba1d-ac6c-41c2-bfaf-ce47f406a7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:56.786384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1662ba1d-ac6c-41c2-bfaf-ce47f406a7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:56.789974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:48:56.810769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-84cf353b-0a9c-47a8-85a7-732b73b2de51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Aug 06 12:48:56.811333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 823/1653] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:56 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:56.815976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1662ba1d-ac6c-41c2-bfaf-ce47f406a7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044223 Aug 06 12:48:56.816570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 831/1654] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:57.822836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c365b82-30a5-4dac-9b35-2aed21a4f8fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:57.825250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c365b82-30a5-4dac-9b35-2aed21a4f8fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:57.830482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6cdaf73a-1c3c-4457-8b7d-5bfccf683e07 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:57.832146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c365b82-30a5-4dac-9b35-2aed21a4f8fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:57.832635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6cdaf73a-1c3c-4457-8b7d-5bfccf683e07 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:57.832760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c365b82-30a5-4dac-9b35-2aed21a4f8fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:57.833072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c365b82-30a5-4dac-9b35-2aed21a4f8fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:57.833760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c365b82-30a5-4dac-9b35-2aed21a4f8fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:57.834206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c365b82-30a5-4dac-9b35-2aed21a4f8fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:57.834622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c365b82-30a5-4dac-9b35-2aed21a4f8fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:57.840291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cdaf73a-1c3c-4457-8b7d-5bfccf683e07 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:57.841119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cdaf73a-1c3c-4457-8b7d-5bfccf683e07 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:57.841722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cdaf73a-1c3c-4457-8b7d-5bfccf683e07 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:57.842420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cdaf73a-1c3c-4457-8b7d-5bfccf683e07 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:57.842877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cdaf73a-1c3c-4457-8b7d-5bfccf683e07 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:57.843289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cdaf73a-1c3c-4457-8b7d-5bfccf683e07 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:57.865506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c365b82-30a5-4dac-9b35-2aed21a4f8fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046509 Aug 06 12:48:57.866075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 824/1655] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:57 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:57.877661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6cdaf73a-1c3c-4457-8b7d-5bfccf683e07 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053524 Aug 06 12:48:57.878206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 832/1656] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:58.877983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a109e468-48b7-4706-8ff5-7a243893b4e5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:58.880153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a109e468-48b7-4706-8ff5-7a243893b4e5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:58.886963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a109e468-48b7-4706-8ff5-7a243893b4e5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:58.887452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a109e468-48b7-4706-8ff5-7a243893b4e5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:58.887890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a109e468-48b7-4706-8ff5-7a243893b4e5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:58.888612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a109e468-48b7-4706-8ff5-7a243893b4e5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:58.889067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a109e468-48b7-4706-8ff5-7a243893b4e5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:58.889451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac48b430-3166-4d8f-8e86-4c31358f753b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:58.889879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a109e468-48b7-4706-8ff5-7a243893b4e5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:58.891555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac48b430-3166-4d8f-8e86-4c31358f753b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:58.897871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac48b430-3166-4d8f-8e86-4c31358f753b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:58.898343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac48b430-3166-4d8f-8e86-4c31358f753b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:58.898768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac48b430-3166-4d8f-8e86-4c31358f753b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:58.899444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac48b430-3166-4d8f-8e86-4c31358f753b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:58.899883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac48b430-3166-4d8f-8e86-4c31358f753b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:58.900335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac48b430-3166-4d8f-8e86-4c31358f753b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:58.918546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a109e468-48b7-4706-8ff5-7a243893b4e5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044522 Aug 06 12:48:58.919124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 825/1657] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:58 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:58.928753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac48b430-3166-4d8f-8e86-4c31358f753b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043107 Aug 06 12:48:58.929293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 833/1658] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:48:59.931338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cd7c0096-229c-41ff-8b41-c8c78381e229 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:59.933966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cd7c0096-229c-41ff-8b41-c8c78381e229 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:59.940342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd7c0096-229c-41ff-8b41-c8c78381e229 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:59.940823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd7c0096-229c-41ff-8b41-c8c78381e229 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:59.941250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd7c0096-229c-41ff-8b41-c8c78381e229 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:59.941486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-858aefeb-5ebf-47d5-98a9-198c3d9564c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:48:59.941942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd7c0096-229c-41ff-8b41-c8c78381e229 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:59.942362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd7c0096-229c-41ff-8b41-c8c78381e229 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:59.942777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd7c0096-229c-41ff-8b41-c8c78381e229 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:59.943649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-858aefeb-5ebf-47d5-98a9-198c3d9564c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:48:59.950610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-858aefeb-5ebf-47d5-98a9-198c3d9564c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:59.951088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-858aefeb-5ebf-47d5-98a9-198c3d9564c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:59.951520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-858aefeb-5ebf-47d5-98a9-198c3d9564c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:59.952211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-858aefeb-5ebf-47d5-98a9-198c3d9564c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:48:59.952708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-858aefeb-5ebf-47d5-98a9-198c3d9564c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:48:59.953129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-858aefeb-5ebf-47d5-98a9-198c3d9564c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:48:59.972125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cd7c0096-229c-41ff-8b41-c8c78381e229 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Aug 06 12:48:59.972699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 826/1659] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:48:59.981483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-858aefeb-5ebf-47d5-98a9-198c3d9564c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Aug 06 12:48:59.982030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 834/1660] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:48:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:00.984915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-141705fe-d8c5-4b96-b456-f7030eb84ea4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:00.987319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-141705fe-d8c5-4b96-b456-f7030eb84ea4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:00.993621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141705fe-d8c5-4b96-b456-f7030eb84ea4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:00.993817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-08bfa544-8c43-4e3a-bb92-39bd90e51f00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:00.994208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141705fe-d8c5-4b96-b456-f7030eb84ea4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:00.994545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141705fe-d8c5-4b96-b456-f7030eb84ea4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:00.995239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141705fe-d8c5-4b96-b456-f7030eb84ea4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:00.995693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141705fe-d8c5-4b96-b456-f7030eb84ea4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:00.995814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-08bfa544-8c43-4e3a-bb92-39bd90e51f00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:00.996118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141705fe-d8c5-4b96-b456-f7030eb84ea4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:01.002356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08bfa544-8c43-4e3a-bb92-39bd90e51f00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:01.002889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08bfa544-8c43-4e3a-bb92-39bd90e51f00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:01.003323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08bfa544-8c43-4e3a-bb92-39bd90e51f00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:01.004013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08bfa544-8c43-4e3a-bb92-39bd90e51f00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:01.004570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08bfa544-8c43-4e3a-bb92-39bd90e51f00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:01.004993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08bfa544-8c43-4e3a-bb92-39bd90e51f00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:01.013334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:01.027281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-141705fe-d8c5-4b96-b456-f7030eb84ea4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Aug 06 12:49:01.028042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 827/1661] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:00 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:01.036325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-08bfa544-8c43-4e3a-bb92-39bd90e51f00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046746 Aug 06 12:49:01.036892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 835/1662] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:02.039760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e5b66a58-3464-4d44-a70f-2b249ff39cd5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:02.042450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e5b66a58-3464-4d44-a70f-2b249ff39cd5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:02.048604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ccc93f31-3735-4271-afa8-a28302e16801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:02.049060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5b66a58-3464-4d44-a70f-2b249ff39cd5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:02.049415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5b66a58-3464-4d44-a70f-2b249ff39cd5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:02.049850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5b66a58-3464-4d44-a70f-2b249ff39cd5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:02.050539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5b66a58-3464-4d44-a70f-2b249ff39cd5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:02.050769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ccc93f31-3735-4271-afa8-a28302e16801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:02.050987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5b66a58-3464-4d44-a70f-2b249ff39cd5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:02.051406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5b66a58-3464-4d44-a70f-2b249ff39cd5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:02.056982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccc93f31-3735-4271-afa8-a28302e16801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:02.057507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccc93f31-3735-4271-afa8-a28302e16801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:02.058461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccc93f31-3735-4271-afa8-a28302e16801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:02.059141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccc93f31-3735-4271-afa8-a28302e16801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:02.059583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccc93f31-3735-4271-afa8-a28302e16801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:02.059994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccc93f31-3735-4271-afa8-a28302e16801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:02.080416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e5b66a58-3464-4d44-a70f-2b249ff39cd5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044507 Aug 06 12:49:02.080977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 828/1663] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:02 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:02.088191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ccc93f31-3735-4271-afa8-a28302e16801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043443 Aug 06 12:49:02.088761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 836/1664] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:02.806645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:49:02.806878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:49:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:49:03.092666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7bd24a9b-5786-4ba6-90e6-217ccd2f0d32 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:03.094877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7bd24a9b-5786-4ba6-90e6-217ccd2f0d32 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:03.099630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-90448615-4435-4fdd-a71d-4a38b706c116 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:03.100995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd24a9b-5786-4ba6-90e6-217ccd2f0d32 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:03.101479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd24a9b-5786-4ba6-90e6-217ccd2f0d32 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:03.101792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-90448615-4435-4fdd-a71d-4a38b706c116 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:03.101898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd24a9b-5786-4ba6-90e6-217ccd2f0d32 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:03.102592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd24a9b-5786-4ba6-90e6-217ccd2f0d32 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:03.103042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd24a9b-5786-4ba6-90e6-217ccd2f0d32 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:03.103469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bd24a9b-5786-4ba6-90e6-217ccd2f0d32 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:03.107970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90448615-4435-4fdd-a71d-4a38b706c116 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:03.108471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90448615-4435-4fdd-a71d-4a38b706c116 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:03.108898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90448615-4435-4fdd-a71d-4a38b706c116 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:03.109577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90448615-4435-4fdd-a71d-4a38b706c116 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:03.110019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90448615-4435-4fdd-a71d-4a38b706c116 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:03.110437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90448615-4435-4fdd-a71d-4a38b706c116 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:03.132571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7bd24a9b-5786-4ba6-90e6-217ccd2f0d32 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043831 Aug 06 12:49:03.133133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 829/1665] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:03 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:03.140087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-90448615-4435-4fdd-a71d-4a38b706c116 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Aug 06 12:49:03.140813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 837/1666] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:04.145755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3ac1101a-692d-425e-8fc0-622b5d02b4ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:04.147944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3ac1101a-692d-425e-8fc0-622b5d02b4ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:04.152215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5d0dd8cb-dfd6-4f6c-bafe-b7df46fbdd8f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:04.154906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5d0dd8cb-dfd6-4f6c-bafe-b7df46fbdd8f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:04.155051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ac1101a-692d-425e-8fc0-622b5d02b4ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:04.155507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ac1101a-692d-425e-8fc0-622b5d02b4ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:04.155940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ac1101a-692d-425e-8fc0-622b5d02b4ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:04.156668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ac1101a-692d-425e-8fc0-622b5d02b4ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:04.157121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ac1101a-692d-425e-8fc0-622b5d02b4ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:04.157545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ac1101a-692d-425e-8fc0-622b5d02b4ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:04.161208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0dd8cb-dfd6-4f6c-bafe-b7df46fbdd8f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:04.161682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0dd8cb-dfd6-4f6c-bafe-b7df46fbdd8f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:04.162106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0dd8cb-dfd6-4f6c-bafe-b7df46fbdd8f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:04.162779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0dd8cb-dfd6-4f6c-bafe-b7df46fbdd8f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:04.163219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0dd8cb-dfd6-4f6c-bafe-b7df46fbdd8f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:04.163632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0dd8cb-dfd6-4f6c-bafe-b7df46fbdd8f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:04.185908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3ac1101a-692d-425e-8fc0-622b5d02b4ed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044248 Aug 06 12:49:04.186471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 830/1667] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:04 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:04.191610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5d0dd8cb-dfd6-4f6c-bafe-b7df46fbdd8f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 Aug 06 12:49:04.192150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 838/1668] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:05.198236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b04a86e1-d993-4536-9351-1c9b1891e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:05.200684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b04a86e1-d993-4536-9351-1c9b1891e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:05.203125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d8d9af64-bb4e-4195-8f9e-720b0fef3612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:05.205428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d8d9af64-bb4e-4195-8f9e-720b0fef3612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:05.207136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b04a86e1-d993-4536-9351-1c9b1891e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:05.207619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b04a86e1-d993-4536-9351-1c9b1891e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:05.208057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b04a86e1-d993-4536-9351-1c9b1891e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:05.208784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b04a86e1-d993-4536-9351-1c9b1891e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:05.209236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b04a86e1-d993-4536-9351-1c9b1891e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:05.209660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b04a86e1-d993-4536-9351-1c9b1891e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:05.211642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8d9af64-bb4e-4195-8f9e-720b0fef3612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:05.212116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8d9af64-bb4e-4195-8f9e-720b0fef3612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:05.212589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8d9af64-bb4e-4195-8f9e-720b0fef3612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:05.213277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8d9af64-bb4e-4195-8f9e-720b0fef3612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:05.213751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8d9af64-bb4e-4195-8f9e-720b0fef3612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:05.214168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8d9af64-bb4e-4195-8f9e-720b0fef3612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:05.239843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b04a86e1-d993-4536-9351-1c9b1891e27b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Aug 06 12:49:05.244242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 831/1669] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:05.244416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d8d9af64-bb4e-4195-8f9e-720b0fef3612 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Aug 06 12:49:05.244416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 839/1670] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:06.251836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-04410419-9b53-4da5-850a-9c19543e6cab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:06.254068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-04410419-9b53-4da5-850a-9c19543e6cab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:06.255576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-51e7999c-862e-4317-ad88-9117edd15165 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:06.257784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-51e7999c-862e-4317-ad88-9117edd15165 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:06.260578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04410419-9b53-4da5-850a-9c19543e6cab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:06.261058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04410419-9b53-4da5-850a-9c19543e6cab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:06.261493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04410419-9b53-4da5-850a-9c19543e6cab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:06.262181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04410419-9b53-4da5-850a-9c19543e6cab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:06.262634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04410419-9b53-4da5-850a-9c19543e6cab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:06.263057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04410419-9b53-4da5-850a-9c19543e6cab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:06.264084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51e7999c-862e-4317-ad88-9117edd15165 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:06.264596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51e7999c-862e-4317-ad88-9117edd15165 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:06.265031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51e7999c-862e-4317-ad88-9117edd15165 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:06.265724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51e7999c-862e-4317-ad88-9117edd15165 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:06.266174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51e7999c-862e-4317-ad88-9117edd15165 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:06.266598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51e7999c-862e-4317-ad88-9117edd15165 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:06.291414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-04410419-9b53-4da5-850a-9c19543e6cab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Aug 06 12:49:06.291972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 832/1671] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:06.296999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-51e7999c-862e-4317-ad88-9117edd15165 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045300 Aug 06 12:49:06.297549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 840/1672] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:07.303133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-673466ee-1f05-4aad-9c58-72b67a8cbe2c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:07.305474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-673466ee-1f05-4aad-9c58-72b67a8cbe2c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:07.308878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-854c1028-9d14-4a79-8550-b9cc63e6f9fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:07.311506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-854c1028-9d14-4a79-8550-b9cc63e6f9fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:07.312639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-673466ee-1f05-4aad-9c58-72b67a8cbe2c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:07.313121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-673466ee-1f05-4aad-9c58-72b67a8cbe2c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:07.313548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-673466ee-1f05-4aad-9c58-72b67a8cbe2c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:07.314237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-673466ee-1f05-4aad-9c58-72b67a8cbe2c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:07.314680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-673466ee-1f05-4aad-9c58-72b67a8cbe2c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:07.315094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-673466ee-1f05-4aad-9c58-72b67a8cbe2c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:07.317555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-854c1028-9d14-4a79-8550-b9cc63e6f9fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:07.318033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-854c1028-9d14-4a79-8550-b9cc63e6f9fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:07.318499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-854c1028-9d14-4a79-8550-b9cc63e6f9fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:07.319180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-854c1028-9d14-4a79-8550-b9cc63e6f9fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:07.319626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-854c1028-9d14-4a79-8550-b9cc63e6f9fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:07.320044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-854c1028-9d14-4a79-8550-b9cc63e6f9fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:07.344855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-673466ee-1f05-4aad-9c58-72b67a8cbe2c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Aug 06 12:49:07.345412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 833/1673] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:07 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:07.348616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-854c1028-9d14-4a79-8550-b9cc63e6f9fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043650 Aug 06 12:49:07.349156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 841/1674] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:08.356424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d2096d9f-e74b-488b-bf93-31e9dfb84ee1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:08.358661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d2096d9f-e74b-488b-bf93-31e9dfb84ee1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:08.360436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-936522fb-9650-4887-8b25-c13bd531a503 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:08.362881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-936522fb-9650-4887-8b25-c13bd531a503 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:08.365446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2096d9f-e74b-488b-bf93-31e9dfb84ee1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:08.366282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2096d9f-e74b-488b-bf93-31e9dfb84ee1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:08.366426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2096d9f-e74b-488b-bf93-31e9dfb84ee1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:08.367023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2096d9f-e74b-488b-bf93-31e9dfb84ee1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:08.367469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2096d9f-e74b-488b-bf93-31e9dfb84ee1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:08.367891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2096d9f-e74b-488b-bf93-31e9dfb84ee1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:08.369245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936522fb-9650-4887-8b25-c13bd531a503 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:08.369728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936522fb-9650-4887-8b25-c13bd531a503 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:08.370162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936522fb-9650-4887-8b25-c13bd531a503 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:08.370847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936522fb-9650-4887-8b25-c13bd531a503 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:08.371305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936522fb-9650-4887-8b25-c13bd531a503 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:08.372209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936522fb-9650-4887-8b25-c13bd531a503 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:08.396928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d2096d9f-e74b-488b-bf93-31e9dfb84ee1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Aug 06 12:49:08.397482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 834/1675] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:08.401359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-936522fb-9650-4887-8b25-c13bd531a503 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044840 Aug 06 12:49:08.401914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 842/1676] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:08 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:09.409737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6fc21d91-7670-4191-8bc5-0c869e31a19d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:09.411817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6fc21d91-7670-4191-8bc5-0c869e31a19d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:09.412819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ddce933c-5c8d-477d-beae-40f38c69c037 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:09.414928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ddce933c-5c8d-477d-beae-40f38c69c037 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:09.418190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fc21d91-7670-4191-8bc5-0c869e31a19d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:09.418749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fc21d91-7670-4191-8bc5-0c869e31a19d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:09.419186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fc21d91-7670-4191-8bc5-0c869e31a19d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:09.419879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fc21d91-7670-4191-8bc5-0c869e31a19d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:09.420353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fc21d91-7670-4191-8bc5-0c869e31a19d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:09.420780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fc21d91-7670-4191-8bc5-0c869e31a19d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:09.421377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddce933c-5c8d-477d-beae-40f38c69c037 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:09.421858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddce933c-5c8d-477d-beae-40f38c69c037 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:09.422295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddce933c-5c8d-477d-beae-40f38c69c037 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:09.422981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddce933c-5c8d-477d-beae-40f38c69c037 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:09.423434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddce933c-5c8d-477d-beae-40f38c69c037 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:09.423862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddce933c-5c8d-477d-beae-40f38c69c037 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:09.449133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6fc21d91-7670-4191-8bc5-0c869e31a19d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 Aug 06 12:49:09.449716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 835/1677] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:09.452856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ddce933c-5c8d-477d-beae-40f38c69c037 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Aug 06 12:49:09.453413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 843/1678] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:10.461804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a3651e72-3d66-4178-a52d-a3d724a1c25e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:10.463938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a3651e72-3d66-4178-a52d-a3d724a1c25e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:10.464870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-249c4700-4aee-42cb-ad6a-3fed43146951 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:10.467479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-249c4700-4aee-42cb-ad6a-3fed43146951 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:10.470897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3651e72-3d66-4178-a52d-a3d724a1c25e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:10.471378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3651e72-3d66-4178-a52d-a3d724a1c25e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:10.471807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3651e72-3d66-4178-a52d-a3d724a1c25e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:10.472518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3651e72-3d66-4178-a52d-a3d724a1c25e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:10.472967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3651e72-3d66-4178-a52d-a3d724a1c25e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:10.473381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3651e72-3d66-4178-a52d-a3d724a1c25e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:10.473607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249c4700-4aee-42cb-ad6a-3fed43146951 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:10.474079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249c4700-4aee-42cb-ad6a-3fed43146951 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:10.474509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249c4700-4aee-42cb-ad6a-3fed43146951 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:10.475182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249c4700-4aee-42cb-ad6a-3fed43146951 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:10.475651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249c4700-4aee-42cb-ad6a-3fed43146951 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:10.476064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249c4700-4aee-42cb-ad6a-3fed43146951 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:10.502658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a3651e72-3d66-4178-a52d-a3d724a1c25e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Aug 06 12:49:10.503221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 836/1679] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:10.505102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-249c4700-4aee-42cb-ad6a-3fed43146951 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Aug 06 12:49:10.505650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 844/1680] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:11.514114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6d25a4d8-9544-46a1-b053-f20ddd3162c7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:11.516878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6d25a4d8-9544-46a1-b053-f20ddd3162c7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:11.517047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-26568585-72af-491c-b4fc-449804d7ee8a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:11.519014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-26568585-72af-491c-b4fc-449804d7ee8a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:11.523269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d25a4d8-9544-46a1-b053-f20ddd3162c7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:11.523743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d25a4d8-9544-46a1-b053-f20ddd3162c7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:11.524173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d25a4d8-9544-46a1-b053-f20ddd3162c7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:11.524938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d25a4d8-9544-46a1-b053-f20ddd3162c7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:11.525252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26568585-72af-491c-b4fc-449804d7ee8a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:11.525370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d25a4d8-9544-46a1-b053-f20ddd3162c7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:11.525732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26568585-72af-491c-b4fc-449804d7ee8a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:11.525866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d25a4d8-9544-46a1-b053-f20ddd3162c7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:11.526166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26568585-72af-491c-b4fc-449804d7ee8a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:11.526852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26568585-72af-491c-b4fc-449804d7ee8a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:11.527300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26568585-72af-491c-b4fc-449804d7ee8a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:11.527719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26568585-72af-491c-b4fc-449804d7ee8a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:11.555006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6d25a4d8-9544-46a1-b053-f20ddd3162c7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044807 Aug 06 12:49:11.555598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 837/1681] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:11.556528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-26568585-72af-491c-b4fc-449804d7ee8a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043315 Aug 06 12:49:11.557084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 845/1682] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:12.567855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-01686c3e-04e6-43e4-adee-020547d07ca8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:12.569161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e7eafceb-7d36-4159-a616-0e4ce67d7e83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:12.569997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-01686c3e-04e6-43e4-adee-020547d07ca8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:12.571308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e7eafceb-7d36-4159-a616-0e4ce67d7e83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:12.576654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01686c3e-04e6-43e4-adee-020547d07ca8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:12.577158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01686c3e-04e6-43e4-adee-020547d07ca8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:12.577588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01686c3e-04e6-43e4-adee-020547d07ca8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:12.578272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01686c3e-04e6-43e4-adee-020547d07ca8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:12.578387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7eafceb-7d36-4159-a616-0e4ce67d7e83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:12.578718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01686c3e-04e6-43e4-adee-020547d07ca8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:12.578836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7eafceb-7d36-4159-a616-0e4ce67d7e83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:12.579132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01686c3e-04e6-43e4-adee-020547d07ca8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:12.579255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7eafceb-7d36-4159-a616-0e4ce67d7e83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:12.579866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7eafceb-7d36-4159-a616-0e4ce67d7e83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:12.580331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7eafceb-7d36-4159-a616-0e4ce67d7e83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:12.580769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7eafceb-7d36-4159-a616-0e4ce67d7e83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:12.607300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-01686c3e-04e6-43e4-adee-020547d07ca8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043451 Aug 06 12:49:12.607856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 838/1683] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:12.609882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e7eafceb-7d36-4159-a616-0e4ce67d7e83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Aug 06 12:49:12.610435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 846/1684] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:13.619182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f26b70c9-68cc-4dbb-9547-cc28b85dedd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:13.621333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f26b70c9-68cc-4dbb-9547-cc28b85dedd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:13.621947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-95d4ce29-6cb7-4583-86f6-5055d8d853e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:13.624042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-95d4ce29-6cb7-4583-86f6-5055d8d853e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:13.627655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f26b70c9-68cc-4dbb-9547-cc28b85dedd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:13.628130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f26b70c9-68cc-4dbb-9547-cc28b85dedd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:13.628588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f26b70c9-68cc-4dbb-9547-cc28b85dedd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:13.629270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f26b70c9-68cc-4dbb-9547-cc28b85dedd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:13.629713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f26b70c9-68cc-4dbb-9547-cc28b85dedd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:13.630126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f26b70c9-68cc-4dbb-9547-cc28b85dedd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:13.630228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d4ce29-6cb7-4583-86f6-5055d8d853e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:13.630660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d4ce29-6cb7-4583-86f6-5055d8d853e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:13.631087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d4ce29-6cb7-4583-86f6-5055d8d853e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:13.631761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d4ce29-6cb7-4583-86f6-5055d8d853e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:13.632206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d4ce29-6cb7-4583-86f6-5055d8d853e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:13.632644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95d4ce29-6cb7-4583-86f6-5055d8d853e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:13.656885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:13.659021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f26b70c9-68cc-4dbb-9547-cc28b85dedd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043693 Aug 06 12:49:13.659589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 839/1685] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:13 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:13.662052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-95d4ce29-6cb7-4583-86f6-5055d8d853e9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Aug 06 12:49:13.662603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 847/1686] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:14.671597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7e1143ad-0569-419d-9d3b-ba727e827c99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:14.673791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7e1143ad-0569-419d-9d3b-ba727e827c99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:14.674434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-81c93d30-af25-469b-b3ff-12dae8db22b7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:14.676573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-81c93d30-af25-469b-b3ff-12dae8db22b7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:14.680205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e1143ad-0569-419d-9d3b-ba727e827c99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:14.680717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e1143ad-0569-419d-9d3b-ba727e827c99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:14.681151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e1143ad-0569-419d-9d3b-ba727e827c99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:14.681837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e1143ad-0569-419d-9d3b-ba727e827c99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:14.682287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e1143ad-0569-419d-9d3b-ba727e827c99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:14.682693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81c93d30-af25-469b-b3ff-12dae8db22b7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:14.682813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e1143ad-0569-419d-9d3b-ba727e827c99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:14.683172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81c93d30-af25-469b-b3ff-12dae8db22b7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:14.683601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81c93d30-af25-469b-b3ff-12dae8db22b7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:14.684941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81c93d30-af25-469b-b3ff-12dae8db22b7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:14.685394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81c93d30-af25-469b-b3ff-12dae8db22b7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:14.685832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81c93d30-af25-469b-b3ff-12dae8db22b7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:14.711531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7e1143ad-0569-419d-9d3b-ba727e827c99 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044439 Aug 06 12:49:14.712095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 840/1687] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:14.713889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-81c93d30-af25-469b-b3ff-12dae8db22b7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Aug 06 12:49:14.714434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 848/1688] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:15.724045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-df899c00-7756-4ca9-9443-a447e30fe1f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:15.725784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4620c200-55fb-4308-bc30-ae80ec335a2e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:15.726194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df899c00-7756-4ca9-9443-a447e30fe1f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:15.727886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4620c200-55fb-4308-bc30-ae80ec335a2e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:15.732693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df899c00-7756-4ca9-9443-a447e30fe1f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:15.733167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df899c00-7756-4ca9-9443-a447e30fe1f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:15.733599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df899c00-7756-4ca9-9443-a447e30fe1f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:15.733724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4620c200-55fb-4308-bc30-ae80ec335a2e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:15.734131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4620c200-55fb-4308-bc30-ae80ec335a2e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:15.734286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df899c00-7756-4ca9-9443-a447e30fe1f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:15.734558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4620c200-55fb-4308-bc30-ae80ec335a2e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:15.734734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df899c00-7756-4ca9-9443-a447e30fe1f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:15.735158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df899c00-7756-4ca9-9443-a447e30fe1f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:15.735307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4620c200-55fb-4308-bc30-ae80ec335a2e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:15.735661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4620c200-55fb-4308-bc30-ae80ec335a2e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:15.736347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4620c200-55fb-4308-bc30-ae80ec335a2e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:15.764923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-df899c00-7756-4ca9-9443-a447e30fe1f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Aug 06 12:49:15.765303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4620c200-55fb-4308-bc30-ae80ec335a2e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Aug 06 12:49:15.769657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 841/1689] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:15.769806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 849/1690] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:15 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:16.776445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-556e57a5-703a-4007-a9a1-fe7f7682dad3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:16.777131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-67f10b7c-ce89-4454-9a4c-64ba576fc5f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:16.779157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-556e57a5-703a-4007-a9a1-fe7f7682dad3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:16.779863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-67f10b7c-ce89-4454-9a4c-64ba576fc5f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:16.781546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=58 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:16.782429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=58 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:16.786976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-556e57a5-703a-4007-a9a1-fe7f7682dad3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:16.787370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67f10b7c-ce89-4454-9a4c-64ba576fc5f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:16.787484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-556e57a5-703a-4007-a9a1-fe7f7682dad3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:16.787879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67f10b7c-ce89-4454-9a4c-64ba576fc5f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:16.787992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-556e57a5-703a-4007-a9a1-fe7f7682dad3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:16.788324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67f10b7c-ce89-4454-9a4c-64ba576fc5f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:16.788613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-556e57a5-703a-4007-a9a1-fe7f7682dad3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:16.789027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67f10b7c-ce89-4454-9a4c-64ba576fc5f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:16.789127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-556e57a5-703a-4007-a9a1-fe7f7682dad3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:16.789476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67f10b7c-ce89-4454-9a4c-64ba576fc5f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:16.789584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-556e57a5-703a-4007-a9a1-fe7f7682dad3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:16.789899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67f10b7c-ce89-4454-9a4c-64ba576fc5f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:16.818311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-556e57a5-703a-4007-a9a1-fe7f7682dad3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Aug 06 12:49:16.818544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-67f10b7c-ce89-4454-9a4c-64ba576fc5f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Aug 06 12:49:16.818899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 842/1691] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:16.819161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 850/1692] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:17.830152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-af3c9342-9361-4920-831f-724b94805542 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:17.832443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-af3c9342-9361-4920-831f-724b94805542 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:17.833049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d0ff6a80-0ecf-474c-9040-631cee68bfef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:17.835137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d0ff6a80-0ecf-474c-9040-631cee68bfef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:17.838871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3c9342-9361-4920-831f-724b94805542 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:17.839353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3c9342-9361-4920-831f-724b94805542 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:17.839790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3c9342-9361-4920-831f-724b94805542 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:17.840537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3c9342-9361-4920-831f-724b94805542 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:17.840994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3c9342-9361-4920-831f-724b94805542 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:17.841417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3c9342-9361-4920-831f-724b94805542 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:17.841520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ff6a80-0ecf-474c-9040-631cee68bfef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:17.841926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ff6a80-0ecf-474c-9040-631cee68bfef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:17.842353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ff6a80-0ecf-474c-9040-631cee68bfef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:17.843040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ff6a80-0ecf-474c-9040-631cee68bfef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:17.843490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ff6a80-0ecf-474c-9040-631cee68bfef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:17.843910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0ff6a80-0ecf-474c-9040-631cee68bfef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:17.869953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-af3c9342-9361-4920-831f-724b94805542 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043749 Aug 06 12:49:17.870511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 843/1693] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:17.872927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d0ff6a80-0ecf-474c-9040-631cee68bfef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043673 Aug 06 12:49:17.873470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 851/1694] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:18.882748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2464c034-30ab-4db0-aa78-bfb1dec419ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:18.884863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-58a4ee6b-fceb-4fc5-98c0-7e1710e8363f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:18.885258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2464c034-30ab-4db0-aa78-bfb1dec419ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:18.887715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-58a4ee6b-fceb-4fc5-98c0-7e1710e8363f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:18.892794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2464c034-30ab-4db0-aa78-bfb1dec419ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:18.893506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2464c034-30ab-4db0-aa78-bfb1dec419ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:18.893940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2464c034-30ab-4db0-aa78-bfb1dec419ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:18.894375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58a4ee6b-fceb-4fc5-98c0-7e1710e8363f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:18.894635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2464c034-30ab-4db0-aa78-bfb1dec419ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:18.894993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58a4ee6b-fceb-4fc5-98c0-7e1710e8363f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:18.895104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2464c034-30ab-4db0-aa78-bfb1dec419ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:18.895496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2464c034-30ab-4db0-aa78-bfb1dec419ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:18.895596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58a4ee6b-fceb-4fc5-98c0-7e1710e8363f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:18.896404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58a4ee6b-fceb-4fc5-98c0-7e1710e8363f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:18.896918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58a4ee6b-fceb-4fc5-98c0-7e1710e8363f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:18.897404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58a4ee6b-fceb-4fc5-98c0-7e1710e8363f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:18.899258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:18.928285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2464c034-30ab-4db0-aa78-bfb1dec419ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049510 Aug 06 12:49:18.929501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-58a4ee6b-fceb-4fc5-98c0-7e1710e8363f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048720 Aug 06 12:49:18.929679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 844/1695] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:18 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:18.930373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 852/1696] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:18 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:19.940898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1ed1046a-1455-4988-99f6-982c7b93db4b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:19.942152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1d647699-8add-4e4a-b2f3-72d0f470d825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:19.943024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1ed1046a-1455-4988-99f6-982c7b93db4b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:19.944319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1d647699-8add-4e4a-b2f3-72d0f470d825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:19.949965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ed1046a-1455-4988-99f6-982c7b93db4b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:19.950448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ed1046a-1455-4988-99f6-982c7b93db4b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:19.950880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ed1046a-1455-4988-99f6-982c7b93db4b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:19.951181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d647699-8add-4e4a-b2f3-72d0f470d825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:19.951577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ed1046a-1455-4988-99f6-982c7b93db4b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:19.951682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d647699-8add-4e4a-b2f3-72d0f470d825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:19.952041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ed1046a-1455-4988-99f6-982c7b93db4b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:19.952238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d647699-8add-4e4a-b2f3-72d0f470d825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:19.952492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ed1046a-1455-4988-99f6-982c7b93db4b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:19.952788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d647699-8add-4e4a-b2f3-72d0f470d825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:19.953240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d647699-8add-4e4a-b2f3-72d0f470d825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:19.953676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d647699-8add-4e4a-b2f3-72d0f470d825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:19.983048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1ed1046a-1455-4988-99f6-982c7b93db4b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046099 Aug 06 12:49:19.983306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1d647699-8add-4e4a-b2f3-72d0f470d825 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Aug 06 12:49:19.983843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 845/1697] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:19.983969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 853/1698] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:20.995901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-889dfc86-bb49-4a60-98ad-c587e236beeb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:20.996857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7c6b8c54-57ca-429d-ae70-96d864c81d13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:20.998091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-889dfc86-bb49-4a60-98ad-c587e236beeb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:20.998998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7c6b8c54-57ca-429d-ae70-96d864c81d13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:21.005270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c6b8c54-57ca-429d-ae70-96d864c81d13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:21.005431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-889dfc86-bb49-4a60-98ad-c587e236beeb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:21.005728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c6b8c54-57ca-429d-ae70-96d864c81d13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:21.005881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-889dfc86-bb49-4a60-98ad-c587e236beeb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:21.006160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c6b8c54-57ca-429d-ae70-96d864c81d13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:21.006315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-889dfc86-bb49-4a60-98ad-c587e236beeb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:21.006843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c6b8c54-57ca-429d-ae70-96d864c81d13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:21.006948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-889dfc86-bb49-4a60-98ad-c587e236beeb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:21.007292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c6b8c54-57ca-429d-ae70-96d864c81d13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:21.007396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-889dfc86-bb49-4a60-98ad-c587e236beeb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:21.007707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c6b8c54-57ca-429d-ae70-96d864c81d13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:21.007817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-889dfc86-bb49-4a60-98ad-c587e236beeb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:21.036539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7c6b8c54-57ca-429d-ae70-96d864c81d13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 Aug 06 12:49:21.037424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 854/1699] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:21.037610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-889dfc86-bb49-4a60-98ad-c587e236beeb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Aug 06 12:49:21.037704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 846/1700] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:22.048694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7c8cad44-4e16-477c-a8ba-75b806f46afb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:22.049187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ac95815-34f2-45e1-94f9-acc8a49fb890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:22.050831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7c8cad44-4e16-477c-a8ba-75b806f46afb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:22.051093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ac95815-34f2-45e1-94f9-acc8a49fb890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:22.057337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8cad44-4e16-477c-a8ba-75b806f46afb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:22.057526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ac95815-34f2-45e1-94f9-acc8a49fb890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:22.057837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8cad44-4e16-477c-a8ba-75b806f46afb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:22.057970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ac95815-34f2-45e1-94f9-acc8a49fb890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:22.058266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8cad44-4e16-477c-a8ba-75b806f46afb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:22.058375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ac95815-34f2-45e1-94f9-acc8a49fb890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:22.058954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ac95815-34f2-45e1-94f9-acc8a49fb890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:22.059054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8cad44-4e16-477c-a8ba-75b806f46afb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:22.059404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8cad44-4e16-477c-a8ba-75b806f46afb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:22.059537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ac95815-34f2-45e1-94f9-acc8a49fb890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:22.059857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8cad44-4e16-477c-a8ba-75b806f46afb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:22.059969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ac95815-34f2-45e1-94f9-acc8a49fb890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:22.088789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7c8cad44-4e16-477c-a8ba-75b806f46afb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044043 Aug 06 12:49:22.089024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ac95815-34f2-45e1-94f9-acc8a49fb890 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Aug 06 12:49:22.089348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 855/1701] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:22.089745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 847/1702] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:22 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:23.101852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-38a7f729-b363-44d4-b38c-3b0b7597b92f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:23.104166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-38a7f729-b363-44d4-b38c-3b0b7597b92f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:23.110424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38a7f729-b363-44d4-b38c-3b0b7597b92f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:23.111163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38a7f729-b363-44d4-b38c-3b0b7597b92f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:23.111594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38a7f729-b363-44d4-b38c-3b0b7597b92f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:23.112281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38a7f729-b363-44d4-b38c-3b0b7597b92f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:23.112753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38a7f729-b363-44d4-b38c-3b0b7597b92f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:23.113177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38a7f729-b363-44d4-b38c-3b0b7597b92f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:23.142916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-38a7f729-b363-44d4-b38c-3b0b7597b92f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Aug 06 12:49:23.143475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 856/1703] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:23.244531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-be3dce9f-15ec-4f8b-b3b1-0c31d44af578 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:23.247821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-be3dce9f-15ec-4f8b-b3b1-0c31d44af578 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:23.253744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be3dce9f-15ec-4f8b-b3b1-0c31d44af578 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:23.254159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be3dce9f-15ec-4f8b-b3b1-0c31d44af578 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:23.254584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be3dce9f-15ec-4f8b-b3b1-0c31d44af578 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:23.255260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be3dce9f-15ec-4f8b-b3b1-0c31d44af578 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:23.255702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be3dce9f-15ec-4f8b-b3b1-0c31d44af578 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:23.256118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be3dce9f-15ec-4f8b-b3b1-0c31d44af578 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:23.284546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-be3dce9f-15ec-4f8b-b3b1-0c31d44af578 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186627 Aug 06 12:49:23.285087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 848/1704] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:23 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:24.155538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c172f07d-0f28-4942-ad85-4f38171942f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:24.157689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c172f07d-0f28-4942-ad85-4f38171942f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:24.163976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c172f07d-0f28-4942-ad85-4f38171942f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:24.164484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c172f07d-0f28-4942-ad85-4f38171942f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:24.164914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c172f07d-0f28-4942-ad85-4f38171942f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:24.165586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c172f07d-0f28-4942-ad85-4f38171942f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:24.166034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c172f07d-0f28-4942-ad85-4f38171942f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:24.166446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c172f07d-0f28-4942-ad85-4f38171942f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:24.194755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c172f07d-0f28-4942-ad85-4f38171942f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043692 Aug 06 12:49:24.195281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 857/1705] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:24.295698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-700c2dbb-8d4f-4c8f-b626-49c8c0636725 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:24.297836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-700c2dbb-8d4f-4c8f-b626-49c8c0636725 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:24.304477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-700c2dbb-8d4f-4c8f-b626-49c8c0636725 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:24.304952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-700c2dbb-8d4f-4c8f-b626-49c8c0636725 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:24.305381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-700c2dbb-8d4f-4c8f-b626-49c8c0636725 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:24.306059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-700c2dbb-8d4f-4c8f-b626-49c8c0636725 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:24.306502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-700c2dbb-8d4f-4c8f-b626-49c8c0636725 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:24.306917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-700c2dbb-8d4f-4c8f-b626-49c8c0636725 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:24.335471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-700c2dbb-8d4f-4c8f-b626-49c8c0636725 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Aug 06 12:49:24.336014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 849/1706] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:24 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:25.207386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8ec3030f-dccd-4728-9db2-830381eaf842 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:25.209446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8ec3030f-dccd-4728-9db2-830381eaf842 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:25.215679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ec3030f-dccd-4728-9db2-830381eaf842 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:25.216798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ec3030f-dccd-4728-9db2-830381eaf842 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:25.217223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ec3030f-dccd-4728-9db2-830381eaf842 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:25.217897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ec3030f-dccd-4728-9db2-830381eaf842 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:25.218337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ec3030f-dccd-4728-9db2-830381eaf842 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:25.218749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ec3030f-dccd-4728-9db2-830381eaf842 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:25.247305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8ec3030f-dccd-4728-9db2-830381eaf842 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Aug 06 12:49:25.247849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 858/1707] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:25.347800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d6a6c7c-9010-41f9-8e6b-2d9852d90ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:25.349946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d6a6c7c-9010-41f9-8e6b-2d9852d90ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:25.356359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d6a6c7c-9010-41f9-8e6b-2d9852d90ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:25.356829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d6a6c7c-9010-41f9-8e6b-2d9852d90ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:25.357255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d6a6c7c-9010-41f9-8e6b-2d9852d90ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:25.357924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d6a6c7c-9010-41f9-8e6b-2d9852d90ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:25.358368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d6a6c7c-9010-41f9-8e6b-2d9852d90ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:25.358781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d6a6c7c-9010-41f9-8e6b-2d9852d90ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:25.387377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d6a6c7c-9010-41f9-8e6b-2d9852d90ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043818 Aug 06 12:49:25.388564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 850/1708] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:25 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:26.259144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-334dd840-5668-44f2-9118-5995e78bbc00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:26.261252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-334dd840-5668-44f2-9118-5995e78bbc00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:26.267556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-334dd840-5668-44f2-9118-5995e78bbc00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:26.268032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-334dd840-5668-44f2-9118-5995e78bbc00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:26.268509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-334dd840-5668-44f2-9118-5995e78bbc00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:26.269193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-334dd840-5668-44f2-9118-5995e78bbc00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:26.269640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-334dd840-5668-44f2-9118-5995e78bbc00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:26.270062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-334dd840-5668-44f2-9118-5995e78bbc00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:26.298966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-334dd840-5668-44f2-9118-5995e78bbc00 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043865 Aug 06 12:49:26.299509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 859/1709] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:26.399965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2d563809-fe1c-4a8b-a4ac-e495942b9374 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:26.402123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2d563809-fe1c-4a8b-a4ac-e495942b9374 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:26.409133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d563809-fe1c-4a8b-a4ac-e495942b9374 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:26.409607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d563809-fe1c-4a8b-a4ac-e495942b9374 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:26.410035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d563809-fe1c-4a8b-a4ac-e495942b9374 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:26.410709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d563809-fe1c-4a8b-a4ac-e495942b9374 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:26.411156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d563809-fe1c-4a8b-a4ac-e495942b9374 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:26.411574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d563809-fe1c-4a8b-a4ac-e495942b9374 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:26.439956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2d563809-fe1c-4a8b-a4ac-e495942b9374 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Aug 06 12:49:26.440526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 851/1710] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:26 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:27.310635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ce8f0108-eb74-46fc-b3fa-2c6d9f8de59d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:27.313379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ce8f0108-eb74-46fc-b3fa-2c6d9f8de59d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:27.320639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce8f0108-eb74-46fc-b3fa-2c6d9f8de59d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:27.321115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce8f0108-eb74-46fc-b3fa-2c6d9f8de59d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:27.321543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce8f0108-eb74-46fc-b3fa-2c6d9f8de59d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:27.322228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce8f0108-eb74-46fc-b3fa-2c6d9f8de59d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:27.322675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce8f0108-eb74-46fc-b3fa-2c6d9f8de59d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:27.323091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce8f0108-eb74-46fc-b3fa-2c6d9f8de59d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:27.352099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ce8f0108-eb74-46fc-b3fa-2c6d9f8de59d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045426 Aug 06 12:49:27.352677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 860/1711] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:27.452609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b279e522-9997-4f1b-861c-0021409fccc9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:27.454732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b279e522-9997-4f1b-861c-0021409fccc9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:27.461051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b279e522-9997-4f1b-861c-0021409fccc9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:27.461527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b279e522-9997-4f1b-861c-0021409fccc9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:27.461956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b279e522-9997-4f1b-861c-0021409fccc9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:27.462635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b279e522-9997-4f1b-861c-0021409fccc9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:27.463083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b279e522-9997-4f1b-861c-0021409fccc9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:27.463501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b279e522-9997-4f1b-861c-0021409fccc9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:27.492069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b279e522-9997-4f1b-861c-0021409fccc9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Aug 06 12:49:27.492637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 852/1712] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:27 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:28.364501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6974ba8c-dae2-4a03-a7e1-3cc9bab012b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:28.366661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6974ba8c-dae2-4a03-a7e1-3cc9bab012b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:28.373452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6974ba8c-dae2-4a03-a7e1-3cc9bab012b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:28.373931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6974ba8c-dae2-4a03-a7e1-3cc9bab012b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:28.374362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6974ba8c-dae2-4a03-a7e1-3cc9bab012b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:28.375040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6974ba8c-dae2-4a03-a7e1-3cc9bab012b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:28.375514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6974ba8c-dae2-4a03-a7e1-3cc9bab012b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:28.375931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6974ba8c-dae2-4a03-a7e1-3cc9bab012b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:28.406674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6974ba8c-dae2-4a03-a7e1-3cc9bab012b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046365 Aug 06 12:49:28.407230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 861/1713] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:28 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:28.504523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-25e3848d-227d-4398-a38b-3eca54abdf12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:28.506660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-25e3848d-227d-4398-a38b-3eca54abdf12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:28.513106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e3848d-227d-4398-a38b-3eca54abdf12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:28.513594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e3848d-227d-4398-a38b-3eca54abdf12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:28.514027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e3848d-227d-4398-a38b-3eca54abdf12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:28.514722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e3848d-227d-4398-a38b-3eca54abdf12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:28.515169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e3848d-227d-4398-a38b-3eca54abdf12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:28.515589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e3848d-227d-4398-a38b-3eca54abdf12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:28.545227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-25e3848d-227d-4398-a38b-3eca54abdf12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Aug 06 12:49:28.545784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 853/1714] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:28 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:29.419473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5d8c7ec9-f1c9-4918-a54c-2793d8b74b84 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:29.421624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5d8c7ec9-f1c9-4918-a54c-2793d8b74b84 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:29.428021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d8c7ec9-f1c9-4918-a54c-2793d8b74b84 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:29.428538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d8c7ec9-f1c9-4918-a54c-2793d8b74b84 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:29.428972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d8c7ec9-f1c9-4918-a54c-2793d8b74b84 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:29.429724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d8c7ec9-f1c9-4918-a54c-2793d8b74b84 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:29.430178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d8c7ec9-f1c9-4918-a54c-2793d8b74b84 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:29.430600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d8c7ec9-f1c9-4918-a54c-2793d8b74b84 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:29.459689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5d8c7ec9-f1c9-4918-a54c-2793d8b74b84 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044791 Aug 06 12:49:29.460257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 862/1715] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:29.556371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b97d837b-f7a2-4581-9d54-79003ae28293 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:29.558535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b97d837b-f7a2-4581-9d54-79003ae28293 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:29.565028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b97d837b-f7a2-4581-9d54-79003ae28293 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:29.565515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b97d837b-f7a2-4581-9d54-79003ae28293 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:29.565956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b97d837b-f7a2-4581-9d54-79003ae28293 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:29.566654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b97d837b-f7a2-4581-9d54-79003ae28293 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:29.567110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b97d837b-f7a2-4581-9d54-79003ae28293 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:29.567537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b97d837b-f7a2-4581-9d54-79003ae28293 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:29.597185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b97d837b-f7a2-4581-9d54-79003ae28293 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044716 Aug 06 12:49:29.597748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 854/1716] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:29 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:30.471761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6790753-d611-40ab-9d7a-2f66c06f2e3d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:30.473911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c6790753-d611-40ab-9d7a-2f66c06f2e3d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:30.480292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6790753-d611-40ab-9d7a-2f66c06f2e3d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:30.480794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6790753-d611-40ab-9d7a-2f66c06f2e3d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:30.481727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6790753-d611-40ab-9d7a-2f66c06f2e3d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:30.482407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6790753-d611-40ab-9d7a-2f66c06f2e3d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:30.482854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6790753-d611-40ab-9d7a-2f66c06f2e3d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:30.483275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6790753-d611-40ab-9d7a-2f66c06f2e3d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:30.511858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c6790753-d611-40ab-9d7a-2f66c06f2e3d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Aug 06 12:49:30.512485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 863/1717] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:30.609572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-420c7c01-2b57-46c6-9b38-fa4f42501fee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:30.611990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-420c7c01-2b57-46c6-9b38-fa4f42501fee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:30.618296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-420c7c01-2b57-46c6-9b38-fa4f42501fee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:30.618771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-420c7c01-2b57-46c6-9b38-fa4f42501fee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:30.619202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-420c7c01-2b57-46c6-9b38-fa4f42501fee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:30.619881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-420c7c01-2b57-46c6-9b38-fa4f42501fee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:30.620352 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-420c7c01-2b57-46c6-9b38-fa4f42501fee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:30.620775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-420c7c01-2b57-46c6-9b38-fa4f42501fee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:30.648255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-420c7c01-2b57-46c6-9b38-fa4f42501fee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043359 Aug 06 12:49:30.648832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 855/1718] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:30 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:31.522929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-57326023-aa0c-46eb-a8d6-499e8bb62558 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:31.525067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-57326023-aa0c-46eb-a8d6-499e8bb62558 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:31.531255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57326023-aa0c-46eb-a8d6-499e8bb62558 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:31.531728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57326023-aa0c-46eb-a8d6-499e8bb62558 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:31.532154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57326023-aa0c-46eb-a8d6-499e8bb62558 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:31.532861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57326023-aa0c-46eb-a8d6-499e8bb62558 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:31.533306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57326023-aa0c-46eb-a8d6-499e8bb62558 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:31.533719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57326023-aa0c-46eb-a8d6-499e8bb62558 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:31.549823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:31.563020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-57326023-aa0c-46eb-a8d6-499e8bb62558 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 Aug 06 12:49:31.563561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 864/1719] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:31.659523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6dee60e2-cc6a-41cc-b850-f6b3cec6b79d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:31.661793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6dee60e2-cc6a-41cc-b850-f6b3cec6b79d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:31.668193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6dee60e2-cc6a-41cc-b850-f6b3cec6b79d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:31.669197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6dee60e2-cc6a-41cc-b850-f6b3cec6b79d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:31.669635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6dee60e2-cc6a-41cc-b850-f6b3cec6b79d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:31.670324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6dee60e2-cc6a-41cc-b850-f6b3cec6b79d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:31.670809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6dee60e2-cc6a-41cc-b850-f6b3cec6b79d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:31.671240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6dee60e2-cc6a-41cc-b850-f6b3cec6b79d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:31.700209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6dee60e2-cc6a-41cc-b850-f6b3cec6b79d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044650 Aug 06 12:49:31.700796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 856/1720] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:31 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:32.575537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f5fdd629-5f5b-44c4-a42e-e5638303a4a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:32.577684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f5fdd629-5f5b-44c4-a42e-e5638303a4a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:32.584010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5fdd629-5f5b-44c4-a42e-e5638303a4a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:32.584522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5fdd629-5f5b-44c4-a42e-e5638303a4a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:32.584957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5fdd629-5f5b-44c4-a42e-e5638303a4a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:32.585635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5fdd629-5f5b-44c4-a42e-e5638303a4a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:32.586177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5fdd629-5f5b-44c4-a42e-e5638303a4a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:32.586602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5fdd629-5f5b-44c4-a42e-e5638303a4a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:32.615857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f5fdd629-5f5b-44c4-a42e-e5638303a4a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Aug 06 12:49:32.616424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 865/1721] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:32.712295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d690b2cc-d29e-4e23-b4bf-8022d69fdcdc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:32.714442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d690b2cc-d29e-4e23-b4bf-8022d69fdcdc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:32.721072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d690b2cc-d29e-4e23-b4bf-8022d69fdcdc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:32.721547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d690b2cc-d29e-4e23-b4bf-8022d69fdcdc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:32.721976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d690b2cc-d29e-4e23-b4bf-8022d69fdcdc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:32.722655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d690b2cc-d29e-4e23-b4bf-8022d69fdcdc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:32.723096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d690b2cc-d29e-4e23-b4bf-8022d69fdcdc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:32.723527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d690b2cc-d29e-4e23-b4bf-8022d69fdcdc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:32.753464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d690b2cc-d29e-4e23-b4bf-8022d69fdcdc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045105 Aug 06 12:49:32.754013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 857/1722] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:32 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:33.627516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2efe5dca-7fa1-41ef-a55a-4aa0c63ef25f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:33.629679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2efe5dca-7fa1-41ef-a55a-4aa0c63ef25f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:33.636202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2efe5dca-7fa1-41ef-a55a-4aa0c63ef25f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:33.636717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2efe5dca-7fa1-41ef-a55a-4aa0c63ef25f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:33.637292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2efe5dca-7fa1-41ef-a55a-4aa0c63ef25f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:33.638602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2efe5dca-7fa1-41ef-a55a-4aa0c63ef25f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:33.639056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2efe5dca-7fa1-41ef-a55a-4aa0c63ef25f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:33.639506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2efe5dca-7fa1-41ef-a55a-4aa0c63ef25f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:33.667858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2efe5dca-7fa1-41ef-a55a-4aa0c63ef25f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Aug 06 12:49:33.668438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 866/1723] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:33.765998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-280483bd-e5de-47b4-8cdc-79cdfd966b9c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:33.768138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-280483bd-e5de-47b4-8cdc-79cdfd966b9c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:33.774535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280483bd-e5de-47b4-8cdc-79cdfd966b9c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:33.774535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280483bd-e5de-47b4-8cdc-79cdfd966b9c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:33.774938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280483bd-e5de-47b4-8cdc-79cdfd966b9c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:33.776105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280483bd-e5de-47b4-8cdc-79cdfd966b9c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:33.776738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280483bd-e5de-47b4-8cdc-79cdfd966b9c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:33.777158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280483bd-e5de-47b4-8cdc-79cdfd966b9c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:33.806355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-280483bd-e5de-47b4-8cdc-79cdfd966b9c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Aug 06 12:49:33.806919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 858/1724] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:33 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:34.680170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d81a4afc-d4a8-46ed-af8e-9f7e3755ae02 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:34.682250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d81a4afc-d4a8-46ed-af8e-9f7e3755ae02 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:34.688604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81a4afc-d4a8-46ed-af8e-9f7e3755ae02 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:34.689084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81a4afc-d4a8-46ed-af8e-9f7e3755ae02 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:34.689522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81a4afc-d4a8-46ed-af8e-9f7e3755ae02 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:34.690206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81a4afc-d4a8-46ed-af8e-9f7e3755ae02 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:34.690657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81a4afc-d4a8-46ed-af8e-9f7e3755ae02 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:34.691082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81a4afc-d4a8-46ed-af8e-9f7e3755ae02 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:34.720027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d81a4afc-d4a8-46ed-af8e-9f7e3755ae02 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 Aug 06 12:49:34.720591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 867/1725] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:34.818510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d551a4e-c5a1-4f84-bdad-76579d3e13c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:34.820828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d551a4e-c5a1-4f84-bdad-76579d3e13c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:34.827822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d551a4e-c5a1-4f84-bdad-76579d3e13c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:34.828461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d551a4e-c5a1-4f84-bdad-76579d3e13c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:34.828895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d551a4e-c5a1-4f84-bdad-76579d3e13c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:34.829617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d551a4e-c5a1-4f84-bdad-76579d3e13c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:34.830064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d551a4e-c5a1-4f84-bdad-76579d3e13c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:34.830482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d551a4e-c5a1-4f84-bdad-76579d3e13c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:34.859001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d551a4e-c5a1-4f84-bdad-76579d3e13c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Aug 06 12:49:34.859553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 859/1726] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:34 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:35.731675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4874f184-c3e0-4ad8-91b1-ab1bea3fda4b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:35.733807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4874f184-c3e0-4ad8-91b1-ab1bea3fda4b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:35.740368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4874f184-c3e0-4ad8-91b1-ab1bea3fda4b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:35.740843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4874f184-c3e0-4ad8-91b1-ab1bea3fda4b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:35.741271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4874f184-c3e0-4ad8-91b1-ab1bea3fda4b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:35.741944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4874f184-c3e0-4ad8-91b1-ab1bea3fda4b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:35.742396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4874f184-c3e0-4ad8-91b1-ab1bea3fda4b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:35.742809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4874f184-c3e0-4ad8-91b1-ab1bea3fda4b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:35.770913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4874f184-c3e0-4ad8-91b1-ab1bea3fda4b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 Aug 06 12:49:35.771446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 868/1727] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:35 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:35.870472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bf32219b-9215-49b2-a294-b8b37fbf685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:35.873113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bf32219b-9215-49b2-a294-b8b37fbf685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:35.879382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf32219b-9215-49b2-a294-b8b37fbf685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:35.879839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf32219b-9215-49b2-a294-b8b37fbf685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:35.880265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf32219b-9215-49b2-a294-b8b37fbf685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:35.880963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf32219b-9215-49b2-a294-b8b37fbf685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:35.881413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf32219b-9215-49b2-a294-b8b37fbf685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:35.881830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf32219b-9215-49b2-a294-b8b37fbf685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:35.906127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:35.911160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bf32219b-9215-49b2-a294-b8b37fbf685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Aug 06 12:49:35.911702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 860/1728] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:35 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:36.783416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-11ca202d-9ffd-4d91-a746-9d9a841b46fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:36.785568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-11ca202d-9ffd-4d91-a746-9d9a841b46fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:36.791854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11ca202d-9ffd-4d91-a746-9d9a841b46fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:36.792353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11ca202d-9ffd-4d91-a746-9d9a841b46fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:36.792789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11ca202d-9ffd-4d91-a746-9d9a841b46fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:36.793465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11ca202d-9ffd-4d91-a746-9d9a841b46fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:36.794548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11ca202d-9ffd-4d91-a746-9d9a841b46fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:36.794969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11ca202d-9ffd-4d91-a746-9d9a841b46fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:36.822609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-11ca202d-9ffd-4d91-a746-9d9a841b46fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043112 Aug 06 12:49:36.823145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 869/1729] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:36.923136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16a75ffd-139e-4b40-8768-91970fb4738f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:36.925319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16a75ffd-139e-4b40-8768-91970fb4738f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:36.931780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16a75ffd-139e-4b40-8768-91970fb4738f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:36.932263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16a75ffd-139e-4b40-8768-91970fb4738f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:36.932735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16a75ffd-139e-4b40-8768-91970fb4738f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:36.933431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16a75ffd-139e-4b40-8768-91970fb4738f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:36.933877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16a75ffd-139e-4b40-8768-91970fb4738f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:36.934301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16a75ffd-139e-4b40-8768-91970fb4738f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:36.967910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16a75ffd-139e-4b40-8768-91970fb4738f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048728 Aug 06 12:49:36.968498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 861/1730] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:36 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:37.834908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-edee10b9-2112-409a-977c-e4f3bff32fa9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:37.837038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-edee10b9-2112-409a-977c-e4f3bff32fa9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:37.843327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edee10b9-2112-409a-977c-e4f3bff32fa9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:37.843804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edee10b9-2112-409a-977c-e4f3bff32fa9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:37.844235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edee10b9-2112-409a-977c-e4f3bff32fa9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:37.844939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edee10b9-2112-409a-977c-e4f3bff32fa9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:37.845385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edee10b9-2112-409a-977c-e4f3bff32fa9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:37.845802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edee10b9-2112-409a-977c-e4f3bff32fa9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:37.875980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-edee10b9-2112-409a-977c-e4f3bff32fa9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044978 Aug 06 12:49:37.876561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 870/1731] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:37 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:37.979812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4bdf2e5c-8804-4567-967f-a7e56258620a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:37.982469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4bdf2e5c-8804-4567-967f-a7e56258620a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:37.989009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e5c-8804-4567-967f-a7e56258620a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:37.989483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e5c-8804-4567-967f-a7e56258620a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:37.989911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e5c-8804-4567-967f-a7e56258620a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:37.990596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e5c-8804-4567-967f-a7e56258620a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:37.991073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e5c-8804-4567-967f-a7e56258620a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:37.991491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e5c-8804-4567-967f-a7e56258620a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:38.020411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4bdf2e5c-8804-4567-967f-a7e56258620a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Aug 06 12:49:38.020959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 862/1732] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:37 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:38.887455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a47220c-653d-4111-a403-104ad48bd8b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:38.890123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0a47220c-653d-4111-a403-104ad48bd8b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:38.896444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a47220c-653d-4111-a403-104ad48bd8b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:38.896916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a47220c-653d-4111-a403-104ad48bd8b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:38.897341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a47220c-653d-4111-a403-104ad48bd8b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:38.898007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a47220c-653d-4111-a403-104ad48bd8b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:38.898450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a47220c-653d-4111-a403-104ad48bd8b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:38.898863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a47220c-653d-4111-a403-104ad48bd8b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:38.926312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0a47220c-653d-4111-a403-104ad48bd8b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042885 Aug 06 12:49:38.926841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 871/1733] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:39.032523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3e92b7f0-8493-4faf-b40c-e1a035970a9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:39.034681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3e92b7f0-8493-4faf-b40c-e1a035970a9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:39.041007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e92b7f0-8493-4faf-b40c-e1a035970a9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:39.041485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e92b7f0-8493-4faf-b40c-e1a035970a9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:39.041920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e92b7f0-8493-4faf-b40c-e1a035970a9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:39.042603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e92b7f0-8493-4faf-b40c-e1a035970a9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:39.043053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e92b7f0-8493-4faf-b40c-e1a035970a9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:39.043478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e92b7f0-8493-4faf-b40c-e1a035970a9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:39.072017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3e92b7f0-8493-4faf-b40c-e1a035970a9e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043460 Aug 06 12:49:39.072596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 863/1734] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:39 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:39.938638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d998e9db-a688-4c52-90f4-12cb97decde4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:39.940809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d998e9db-a688-4c52-90f4-12cb97decde4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:39.947052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d998e9db-a688-4c52-90f4-12cb97decde4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:39.947521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d998e9db-a688-4c52-90f4-12cb97decde4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:39.947949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d998e9db-a688-4c52-90f4-12cb97decde4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:39.948656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d998e9db-a688-4c52-90f4-12cb97decde4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:39.949097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d998e9db-a688-4c52-90f4-12cb97decde4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:39.949508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d998e9db-a688-4c52-90f4-12cb97decde4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:39.978251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d998e9db-a688-4c52-90f4-12cb97decde4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043541 Aug 06 12:49:39.978798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 872/1735] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:40.085008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9b6a572c-5e5c-473e-af50-397bf122c528 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:40.087135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9b6a572c-5e5c-473e-af50-397bf122c528 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:40.094236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b6a572c-5e5c-473e-af50-397bf122c528 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:40.094716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b6a572c-5e5c-473e-af50-397bf122c528 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:40.095149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b6a572c-5e5c-473e-af50-397bf122c528 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:40.095834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b6a572c-5e5c-473e-af50-397bf122c528 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:40.096283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b6a572c-5e5c-473e-af50-397bf122c528 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:40.096724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b6a572c-5e5c-473e-af50-397bf122c528 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:40.124762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9b6a572c-5e5c-473e-af50-397bf122c528 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043648 Aug 06 12:49:40.125319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 864/1736] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:40 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:40.990772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d313ceba-90a1-4d6c-9a6b-d3f0150acd78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:40.992848 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d313ceba-90a1-4d6c-9a6b-d3f0150acd78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:41.000194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313ceba-90a1-4d6c-9a6b-d3f0150acd78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:41.000468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313ceba-90a1-4d6c-9a6b-d3f0150acd78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:41.000903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313ceba-90a1-4d6c-9a6b-d3f0150acd78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:41.001591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313ceba-90a1-4d6c-9a6b-d3f0150acd78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:41.002036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313ceba-90a1-4d6c-9a6b-d3f0150acd78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:41.002455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d313ceba-90a1-4d6c-9a6b-d3f0150acd78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:41.031097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d313ceba-90a1-4d6c-9a6b-d3f0150acd78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044379 Aug 06 12:49:41.031641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 873/1737] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:41.136942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-99571301-8646-4582-89ae-402978be39fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:41.139063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-99571301-8646-4582-89ae-402978be39fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:41.145721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99571301-8646-4582-89ae-402978be39fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:41.146198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99571301-8646-4582-89ae-402978be39fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:41.146729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99571301-8646-4582-89ae-402978be39fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:41.147419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99571301-8646-4582-89ae-402978be39fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:41.147874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99571301-8646-4582-89ae-402978be39fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:41.148290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99571301-8646-4582-89ae-402978be39fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:41.177854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-99571301-8646-4582-89ae-402978be39fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044869 Aug 06 12:49:41.178612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 865/1738] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:41 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:42.043216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a634c6ac-429d-48c5-8cd9-1e4f14682081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:42.045540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a634c6ac-429d-48c5-8cd9-1e4f14682081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:42.052015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a634c6ac-429d-48c5-8cd9-1e4f14682081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:42.052528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a634c6ac-429d-48c5-8cd9-1e4f14682081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:42.052964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a634c6ac-429d-48c5-8cd9-1e4f14682081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:42.053645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a634c6ac-429d-48c5-8cd9-1e4f14682081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:42.054094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a634c6ac-429d-48c5-8cd9-1e4f14682081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:42.054513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a634c6ac-429d-48c5-8cd9-1e4f14682081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:42.083613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a634c6ac-429d-48c5-8cd9-1e4f14682081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Aug 06 12:49:42.084160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 874/1739] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:42 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:42.190711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bebcc331-e1aa-4034-8777-ec0e8a673073 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:42.192914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bebcc331-e1aa-4034-8777-ec0e8a673073 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:42.199271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bebcc331-e1aa-4034-8777-ec0e8a673073 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:42.199772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bebcc331-e1aa-4034-8777-ec0e8a673073 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:42.200201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bebcc331-e1aa-4034-8777-ec0e8a673073 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:42.201354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bebcc331-e1aa-4034-8777-ec0e8a673073 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:42.202123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bebcc331-e1aa-4034-8777-ec0e8a673073 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:42.202701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bebcc331-e1aa-4034-8777-ec0e8a673073 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:42.241062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bebcc331-e1aa-4034-8777-ec0e8a673073 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054083 Aug 06 12:49:42.241898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 866/1740] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:42 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:49:43.096342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ca9d8157-892c-4429-b3ff-233385f580fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:43.098396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ca9d8157-892c-4429-b3ff-233385f580fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:43.104751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca9d8157-892c-4429-b3ff-233385f580fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:43.105225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca9d8157-892c-4429-b3ff-233385f580fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:43.105650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca9d8157-892c-4429-b3ff-233385f580fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:43.106322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca9d8157-892c-4429-b3ff-233385f580fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:43.106766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca9d8157-892c-4429-b3ff-233385f580fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:43.107182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca9d8157-892c-4429-b3ff-233385f580fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:43.134906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ca9d8157-892c-4429-b3ff-233385f580fe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042593 Aug 06 12:49:43.135444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 875/1741] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:43.253443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-20a6d61b-faaa-4e10-a1f4-d5d8052ef264 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:43.255585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-20a6d61b-faaa-4e10-a1f4-d5d8052ef264 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:43.261925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20a6d61b-faaa-4e10-a1f4-d5d8052ef264 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:43.262398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20a6d61b-faaa-4e10-a1f4-d5d8052ef264 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:43.263329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20a6d61b-faaa-4e10-a1f4-d5d8052ef264 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:43.264004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20a6d61b-faaa-4e10-a1f4-d5d8052ef264 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:43.264485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20a6d61b-faaa-4e10-a1f4-d5d8052ef264 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:43.264899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20a6d61b-faaa-4e10-a1f4-d5d8052ef264 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:43.293520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-20a6d61b-faaa-4e10-a1f4-d5d8052ef264 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043960 Aug 06 12:49:43.294100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 867/1742] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:43 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:44.147488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d3507fa2-528a-402f-8de8-3ad690bf26c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:44.149646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d3507fa2-528a-402f-8de8-3ad690bf26c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:44.156502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3507fa2-528a-402f-8de8-3ad690bf26c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:44.156985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3507fa2-528a-402f-8de8-3ad690bf26c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:44.157420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3507fa2-528a-402f-8de8-3ad690bf26c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:44.158104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3507fa2-528a-402f-8de8-3ad690bf26c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:44.158556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3507fa2-528a-402f-8de8-3ad690bf26c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:44.158980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3507fa2-528a-402f-8de8-3ad690bf26c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:44.187462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d3507fa2-528a-402f-8de8-3ad690bf26c9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043975 Aug 06 12:49:44.188011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 876/1743] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:44.305777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5ed7f865-a77d-4bf4-ba7b-a63b8f9258a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:44.307965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5ed7f865-a77d-4bf4-ba7b-a63b8f9258a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:44.314403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ed7f865-a77d-4bf4-ba7b-a63b8f9258a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:44.314886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ed7f865-a77d-4bf4-ba7b-a63b8f9258a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:44.315319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ed7f865-a77d-4bf4-ba7b-a63b8f9258a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:44.316032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ed7f865-a77d-4bf4-ba7b-a63b8f9258a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:44.316536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ed7f865-a77d-4bf4-ba7b-a63b8f9258a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:44.316955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ed7f865-a77d-4bf4-ba7b-a63b8f9258a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:44.345117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5ed7f865-a77d-4bf4-ba7b-a63b8f9258a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043362 Aug 06 12:49:44.345654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 868/1744] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:44 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:45.199250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-73de7e97-d2c1-4369-8231-8a10a7e22d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:45.201322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-73de7e97-d2c1-4369-8231-8a10a7e22d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:45.207597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73de7e97-d2c1-4369-8231-8a10a7e22d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:45.208071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73de7e97-d2c1-4369-8231-8a10a7e22d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:45.208560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73de7e97-d2c1-4369-8231-8a10a7e22d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:45.209240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73de7e97-d2c1-4369-8231-8a10a7e22d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:45.209686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73de7e97-d2c1-4369-8231-8a10a7e22d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:45.210104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73de7e97-d2c1-4369-8231-8a10a7e22d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:45.238751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-73de7e97-d2c1-4369-8231-8a10a7e22d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043575 Aug 06 12:49:45.239292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 877/1745] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:45.356671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ab3d229c-b5aa-4a67-afbe-33ac81b8f191 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:45.359365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ab3d229c-b5aa-4a67-afbe-33ac81b8f191 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:45.365910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab3d229c-b5aa-4a67-afbe-33ac81b8f191 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:45.366385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab3d229c-b5aa-4a67-afbe-33ac81b8f191 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:45.366815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab3d229c-b5aa-4a67-afbe-33ac81b8f191 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:45.367495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab3d229c-b5aa-4a67-afbe-33ac81b8f191 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:45.367938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab3d229c-b5aa-4a67-afbe-33ac81b8f191 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:45.368380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab3d229c-b5aa-4a67-afbe-33ac81b8f191 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:45.397380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ab3d229c-b5aa-4a67-afbe-33ac81b8f191 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Aug 06 12:49:45.397923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 869/1746] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:45 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:46.251886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-45dc962f-5e77-446d-9bd9-5b11ef37e782 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:46.254005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-45dc962f-5e77-446d-9bd9-5b11ef37e782 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:46.259874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45dc962f-5e77-446d-9bd9-5b11ef37e782 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:46.260370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45dc962f-5e77-446d-9bd9-5b11ef37e782 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:46.260800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45dc962f-5e77-446d-9bd9-5b11ef37e782 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:46.261471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45dc962f-5e77-446d-9bd9-5b11ef37e782 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:46.261916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45dc962f-5e77-446d-9bd9-5b11ef37e782 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:46.262327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45dc962f-5e77-446d-9bd9-5b11ef37e782 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:46.290521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-45dc962f-5e77-446d-9bd9-5b11ef37e782 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043593 Aug 06 12:49:46.291062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 878/1747] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:46.409771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-010b9f14-87db-4029-bc29-37c1d1a93cf9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:46.411876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-010b9f14-87db-4029-bc29-37c1d1a93cf9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:46.418289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-010b9f14-87db-4029-bc29-37c1d1a93cf9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:46.418764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-010b9f14-87db-4029-bc29-37c1d1a93cf9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:46.419197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-010b9f14-87db-4029-bc29-37c1d1a93cf9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:46.419877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-010b9f14-87db-4029-bc29-37c1d1a93cf9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:46.420336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-010b9f14-87db-4029-bc29-37c1d1a93cf9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:46.420774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-010b9f14-87db-4029-bc29-37c1d1a93cf9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:46.455574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-010b9f14-87db-4029-bc29-37c1d1a93cf9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049938 Aug 06 12:49:46.456420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 870/1748] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:46 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:47.302588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5ba5585d-d331-4a3c-bc70-45532e345a06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:47.304753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5ba5585d-d331-4a3c-bc70-45532e345a06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:47.307019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=58 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:47.312773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ba5585d-d331-4a3c-bc70-45532e345a06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:47.313251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ba5585d-d331-4a3c-bc70-45532e345a06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:47.313682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ba5585d-d331-4a3c-bc70-45532e345a06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:47.314365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ba5585d-d331-4a3c-bc70-45532e345a06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:47.314811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ba5585d-d331-4a3c-bc70-45532e345a06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:47.315231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ba5585d-d331-4a3c-bc70-45532e345a06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:47.344877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5ba5585d-d331-4a3c-bc70-45532e345a06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 Aug 06 12:49:47.345439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 879/1749] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:47.468082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38a53d2e-5e33-4214-b7d2-07b15a1aad31 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:47.470375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38a53d2e-5e33-4214-b7d2-07b15a1aad31 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:47.472682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=58 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:47.478406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38a53d2e-5e33-4214-b7d2-07b15a1aad31 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:47.478882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38a53d2e-5e33-4214-b7d2-07b15a1aad31 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:47.479310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38a53d2e-5e33-4214-b7d2-07b15a1aad31 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:47.479997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38a53d2e-5e33-4214-b7d2-07b15a1aad31 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:47.480468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38a53d2e-5e33-4214-b7d2-07b15a1aad31 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:47.480886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38a53d2e-5e33-4214-b7d2-07b15a1aad31 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:47.511302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38a53d2e-5e33-4214-b7d2-07b15a1aad31 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047342 Aug 06 12:49:47.511846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 871/1750] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:47 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:48.356625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c07e590b-46ef-4735-83f6-84a18bf3aa3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:48.358718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c07e590b-46ef-4735-83f6-84a18bf3aa3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:48.365438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c07e590b-46ef-4735-83f6-84a18bf3aa3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:48.365913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c07e590b-46ef-4735-83f6-84a18bf3aa3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:48.366340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c07e590b-46ef-4735-83f6-84a18bf3aa3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:48.367020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c07e590b-46ef-4735-83f6-84a18bf3aa3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:48.367468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c07e590b-46ef-4735-83f6-84a18bf3aa3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:48.367885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c07e590b-46ef-4735-83f6-84a18bf3aa3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:48.396668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c07e590b-46ef-4735-83f6-84a18bf3aa3e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043959 Aug 06 12:49:48.397210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 880/1751] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:48.523414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-764cd726-1888-4812-a9f0-980a93de7e21 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:48.525563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-764cd726-1888-4812-a9f0-980a93de7e21 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:48.531788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-764cd726-1888-4812-a9f0-980a93de7e21 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:48.532261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-764cd726-1888-4812-a9f0-980a93de7e21 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:48.532720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-764cd726-1888-4812-a9f0-980a93de7e21 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:48.533394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-764cd726-1888-4812-a9f0-980a93de7e21 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:48.533840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-764cd726-1888-4812-a9f0-980a93de7e21 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:48.534254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-764cd726-1888-4812-a9f0-980a93de7e21 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:48.562259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-764cd726-1888-4812-a9f0-980a93de7e21 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042343 Aug 06 12:49:48.562792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 872/1752] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:48 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:49.409496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4ce6657-9017-444d-9422-8ff9b4e2a0ee tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:49.411519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c4ce6657-9017-444d-9422-8ff9b4e2a0ee tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:49.417850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ce6657-9017-444d-9422-8ff9b4e2a0ee tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:49.418322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ce6657-9017-444d-9422-8ff9b4e2a0ee tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:49.418752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ce6657-9017-444d-9422-8ff9b4e2a0ee tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:49.419429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ce6657-9017-444d-9422-8ff9b4e2a0ee tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:49.419878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ce6657-9017-444d-9422-8ff9b4e2a0ee tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:49.420347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4ce6657-9017-444d-9422-8ff9b4e2a0ee tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:49.424614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:49.449164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c4ce6657-9017-444d-9422-8ff9b4e2a0ee tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Aug 06 12:49:49.449730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 881/1753] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:49.574301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-661f4a3d-7626-453b-9f9c-8a0fa2497bca tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:49.576440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-661f4a3d-7626-453b-9f9c-8a0fa2497bca tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:49.583225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-661f4a3d-7626-453b-9f9c-8a0fa2497bca tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:49.583704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-661f4a3d-7626-453b-9f9c-8a0fa2497bca tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:49.584130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-661f4a3d-7626-453b-9f9c-8a0fa2497bca tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:49.584839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-661f4a3d-7626-453b-9f9c-8a0fa2497bca tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:49.585285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-661f4a3d-7626-453b-9f9c-8a0fa2497bca tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:49.585704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-661f4a3d-7626-453b-9f9c-8a0fa2497bca tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:49.614063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-661f4a3d-7626-453b-9f9c-8a0fa2497bca tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Aug 06 12:49:49.614590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 873/1754] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:49 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:50.461345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8f1b8f53-f887-499f-be7e-4bcce3a6faba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:50.463450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8f1b8f53-f887-499f-be7e-4bcce3a6faba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:50.470614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1b8f53-f887-499f-be7e-4bcce3a6faba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:50.471089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1b8f53-f887-499f-be7e-4bcce3a6faba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:50.471522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1b8f53-f887-499f-be7e-4bcce3a6faba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:50.472221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1b8f53-f887-499f-be7e-4bcce3a6faba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:50.472677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1b8f53-f887-499f-be7e-4bcce3a6faba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:50.473097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1b8f53-f887-499f-be7e-4bcce3a6faba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:50.501820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8f1b8f53-f887-499f-be7e-4bcce3a6faba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 Aug 06 12:49:50.502365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 882/1755] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:50.626992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e651989-2ef8-4c07-bb65-a1fa57c9bf3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:50.629119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e651989-2ef8-4c07-bb65-a1fa57c9bf3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:50.635500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e651989-2ef8-4c07-bb65-a1fa57c9bf3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:50.635970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e651989-2ef8-4c07-bb65-a1fa57c9bf3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:50.636533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e651989-2ef8-4c07-bb65-a1fa57c9bf3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:50.637220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e651989-2ef8-4c07-bb65-a1fa57c9bf3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:50.637666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e651989-2ef8-4c07-bb65-a1fa57c9bf3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:50.638084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e651989-2ef8-4c07-bb65-a1fa57c9bf3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:50.665546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e651989-2ef8-4c07-bb65-a1fa57c9bf3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043116 Aug 06 12:49:50.666077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 874/1756] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:50 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:51.514087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8e996898-f78c-4d82-a6c9-1b87cfc151c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:51.516226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8e996898-f78c-4d82-a6c9-1b87cfc151c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:51.522619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e996898-f78c-4d82-a6c9-1b87cfc151c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:51.523098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e996898-f78c-4d82-a6c9-1b87cfc151c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:51.523530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e996898-f78c-4d82-a6c9-1b87cfc151c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:51.524209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e996898-f78c-4d82-a6c9-1b87cfc151c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:51.524684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e996898-f78c-4d82-a6c9-1b87cfc151c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:51.525102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e996898-f78c-4d82-a6c9-1b87cfc151c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:51.554097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8e996898-f78c-4d82-a6c9-1b87cfc151c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Aug 06 12:49:51.554637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 883/1757] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:51.677585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2fca2ba0-2283-4de7-9787-29f4a2791f02 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:51.679740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2fca2ba0-2283-4de7-9787-29f4a2791f02 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:51.686086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fca2ba0-2283-4de7-9787-29f4a2791f02 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:51.686568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fca2ba0-2283-4de7-9787-29f4a2791f02 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:51.687001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fca2ba0-2283-4de7-9787-29f4a2791f02 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:51.687684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fca2ba0-2283-4de7-9787-29f4a2791f02 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:51.688136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fca2ba0-2283-4de7-9787-29f4a2791f02 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:51.688587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fca2ba0-2283-4de7-9787-29f4a2791f02 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:51.716361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2fca2ba0-2283-4de7-9787-29f4a2791f02 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 Aug 06 12:49:51.717106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 875/1758] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:51 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:52.566734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a03532ff-d437-4428-9635-f2a0cd323b73 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:52.568904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a03532ff-d437-4428-9635-f2a0cd323b73 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:52.575134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a03532ff-d437-4428-9635-f2a0cd323b73 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:52.575606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a03532ff-d437-4428-9635-f2a0cd323b73 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:52.576053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a03532ff-d437-4428-9635-f2a0cd323b73 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:52.576750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a03532ff-d437-4428-9635-f2a0cd323b73 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:52.577194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a03532ff-d437-4428-9635-f2a0cd323b73 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:52.578236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a03532ff-d437-4428-9635-f2a0cd323b73 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:52.605850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a03532ff-d437-4428-9635-f2a0cd323b73 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043074 Aug 06 12:49:52.606379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 884/1759] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:52.728891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a1bf5627-266f-4bf6-a7f5-ac8690b08d5e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:52.731014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a1bf5627-266f-4bf6-a7f5-ac8690b08d5e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:52.738085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1bf5627-266f-4bf6-a7f5-ac8690b08d5e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:52.738565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1bf5627-266f-4bf6-a7f5-ac8690b08d5e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:52.739001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1bf5627-266f-4bf6-a7f5-ac8690b08d5e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:52.739685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1bf5627-266f-4bf6-a7f5-ac8690b08d5e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:52.740136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1bf5627-266f-4bf6-a7f5-ac8690b08d5e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:52.740585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1bf5627-266f-4bf6-a7f5-ac8690b08d5e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:52.768904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a1bf5627-266f-4bf6-a7f5-ac8690b08d5e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Aug 06 12:49:52.769440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 876/1760] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:52 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:53.618460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8d47b0e6-88e2-4b3f-86a8-1c9a5e6c8ba2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:53.620614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8d47b0e6-88e2-4b3f-86a8-1c9a5e6c8ba2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:53.627822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d47b0e6-88e2-4b3f-86a8-1c9a5e6c8ba2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:53.628293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d47b0e6-88e2-4b3f-86a8-1c9a5e6c8ba2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:53.628746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d47b0e6-88e2-4b3f-86a8-1c9a5e6c8ba2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:53.629415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d47b0e6-88e2-4b3f-86a8-1c9a5e6c8ba2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:53.629855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d47b0e6-88e2-4b3f-86a8-1c9a5e6c8ba2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:53.630266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d47b0e6-88e2-4b3f-86a8-1c9a5e6c8ba2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:53.657620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8d47b0e6-88e2-4b3f-86a8-1c9a5e6c8ba2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Aug 06 12:49:53.658158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 885/1761] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:53.781872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dfb37235-eff7-4a2c-8243-39c6db78976e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:53.784249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dfb37235-eff7-4a2c-8243-39c6db78976e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:53.790521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb37235-eff7-4a2c-8243-39c6db78976e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:53.790991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb37235-eff7-4a2c-8243-39c6db78976e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:53.791420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb37235-eff7-4a2c-8243-39c6db78976e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:53.792095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb37235-eff7-4a2c-8243-39c6db78976e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:53.792578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb37235-eff7-4a2c-8243-39c6db78976e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:53.792994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb37235-eff7-4a2c-8243-39c6db78976e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:53.810167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:49:53.823398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dfb37235-eff7-4a2c-8243-39c6db78976e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046389 Aug 06 12:49:53.823946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 877/1762] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:53 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:54.670066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a077f11-29fe-42ab-a4f2-ff68401feb58 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:54.672836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0a077f11-29fe-42ab-a4f2-ff68401feb58 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:54.679192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a077f11-29fe-42ab-a4f2-ff68401feb58 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:54.679672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a077f11-29fe-42ab-a4f2-ff68401feb58 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:54.680105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a077f11-29fe-42ab-a4f2-ff68401feb58 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:54.680824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a077f11-29fe-42ab-a4f2-ff68401feb58 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:54.681277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a077f11-29fe-42ab-a4f2-ff68401feb58 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:54.681705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a077f11-29fe-42ab-a4f2-ff68401feb58 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:54.709463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0a077f11-29fe-42ab-a4f2-ff68401feb58 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043419 Aug 06 12:49:54.710007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 886/1763] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:54.835064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4e9b9e69-5ae9-4261-8cb8-6912c976f140 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:54.837242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4e9b9e69-5ae9-4261-8cb8-6912c976f140 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:54.844486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e9b9e69-5ae9-4261-8cb8-6912c976f140 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:54.844963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e9b9e69-5ae9-4261-8cb8-6912c976f140 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:54.845394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e9b9e69-5ae9-4261-8cb8-6912c976f140 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:54.846072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e9b9e69-5ae9-4261-8cb8-6912c976f140 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:54.846516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e9b9e69-5ae9-4261-8cb8-6912c976f140 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:54.846935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e9b9e69-5ae9-4261-8cb8-6912c976f140 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:54.874905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4e9b9e69-5ae9-4261-8cb8-6912c976f140 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Aug 06 12:49:54.875442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 878/1764] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:54 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:55.721337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cc955c69-5da8-409b-8339-046ab4e89e0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:55.723409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cc955c69-5da8-409b-8339-046ab4e89e0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:55.729696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc955c69-5da8-409b-8339-046ab4e89e0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:55.730166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc955c69-5da8-409b-8339-046ab4e89e0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:55.730592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc955c69-5da8-409b-8339-046ab4e89e0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:55.731263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc955c69-5da8-409b-8339-046ab4e89e0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:55.731704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc955c69-5da8-409b-8339-046ab4e89e0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:55.732117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc955c69-5da8-409b-8339-046ab4e89e0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:55.760236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cc955c69-5da8-409b-8339-046ab4e89e0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Aug 06 12:49:55.760796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 887/1765] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:55.887298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-78be3b99-ae2f-45a5-9062-c38e147c71c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:55.889464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-78be3b99-ae2f-45a5-9062-c38e147c71c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:55.896441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78be3b99-ae2f-45a5-9062-c38e147c71c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:55.896925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78be3b99-ae2f-45a5-9062-c38e147c71c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:55.897359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78be3b99-ae2f-45a5-9062-c38e147c71c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:55.898044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78be3b99-ae2f-45a5-9062-c38e147c71c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:55.898494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78be3b99-ae2f-45a5-9062-c38e147c71c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:55.898916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78be3b99-ae2f-45a5-9062-c38e147c71c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:55.926686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-78be3b99-ae2f-45a5-9062-c38e147c71c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043314 Aug 06 12:49:55.927225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 879/1766] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:55 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:56.772777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-626e1ee8-6a6d-4733-a83f-179867e7340f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:56.774857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-626e1ee8-6a6d-4733-a83f-179867e7340f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:56.781890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-626e1ee8-6a6d-4733-a83f-179867e7340f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:56.782383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-626e1ee8-6a6d-4733-a83f-179867e7340f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:56.782818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-626e1ee8-6a6d-4733-a83f-179867e7340f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:56.783504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-626e1ee8-6a6d-4733-a83f-179867e7340f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:56.783956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-626e1ee8-6a6d-4733-a83f-179867e7340f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:56.784409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-626e1ee8-6a6d-4733-a83f-179867e7340f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:56.812053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-626e1ee8-6a6d-4733-a83f-179867e7340f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Aug 06 12:49:56.812653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 888/1767] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:56.938838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a305fa16-59c3-4840-a447-dd4361f2233f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:56.941058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a305fa16-59c3-4840-a447-dd4361f2233f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:56.947326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a305fa16-59c3-4840-a447-dd4361f2233f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:56.947804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a305fa16-59c3-4840-a447-dd4361f2233f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:56.948240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a305fa16-59c3-4840-a447-dd4361f2233f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:56.948958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a305fa16-59c3-4840-a447-dd4361f2233f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:56.949410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a305fa16-59c3-4840-a447-dd4361f2233f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:56.949863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a305fa16-59c3-4840-a447-dd4361f2233f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:56.979321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a305fa16-59c3-4840-a447-dd4361f2233f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044497 Aug 06 12:49:56.979865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 880/1768] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:56 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:57.824239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-36319e40-f973-4e52-a0e0-e52ae0c89e10 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:57.826341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-36319e40-f973-4e52-a0e0-e52ae0c89e10 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:57.832683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36319e40-f973-4e52-a0e0-e52ae0c89e10 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:57.833161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36319e40-f973-4e52-a0e0-e52ae0c89e10 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:57.833600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36319e40-f973-4e52-a0e0-e52ae0c89e10 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:57.834284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36319e40-f973-4e52-a0e0-e52ae0c89e10 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:57.834732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36319e40-f973-4e52-a0e0-e52ae0c89e10 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:57.835154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36319e40-f973-4e52-a0e0-e52ae0c89e10 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:57.863606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-36319e40-f973-4e52-a0e0-e52ae0c89e10 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043405 Aug 06 12:49:57.864149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 889/1769] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:57.991864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2b3eca53-164c-4d13-8e07-9cfc10ec76fc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:57.994422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2b3eca53-164c-4d13-8e07-9cfc10ec76fc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:58.001504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b3eca53-164c-4d13-8e07-9cfc10ec76fc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:58.001978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b3eca53-164c-4d13-8e07-9cfc10ec76fc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:58.002402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b3eca53-164c-4d13-8e07-9cfc10ec76fc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:58.003085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b3eca53-164c-4d13-8e07-9cfc10ec76fc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:58.003529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b3eca53-164c-4d13-8e07-9cfc10ec76fc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:58.003952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b3eca53-164c-4d13-8e07-9cfc10ec76fc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:58.032922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2b3eca53-164c-4d13-8e07-9cfc10ec76fc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Aug 06 12:49:58.033477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 881/1770] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:57 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:58.875649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-25a42cfe-369a-490a-8921-8ffe8b8ed4e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:58.877681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-25a42cfe-369a-490a-8921-8ffe8b8ed4e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:58.883986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a42cfe-369a-490a-8921-8ffe8b8ed4e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:58.884496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a42cfe-369a-490a-8921-8ffe8b8ed4e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:58.884923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a42cfe-369a-490a-8921-8ffe8b8ed4e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:58.885591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a42cfe-369a-490a-8921-8ffe8b8ed4e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:58.886030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a42cfe-369a-490a-8921-8ffe8b8ed4e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:58.886446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a42cfe-369a-490a-8921-8ffe8b8ed4e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:58.915101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-25a42cfe-369a-490a-8921-8ffe8b8ed4e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Aug 06 12:49:58.915630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 890/1771] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:59.045009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b09af752-ce86-4698-bf1e-bb8af6b750ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:59.047784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b09af752-ce86-4698-bf1e-bb8af6b750ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:59.054118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09af752-ce86-4698-bf1e-bb8af6b750ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:59.054593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09af752-ce86-4698-bf1e-bb8af6b750ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:59.055024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09af752-ce86-4698-bf1e-bb8af6b750ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:59.055709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09af752-ce86-4698-bf1e-bb8af6b750ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:59.056156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09af752-ce86-4698-bf1e-bb8af6b750ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:59.056601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b09af752-ce86-4698-bf1e-bb8af6b750ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:59.084374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b09af752-ce86-4698-bf1e-bb8af6b750ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Aug 06 12:49:59.084915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 882/1772] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:49:59.927911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-df8832bf-8f00-4413-8032-c021077f2b77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:49:59.929983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-df8832bf-8f00-4413-8032-c021077f2b77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:49:59.936360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df8832bf-8f00-4413-8032-c021077f2b77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:59.936837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df8832bf-8f00-4413-8032-c021077f2b77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:59.937265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df8832bf-8f00-4413-8032-c021077f2b77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:59.938019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df8832bf-8f00-4413-8032-c021077f2b77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:49:59.938467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df8832bf-8f00-4413-8032-c021077f2b77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:49:59.938885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df8832bf-8f00-4413-8032-c021077f2b77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:49:59.966702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-df8832bf-8f00-4413-8032-c021077f2b77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042817 Aug 06 12:49:59.967243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 891/1773] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:49:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:00.100024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7982c16a-797a-440e-93a3-8567c22b0565 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:00.102538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7982c16a-797a-440e-93a3-8567c22b0565 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:00.109232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7982c16a-797a-440e-93a3-8567c22b0565 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:00.110387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7982c16a-797a-440e-93a3-8567c22b0565 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:00.111098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7982c16a-797a-440e-93a3-8567c22b0565 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:00.111806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7982c16a-797a-440e-93a3-8567c22b0565 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:00.112264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7982c16a-797a-440e-93a3-8567c22b0565 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:00.112710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7982c16a-797a-440e-93a3-8567c22b0565 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:00.140887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7982c16a-797a-440e-93a3-8567c22b0565 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048224 Aug 06 12:50:00.141434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 883/1774] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:00 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:00.979325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-def39471-19b1-473b-80ab-19f0234c6800 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:00.981399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-def39471-19b1-473b-80ab-19f0234c6800 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:00.987980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def39471-19b1-473b-80ab-19f0234c6800 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:00.988502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def39471-19b1-473b-80ab-19f0234c6800 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:00.988936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def39471-19b1-473b-80ab-19f0234c6800 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:00.989649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def39471-19b1-473b-80ab-19f0234c6800 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:00.990102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def39471-19b1-473b-80ab-19f0234c6800 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:00.990525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-def39471-19b1-473b-80ab-19f0234c6800 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:01.020294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-def39471-19b1-473b-80ab-19f0234c6800 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Aug 06 12:50:01.020866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 892/1775] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:01.153165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-de346e52-eab5-4011-bc62-1b93bebd9551 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:01.155320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-de346e52-eab5-4011-bc62-1b93bebd9551 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:01.161957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de346e52-eab5-4011-bc62-1b93bebd9551 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:01.162442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de346e52-eab5-4011-bc62-1b93bebd9551 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:01.162875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de346e52-eab5-4011-bc62-1b93bebd9551 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:01.163572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de346e52-eab5-4011-bc62-1b93bebd9551 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:01.164028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de346e52-eab5-4011-bc62-1b93bebd9551 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:01.164493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de346e52-eab5-4011-bc62-1b93bebd9551 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:01.196236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-de346e52-eab5-4011-bc62-1b93bebd9551 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047061 Aug 06 12:50:01.196817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 884/1776] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:01 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:02.033269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8565e015-ee0d-4485-87fb-e6c74169691f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:02.035424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8565e015-ee0d-4485-87fb-e6c74169691f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:02.041738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8565e015-ee0d-4485-87fb-e6c74169691f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:02.042211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8565e015-ee0d-4485-87fb-e6c74169691f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:02.042640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8565e015-ee0d-4485-87fb-e6c74169691f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:02.043315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8565e015-ee0d-4485-87fb-e6c74169691f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:02.043759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8565e015-ee0d-4485-87fb-e6c74169691f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:02.044174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8565e015-ee0d-4485-87fb-e6c74169691f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:02.071855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8565e015-ee0d-4485-87fb-e6c74169691f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Aug 06 12:50:02.072422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 893/1777] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:02.210155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3449443-7f7b-438c-8a0c-4adba677ac05 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:02.212339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d3449443-7f7b-438c-8a0c-4adba677ac05 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:02.219271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3449443-7f7b-438c-8a0c-4adba677ac05 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:02.219758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3449443-7f7b-438c-8a0c-4adba677ac05 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:02.220199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3449443-7f7b-438c-8a0c-4adba677ac05 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:02.220917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3449443-7f7b-438c-8a0c-4adba677ac05 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:02.221370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3449443-7f7b-438c-8a0c-4adba677ac05 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:02.221797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3449443-7f7b-438c-8a0c-4adba677ac05 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:02.249926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3449443-7f7b-438c-8a0c-4adba677ac05 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Aug 06 12:50:02.250472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 885/1778] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:02 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:03.083922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a1fadb9-2b81-43ba-a03b-7663e14263cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:03.086050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6a1fadb9-2b81-43ba-a03b-7663e14263cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:03.093584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a1fadb9-2b81-43ba-a03b-7663e14263cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:03.093995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a1fadb9-2b81-43ba-a03b-7663e14263cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:03.094422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a1fadb9-2b81-43ba-a03b-7663e14263cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:03.095101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a1fadb9-2b81-43ba-a03b-7663e14263cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:03.095546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a1fadb9-2b81-43ba-a03b-7663e14263cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:03.095965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a1fadb9-2b81-43ba-a03b-7663e14263cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:03.127218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6a1fadb9-2b81-43ba-a03b-7663e14263cf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047273 Aug 06 12:50:03.127776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 894/1779] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:03.261756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-468aaa6e-78f7-498d-80c1-aa6f020912f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:03.263916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-468aaa6e-78f7-498d-80c1-aa6f020912f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:03.269942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-468aaa6e-78f7-498d-80c1-aa6f020912f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:03.270423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-468aaa6e-78f7-498d-80c1-aa6f020912f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:03.270886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-468aaa6e-78f7-498d-80c1-aa6f020912f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:03.271570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-468aaa6e-78f7-498d-80c1-aa6f020912f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:03.272018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-468aaa6e-78f7-498d-80c1-aa6f020912f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:03.272473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-468aaa6e-78f7-498d-80c1-aa6f020912f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:03.301258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-468aaa6e-78f7-498d-80c1-aa6f020912f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Aug 06 12:50:03.301801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 886/1780] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:03 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:04.139102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f3d463d2-d706-4322-91dd-5842a999dc26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:04.141902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f3d463d2-d706-4322-91dd-5842a999dc26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:04.148202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3d463d2-d706-4322-91dd-5842a999dc26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:04.148713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3d463d2-d706-4322-91dd-5842a999dc26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:04.149196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3d463d2-d706-4322-91dd-5842a999dc26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:04.149822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3d463d2-d706-4322-91dd-5842a999dc26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:04.150269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3d463d2-d706-4322-91dd-5842a999dc26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:04.150689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3d463d2-d706-4322-91dd-5842a999dc26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:04.178531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f3d463d2-d706-4322-91dd-5842a999dc26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043369 Aug 06 12:50:04.179077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 895/1781] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:50:04.313987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e49c117e-5610-4dc3-bba0-ab82778714ef tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:04.316130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e49c117e-5610-4dc3-bba0-ab82778714ef tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:04.322406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e49c117e-5610-4dc3-bba0-ab82778714ef tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:04.322878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e49c117e-5610-4dc3-bba0-ab82778714ef tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:04.323306 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e49c117e-5610-4dc3-bba0-ab82778714ef tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:04.323981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e49c117e-5610-4dc3-bba0-ab82778714ef tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:04.324447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e49c117e-5610-4dc3-bba0-ab82778714ef tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:04.324860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e49c117e-5610-4dc3-bba0-ab82778714ef tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:04.352602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e49c117e-5610-4dc3-bba0-ab82778714ef tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043114 Aug 06 12:50:04.353141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 887/1782] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:04 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:05.191269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cac9d233-4fc9-40ac-90be-8afdafaaced5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:05.193457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cac9d233-4fc9-40ac-90be-8afdafaaced5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:05.199741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac9d233-4fc9-40ac-90be-8afdafaaced5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:05.200223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac9d233-4fc9-40ac-90be-8afdafaaced5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:05.200686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac9d233-4fc9-40ac-90be-8afdafaaced5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:05.201383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac9d233-4fc9-40ac-90be-8afdafaaced5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:05.201833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac9d233-4fc9-40ac-90be-8afdafaaced5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:05.202257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac9d233-4fc9-40ac-90be-8afdafaaced5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:05.230281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cac9d233-4fc9-40ac-90be-8afdafaaced5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 Aug 06 12:50:05.230754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 896/1783] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:05.366608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b24e59f3-b485-4b1c-aa46-a259a251db13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:05.369127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b24e59f3-b485-4b1c-aa46-a259a251db13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:05.375999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b24e59f3-b485-4b1c-aa46-a259a251db13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:05.376498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b24e59f3-b485-4b1c-aa46-a259a251db13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:05.376925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b24e59f3-b485-4b1c-aa46-a259a251db13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:05.377602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b24e59f3-b485-4b1c-aa46-a259a251db13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:05.378045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b24e59f3-b485-4b1c-aa46-a259a251db13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:05.378458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b24e59f3-b485-4b1c-aa46-a259a251db13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:05.406606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b24e59f3-b485-4b1c-aa46-a259a251db13 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044432 Aug 06 12:50:05.407148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 888/1784] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:06.242776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e851c8e4-6153-4662-be4d-2c94cccff63f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:06.244986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e851c8e4-6153-4662-be4d-2c94cccff63f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:06.251887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e851c8e4-6153-4662-be4d-2c94cccff63f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:06.252402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e851c8e4-6153-4662-be4d-2c94cccff63f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:06.252842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e851c8e4-6153-4662-be4d-2c94cccff63f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:06.253597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e851c8e4-6153-4662-be4d-2c94cccff63f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:06.254049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e851c8e4-6153-4662-be4d-2c94cccff63f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:06.254473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e851c8e4-6153-4662-be4d-2c94cccff63f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:06.279035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:50:06.283916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e851c8e4-6153-4662-be4d-2c94cccff63f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Aug 06 12:50:06.284488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 897/1785] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:06.418907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e543a465-67a7-4bb9-8817-3d4582f65834 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:06.421087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e543a465-67a7-4bb9-8817-3d4582f65834 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:06.427889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e543a465-67a7-4bb9-8817-3d4582f65834 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:06.428386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e543a465-67a7-4bb9-8817-3d4582f65834 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:06.428823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e543a465-67a7-4bb9-8817-3d4582f65834 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:06.429506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e543a465-67a7-4bb9-8817-3d4582f65834 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:06.429958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e543a465-67a7-4bb9-8817-3d4582f65834 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:06.430378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e543a465-67a7-4bb9-8817-3d4582f65834 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:06.459304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e543a465-67a7-4bb9-8817-3d4582f65834 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Aug 06 12:50:06.459849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 889/1786] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:07.295501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b34e4c26-bf89-4b39-8d0e-ea6fb16b3939 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:07.298229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b34e4c26-bf89-4b39-8d0e-ea6fb16b3939 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:07.304592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b34e4c26-bf89-4b39-8d0e-ea6fb16b3939 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:07.305072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b34e4c26-bf89-4b39-8d0e-ea6fb16b3939 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:07.305504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b34e4c26-bf89-4b39-8d0e-ea6fb16b3939 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:07.306185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b34e4c26-bf89-4b39-8d0e-ea6fb16b3939 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:07.306630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b34e4c26-bf89-4b39-8d0e-ea6fb16b3939 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:07.307045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b34e4c26-bf89-4b39-8d0e-ea6fb16b3939 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:07.334843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b34e4c26-bf89-4b39-8d0e-ea6fb16b3939 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Aug 06 12:50:07.335331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 898/1787] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:07.472196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-696e7ef7-86f1-4fd3-944b-58a2bbdeffda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:07.474340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-696e7ef7-86f1-4fd3-944b-58a2bbdeffda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:07.480701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-696e7ef7-86f1-4fd3-944b-58a2bbdeffda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:07.481175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-696e7ef7-86f1-4fd3-944b-58a2bbdeffda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:07.481608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-696e7ef7-86f1-4fd3-944b-58a2bbdeffda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:07.482288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-696e7ef7-86f1-4fd3-944b-58a2bbdeffda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:07.482738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-696e7ef7-86f1-4fd3-944b-58a2bbdeffda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:07.483157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-696e7ef7-86f1-4fd3-944b-58a2bbdeffda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:07.511881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-696e7ef7-86f1-4fd3-944b-58a2bbdeffda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Aug 06 12:50:07.512441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 890/1788] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:07 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:08.347633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e0c567c1-1d3c-4ed9-a72d-c7a1f90f90cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:08.349805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e0c567c1-1d3c-4ed9-a72d-c7a1f90f90cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:08.356096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e0c567c1-1d3c-4ed9-a72d-c7a1f90f90cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:08.356616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e0c567c1-1d3c-4ed9-a72d-c7a1f90f90cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:08.357057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e0c567c1-1d3c-4ed9-a72d-c7a1f90f90cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:08.357738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e0c567c1-1d3c-4ed9-a72d-c7a1f90f90cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:08.358189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e0c567c1-1d3c-4ed9-a72d-c7a1f90f90cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:08.358612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e0c567c1-1d3c-4ed9-a72d-c7a1f90f90cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:08.386862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e0c567c1-1d3c-4ed9-a72d-c7a1f90f90cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 Aug 06 12:50:08.387408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 899/1789] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:08 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:08.524032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c90f177e-7793-4c47-8e15-9ae81a996f33 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:08.526168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c90f177e-7793-4c47-8e15-9ae81a996f33 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:08.532455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c90f177e-7793-4c47-8e15-9ae81a996f33 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:08.532930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c90f177e-7793-4c47-8e15-9ae81a996f33 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:08.533358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c90f177e-7793-4c47-8e15-9ae81a996f33 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:08.534033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c90f177e-7793-4c47-8e15-9ae81a996f33 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:08.534478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c90f177e-7793-4c47-8e15-9ae81a996f33 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:08.534895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c90f177e-7793-4c47-8e15-9ae81a996f33 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:08.562838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c90f177e-7793-4c47-8e15-9ae81a996f33 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042281 Aug 06 12:50:08.563368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 891/1790] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:09.399425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7724d56d-35e0-45ef-a92d-85c34c9118b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:09.401577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7724d56d-35e0-45ef-a92d-85c34c9118b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:09.408516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7724d56d-35e0-45ef-a92d-85c34c9118b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:09.408995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7724d56d-35e0-45ef-a92d-85c34c9118b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:09.409421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7724d56d-35e0-45ef-a92d-85c34c9118b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:09.410107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7724d56d-35e0-45ef-a92d-85c34c9118b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:09.410548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7724d56d-35e0-45ef-a92d-85c34c9118b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:09.410963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7724d56d-35e0-45ef-a92d-85c34c9118b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:09.439297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7724d56d-35e0-45ef-a92d-85c34c9118b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Aug 06 12:50:09.439830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 900/1791] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:09.575032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff058271-8806-403b-8d7d-335d44705d3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:09.577325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ff058271-8806-403b-8d7d-335d44705d3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:09.584243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff058271-8806-403b-8d7d-335d44705d3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:09.584751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff058271-8806-403b-8d7d-335d44705d3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:09.585185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff058271-8806-403b-8d7d-335d44705d3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:09.585868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff058271-8806-403b-8d7d-335d44705d3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:09.586321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff058271-8806-403b-8d7d-335d44705d3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:09.586750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff058271-8806-403b-8d7d-335d44705d3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:09.616933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff058271-8806-403b-8d7d-335d44705d3c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Aug 06 12:50:09.617478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 892/1792] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:50:10.450967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8719c4b2-ea79-4c06-ba09-a5c8a848d3f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:10.453615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8719c4b2-ea79-4c06-ba09-a5c8a848d3f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:10.459854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8719c4b2-ea79-4c06-ba09-a5c8a848d3f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:10.460346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8719c4b2-ea79-4c06-ba09-a5c8a848d3f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:10.460776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8719c4b2-ea79-4c06-ba09-a5c8a848d3f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:10.461478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8719c4b2-ea79-4c06-ba09-a5c8a848d3f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:10.461923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8719c4b2-ea79-4c06-ba09-a5c8a848d3f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:10.462336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8719c4b2-ea79-4c06-ba09-a5c8a848d3f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:10.491112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8719c4b2-ea79-4c06-ba09-a5c8a848d3f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Aug 06 12:50:10.491592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 901/1793] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:10.629257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2b03de2e-87e9-4439-a141-d1d2a72bbd88 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:10.631508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2b03de2e-87e9-4439-a141-d1d2a72bbd88 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:10.637786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b03de2e-87e9-4439-a141-d1d2a72bbd88 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:10.638260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b03de2e-87e9-4439-a141-d1d2a72bbd88 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:10.638689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b03de2e-87e9-4439-a141-d1d2a72bbd88 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:10.639397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b03de2e-87e9-4439-a141-d1d2a72bbd88 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:10.639871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b03de2e-87e9-4439-a141-d1d2a72bbd88 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:10.640799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b03de2e-87e9-4439-a141-d1d2a72bbd88 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:10.670259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2b03de2e-87e9-4439-a141-d1d2a72bbd88 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Aug 06 12:50:10.670810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 893/1794] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:11.503290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4df3d4dd-9b4a-42ff-a0ec-a084a42b16e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:11.505455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4df3d4dd-9b4a-42ff-a0ec-a084a42b16e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:11.511805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4df3d4dd-9b4a-42ff-a0ec-a084a42b16e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:11.512285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4df3d4dd-9b4a-42ff-a0ec-a084a42b16e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:11.512748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4df3d4dd-9b4a-42ff-a0ec-a084a42b16e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:11.513433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4df3d4dd-9b4a-42ff-a0ec-a084a42b16e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:11.513893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4df3d4dd-9b4a-42ff-a0ec-a084a42b16e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:11.514319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4df3d4dd-9b4a-42ff-a0ec-a084a42b16e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:11.542744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4df3d4dd-9b4a-42ff-a0ec-a084a42b16e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Aug 06 12:50:11.543224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 902/1795] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:11.681504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ea2da97b-8af5-4fca-86cb-47025cf4ad27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:11.683831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ea2da97b-8af5-4fca-86cb-47025cf4ad27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:11.690284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2da97b-8af5-4fca-86cb-47025cf4ad27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:11.690756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2da97b-8af5-4fca-86cb-47025cf4ad27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:11.691186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2da97b-8af5-4fca-86cb-47025cf4ad27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:11.691859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2da97b-8af5-4fca-86cb-47025cf4ad27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:11.692326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2da97b-8af5-4fca-86cb-47025cf4ad27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:11.692741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea2da97b-8af5-4fca-86cb-47025cf4ad27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:11.696289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:50:11.721284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ea2da97b-8af5-4fca-86cb-47025cf4ad27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043743 Aug 06 12:50:11.721837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 894/1796] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:12.554950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a1191700-0144-4397-87b0-4cf8810bd1a3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:12.557094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a1191700-0144-4397-87b0-4cf8810bd1a3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:12.564031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1191700-0144-4397-87b0-4cf8810bd1a3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:12.564530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1191700-0144-4397-87b0-4cf8810bd1a3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:12.564958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1191700-0144-4397-87b0-4cf8810bd1a3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:12.565628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1191700-0144-4397-87b0-4cf8810bd1a3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:12.566071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1191700-0144-4397-87b0-4cf8810bd1a3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:12.566486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1191700-0144-4397-87b0-4cf8810bd1a3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:12.593866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a1191700-0144-4397-87b0-4cf8810bd1a3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042790 Aug 06 12:50:12.594341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 903/1797] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:12.733030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-69120a9a-7d07-4759-b848-0d900298e3c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:12.736488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-69120a9a-7d07-4759-b848-0d900298e3c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:12.742909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69120a9a-7d07-4759-b848-0d900298e3c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:12.743391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69120a9a-7d07-4759-b848-0d900298e3c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:12.743833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69120a9a-7d07-4759-b848-0d900298e3c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:12.744550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69120a9a-7d07-4759-b848-0d900298e3c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:12.745003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69120a9a-7d07-4759-b848-0d900298e3c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:12.745473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69120a9a-7d07-4759-b848-0d900298e3c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:12.776368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-69120a9a-7d07-4759-b848-0d900298e3c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047616 Aug 06 12:50:12.776923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 895/1798] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:13.605712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f001662c-a9c6-4c44-8c56-22270b70d812 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:13.607827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f001662c-a9c6-4c44-8c56-22270b70d812 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:13.614603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f001662c-a9c6-4c44-8c56-22270b70d812 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:13.615080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f001662c-a9c6-4c44-8c56-22270b70d812 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:13.615512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f001662c-a9c6-4c44-8c56-22270b70d812 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:13.616191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f001662c-a9c6-4c44-8c56-22270b70d812 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:13.616666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f001662c-a9c6-4c44-8c56-22270b70d812 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:13.617083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f001662c-a9c6-4c44-8c56-22270b70d812 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:13.646047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f001662c-a9c6-4c44-8c56-22270b70d812 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044217 Aug 06 12:50:13.646594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 904/1799] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:13.788445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-71e00365-246d-4b38-8f48-875a54663c24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:13.790716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-71e00365-246d-4b38-8f48-875a54663c24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:13.797087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71e00365-246d-4b38-8f48-875a54663c24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:13.797563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71e00365-246d-4b38-8f48-875a54663c24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:13.797997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71e00365-246d-4b38-8f48-875a54663c24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:13.798681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71e00365-246d-4b38-8f48-875a54663c24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:13.799135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71e00365-246d-4b38-8f48-875a54663c24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:13.799554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71e00365-246d-4b38-8f48-875a54663c24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:13.828564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-71e00365-246d-4b38-8f48-875a54663c24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043374 Aug 06 12:50:13.829106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 896/1800] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:13 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:14.658826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-90f7b3df-dec8-4349-a58f-d40668ada4a2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:14.661005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-90f7b3df-dec8-4349-a58f-d40668ada4a2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:14.667262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f7b3df-dec8-4349-a58f-d40668ada4a2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:14.667730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f7b3df-dec8-4349-a58f-d40668ada4a2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:14.668156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f7b3df-dec8-4349-a58f-d40668ada4a2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:14.668859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f7b3df-dec8-4349-a58f-d40668ada4a2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:14.669307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f7b3df-dec8-4349-a58f-d40668ada4a2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:14.669722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f7b3df-dec8-4349-a58f-d40668ada4a2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:14.697713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-90f7b3df-dec8-4349-a58f-d40668ada4a2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Aug 06 12:50:14.698248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 905/1801] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:14.841010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1990a878-c5b5-45ff-95c1-0d494a5424c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:14.843984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1990a878-c5b5-45ff-95c1-0d494a5424c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:14.850569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1990a878-c5b5-45ff-95c1-0d494a5424c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:14.851084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1990a878-c5b5-45ff-95c1-0d494a5424c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:14.851520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1990a878-c5b5-45ff-95c1-0d494a5424c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:14.852239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1990a878-c5b5-45ff-95c1-0d494a5424c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:14.852721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1990a878-c5b5-45ff-95c1-0d494a5424c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:14.853152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1990a878-c5b5-45ff-95c1-0d494a5424c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:14.882163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1990a878-c5b5-45ff-95c1-0d494a5424c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Aug 06 12:50:14.882732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 897/1802] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:15.709854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4a08a4c7-731d-4433-aeb9-f8f27d70647c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:15.711948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4a08a4c7-731d-4433-aeb9-f8f27d70647c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:15.718040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a08a4c7-731d-4433-aeb9-f8f27d70647c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:15.719094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a08a4c7-731d-4433-aeb9-f8f27d70647c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:15.719524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a08a4c7-731d-4433-aeb9-f8f27d70647c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:15.720190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a08a4c7-731d-4433-aeb9-f8f27d70647c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:15.720663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a08a4c7-731d-4433-aeb9-f8f27d70647c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:15.721075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a08a4c7-731d-4433-aeb9-f8f27d70647c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:15.750119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4a08a4c7-731d-4433-aeb9-f8f27d70647c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Aug 06 12:50:15.750669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 906/1803] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:15 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:15.895051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4160203-0836-4c0d-84bb-d12604852cc0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:15.897514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4160203-0836-4c0d-84bb-d12604852cc0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:15.905346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4160203-0836-4c0d-84bb-d12604852cc0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:15.905824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4160203-0836-4c0d-84bb-d12604852cc0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:15.906258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4160203-0836-4c0d-84bb-d12604852cc0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:15.906941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4160203-0836-4c0d-84bb-d12604852cc0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:15.907393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4160203-0836-4c0d-84bb-d12604852cc0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:15.907813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4160203-0836-4c0d-84bb-d12604852cc0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:15.935682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4160203-0836-4c0d-84bb-d12604852cc0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Aug 06 12:50:15.936234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 898/1804] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:16.762018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-56976647-a9cd-42ba-a633-00ea7e55e631 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:16.764171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-56976647-a9cd-42ba-a633-00ea7e55e631 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:16.770462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56976647-a9cd-42ba-a633-00ea7e55e631 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:16.770938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56976647-a9cd-42ba-a633-00ea7e55e631 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:16.771366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56976647-a9cd-42ba-a633-00ea7e55e631 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:16.772040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56976647-a9cd-42ba-a633-00ea7e55e631 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:16.772518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56976647-a9cd-42ba-a633-00ea7e55e631 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:16.772936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56976647-a9cd-42ba-a633-00ea7e55e631 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:16.803636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-56976647-a9cd-42ba-a633-00ea7e55e631 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Aug 06 12:50:16.804184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 907/1805] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:16.948401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-60c76fc1-9158-4815-8ffb-af8016a133fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:16.950693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-60c76fc1-9158-4815-8ffb-af8016a133fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:16.957254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c76fc1-9158-4815-8ffb-af8016a133fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:16.957738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c76fc1-9158-4815-8ffb-af8016a133fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:16.958174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c76fc1-9158-4815-8ffb-af8016a133fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:16.958861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c76fc1-9158-4815-8ffb-af8016a133fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:16.959308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c76fc1-9158-4815-8ffb-af8016a133fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:16.959748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c76fc1-9158-4815-8ffb-af8016a133fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:16.990734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-60c76fc1-9158-4815-8ffb-af8016a133fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Aug 06 12:50:16.991287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 899/1806] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:17.816116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ebb00730-8339-45f0-9abc-0b46eed6520f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:17.818245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ebb00730-8339-45f0-9abc-0b46eed6520f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:17.820538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=58 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:50:17.825721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebb00730-8339-45f0-9abc-0b46eed6520f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:17.826205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebb00730-8339-45f0-9abc-0b46eed6520f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:17.826618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebb00730-8339-45f0-9abc-0b46eed6520f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:17.827294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebb00730-8339-45f0-9abc-0b46eed6520f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:17.828229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebb00730-8339-45f0-9abc-0b46eed6520f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:17.828669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebb00730-8339-45f0-9abc-0b46eed6520f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:17.856989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ebb00730-8339-45f0-9abc-0b46eed6520f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045985 Aug 06 12:50:17.857535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 908/1807] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:18.002795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e69e6085-981b-4290-94d9-6d770ccf091c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:18.005087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e69e6085-981b-4290-94d9-6d770ccf091c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:18.007447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=58 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:50:18.012555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e69e6085-981b-4290-94d9-6d770ccf091c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:18.013028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e69e6085-981b-4290-94d9-6d770ccf091c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:18.013456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e69e6085-981b-4290-94d9-6d770ccf091c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:18.014156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e69e6085-981b-4290-94d9-6d770ccf091c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:18.014597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e69e6085-981b-4290-94d9-6d770ccf091c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:18.015013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e69e6085-981b-4290-94d9-6d770ccf091c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:18.044016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e69e6085-981b-4290-94d9-6d770ccf091c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045141 Aug 06 12:50:18.044585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 900/1808] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:18.869511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-df94896b-cbee-4668-9dba-d8be237682bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:18.871638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-df94896b-cbee-4668-9dba-d8be237682bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:18.878485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df94896b-cbee-4668-9dba-d8be237682bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:18.878956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df94896b-cbee-4668-9dba-d8be237682bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:18.879383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df94896b-cbee-4668-9dba-d8be237682bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:18.880053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df94896b-cbee-4668-9dba-d8be237682bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:18.880525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df94896b-cbee-4668-9dba-d8be237682bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:18.880944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df94896b-cbee-4668-9dba-d8be237682bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:18.908899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-df94896b-cbee-4668-9dba-d8be237682bf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Aug 06 12:50:18.909435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 909/1809] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:18 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:19.056165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aa0a0ea7-c964-43af-9c6b-fa1e1827e7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:19.058423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aa0a0ea7-c964-43af-9c6b-fa1e1827e7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:19.064838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa0a0ea7-c964-43af-9c6b-fa1e1827e7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:19.065321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa0a0ea7-c964-43af-9c6b-fa1e1827e7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:19.065785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa0a0ea7-c964-43af-9c6b-fa1e1827e7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:19.066461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa0a0ea7-c964-43af-9c6b-fa1e1827e7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:19.066920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa0a0ea7-c964-43af-9c6b-fa1e1827e7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:19.067344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa0a0ea7-c964-43af-9c6b-fa1e1827e7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:19.095724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aa0a0ea7-c964-43af-9c6b-fa1e1827e7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043522 Aug 06 12:50:19.096263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 901/1810] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:19.921180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-91b3dab6-4c07-4c83-bafc-a179a3b37387 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:19.923250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-91b3dab6-4c07-4c83-bafc-a179a3b37387 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:19.929603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91b3dab6-4c07-4c83-bafc-a179a3b37387 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:19.930083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91b3dab6-4c07-4c83-bafc-a179a3b37387 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:19.930575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91b3dab6-4c07-4c83-bafc-a179a3b37387 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:19.931267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91b3dab6-4c07-4c83-bafc-a179a3b37387 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:19.931719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91b3dab6-4c07-4c83-bafc-a179a3b37387 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:19.932145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91b3dab6-4c07-4c83-bafc-a179a3b37387 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:19.961033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-91b3dab6-4c07-4c83-bafc-a179a3b37387 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043925 Aug 06 12:50:19.961576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 910/1811] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:20.107734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-110dff8b-ea16-4649-b6fb-a0ee943ff762 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:20.110425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-110dff8b-ea16-4649-b6fb-a0ee943ff762 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:20.116969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-110dff8b-ea16-4649-b6fb-a0ee943ff762 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:20.117442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-110dff8b-ea16-4649-b6fb-a0ee943ff762 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:20.117870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-110dff8b-ea16-4649-b6fb-a0ee943ff762 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:20.118543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-110dff8b-ea16-4649-b6fb-a0ee943ff762 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:20.118987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-110dff8b-ea16-4649-b6fb-a0ee943ff762 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:20.119400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-110dff8b-ea16-4649-b6fb-a0ee943ff762 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:20.148908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-110dff8b-ea16-4649-b6fb-a0ee943ff762 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045112 Aug 06 12:50:20.149457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 902/1812] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:20.973096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5e3c1c77-4be0-4fbe-bf6e-46d83d353942 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:20.975206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5e3c1c77-4be0-4fbe-bf6e-46d83d353942 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:20.981441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e3c1c77-4be0-4fbe-bf6e-46d83d353942 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:20.981907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e3c1c77-4be0-4fbe-bf6e-46d83d353942 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:20.982328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e3c1c77-4be0-4fbe-bf6e-46d83d353942 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:20.983001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e3c1c77-4be0-4fbe-bf6e-46d83d353942 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:20.983443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e3c1c77-4be0-4fbe-bf6e-46d83d353942 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:20.983858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e3c1c77-4be0-4fbe-bf6e-46d83d353942 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:21.012874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5e3c1c77-4be0-4fbe-bf6e-46d83d353942 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Aug 06 12:50:21.013440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 911/1813] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:21.069979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:50:21.070128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:50:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:50:21.160933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9609feda-b98c-4928-aae9-9d46aa77685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:21.163045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9609feda-b98c-4928-aae9-9d46aa77685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:21.169409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9609feda-b98c-4928-aae9-9d46aa77685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:21.169886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9609feda-b98c-4928-aae9-9d46aa77685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:21.170321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9609feda-b98c-4928-aae9-9d46aa77685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:21.171003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9609feda-b98c-4928-aae9-9d46aa77685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:21.171453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9609feda-b98c-4928-aae9-9d46aa77685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:21.171876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9609feda-b98c-4928-aae9-9d46aa77685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:21.201554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9609feda-b98c-4928-aae9-9d46aa77685f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Aug 06 12:50:21.202110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 903/1814] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:21 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:22.025448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bd61a080-0dce-40e3-8421-8133f13077a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:22.027556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bd61a080-0dce-40e3-8421-8133f13077a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:22.034303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd61a080-0dce-40e3-8421-8133f13077a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:22.034776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd61a080-0dce-40e3-8421-8133f13077a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:22.035200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd61a080-0dce-40e3-8421-8133f13077a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:22.035875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd61a080-0dce-40e3-8421-8133f13077a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:22.036349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd61a080-0dce-40e3-8421-8133f13077a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:22.036765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd61a080-0dce-40e3-8421-8133f13077a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:22.065207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bd61a080-0dce-40e3-8421-8133f13077a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043735 Aug 06 12:50:22.065738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 912/1815] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:22.213864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5147ae0f-65b9-4aba-ac06-d272e8c7eee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:22.215982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5147ae0f-65b9-4aba-ac06-d272e8c7eee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:22.223111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5147ae0f-65b9-4aba-ac06-d272e8c7eee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:22.223593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5147ae0f-65b9-4aba-ac06-d272e8c7eee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:22.224029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5147ae0f-65b9-4aba-ac06-d272e8c7eee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:22.224754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5147ae0f-65b9-4aba-ac06-d272e8c7eee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:22.225209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5147ae0f-65b9-4aba-ac06-d272e8c7eee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:22.225635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5147ae0f-65b9-4aba-ac06-d272e8c7eee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:22.255187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5147ae0f-65b9-4aba-ac06-d272e8c7eee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Aug 06 12:50:22.255741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 904/1816] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:22 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:23.077298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d05751e6-96d5-4ef9-aa1d-a0b3449136dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:23.079512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d05751e6-96d5-4ef9-aa1d-a0b3449136dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:23.085879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d05751e6-96d5-4ef9-aa1d-a0b3449136dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:23.086348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d05751e6-96d5-4ef9-aa1d-a0b3449136dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:23.086774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d05751e6-96d5-4ef9-aa1d-a0b3449136dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:23.087460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d05751e6-96d5-4ef9-aa1d-a0b3449136dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:23.087888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d05751e6-96d5-4ef9-aa1d-a0b3449136dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:23.088520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d05751e6-96d5-4ef9-aa1d-a0b3449136dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:23.119052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d05751e6-96d5-4ef9-aa1d-a0b3449136dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045641 Aug 06 12:50:23.119590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 913/1817] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:23.267329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c27dfb2d-576d-4154-8f43-f3b37ed19b03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:50:23.269433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c27dfb2d-576d-4154-8f43-f3b37ed19b03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:23.275747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27dfb2d-576d-4154-8f43-f3b37ed19b03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:23.276213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27dfb2d-576d-4154-8f43-f3b37ed19b03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:23.276667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27dfb2d-576d-4154-8f43-f3b37ed19b03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:23.277341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27dfb2d-576d-4154-8f43-f3b37ed19b03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:23.277787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27dfb2d-576d-4154-8f43-f3b37ed19b03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:23.278204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c27dfb2d-576d-4154-8f43-f3b37ed19b03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:23.382655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c27dfb2d-576d-4154-8f43-f3b37ed19b03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "POST /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/action" status: 200 len: 76046 microversion: 2.1 time: 0.119233 Aug 06 12:50:23.383286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 905/1818] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 12:50:23 2022] POST /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c/action => generated 76046 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:50:24.130491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d0a34754-0cba-4097-825e-9c18be700e46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:24.132666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d0a34754-0cba-4097-825e-9c18be700e46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:24.139087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a34754-0cba-4097-825e-9c18be700e46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:24.139568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a34754-0cba-4097-825e-9c18be700e46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:24.140002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a34754-0cba-4097-825e-9c18be700e46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:24.141351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a34754-0cba-4097-825e-9c18be700e46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:24.141808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a34754-0cba-4097-825e-9c18be700e46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:24.142262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a34754-0cba-4097-825e-9c18be700e46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:24.159595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:50:24.174647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d0a34754-0cba-4097-825e-9c18be700e46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048059 Aug 06 12:50:24.175198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 914/1819] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:25.187965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-280d15b6-a5b9-4c5e-bd4b-1d1e1abcde0e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:25.190276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-280d15b6-a5b9-4c5e-bd4b-1d1e1abcde0e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:25.197726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280d15b6-a5b9-4c5e-bd4b-1d1e1abcde0e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:25.198203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280d15b6-a5b9-4c5e-bd4b-1d1e1abcde0e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:25.198633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280d15b6-a5b9-4c5e-bd4b-1d1e1abcde0e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:25.199330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280d15b6-a5b9-4c5e-bd4b-1d1e1abcde0e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:25.199780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280d15b6-a5b9-4c5e-bd4b-1d1e1abcde0e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:25.200202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280d15b6-a5b9-4c5e-bd4b-1d1e1abcde0e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:25.229644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-280d15b6-a5b9-4c5e-bd4b-1d1e1abcde0e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046147 Aug 06 12:50:25.230188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 906/1820] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:26.241939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0bcde0ff-a1f7-4990-b48e-09ca5412b513 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:26.244043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0bcde0ff-a1f7-4990-b48e-09ca5412b513 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:26.251015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0bcde0ff-a1f7-4990-b48e-09ca5412b513 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:26.251482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0bcde0ff-a1f7-4990-b48e-09ca5412b513 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:26.251906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0bcde0ff-a1f7-4990-b48e-09ca5412b513 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:26.252604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0bcde0ff-a1f7-4990-b48e-09ca5412b513 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:26.253050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0bcde0ff-a1f7-4990-b48e-09ca5412b513 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:26.253459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0bcde0ff-a1f7-4990-b48e-09ca5412b513 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:26.280697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0bcde0ff-a1f7-4990-b48e-09ca5412b513 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042714 Aug 06 12:50:26.281227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 915/1821] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:27.292798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ea7a6a3d-88c1-43f2-a7fe-146312717e08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:27.294958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ea7a6a3d-88c1-43f2-a7fe-146312717e08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:27.301332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea7a6a3d-88c1-43f2-a7fe-146312717e08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:27.301812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea7a6a3d-88c1-43f2-a7fe-146312717e08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:27.302249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea7a6a3d-88c1-43f2-a7fe-146312717e08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:27.302932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea7a6a3d-88c1-43f2-a7fe-146312717e08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:27.303385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea7a6a3d-88c1-43f2-a7fe-146312717e08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:27.303807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea7a6a3d-88c1-43f2-a7fe-146312717e08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:27.333089 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ea7a6a3d-88c1-43f2-a7fe-146312717e08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044260 Aug 06 12:50:27.333635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 907/1822] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:28.345017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9bf4720b-e46f-4181-884e-a4c3f8d262f4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:28.347219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9bf4720b-e46f-4181-884e-a4c3f8d262f4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:28.355750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bf4720b-e46f-4181-884e-a4c3f8d262f4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:28.356224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bf4720b-e46f-4181-884e-a4c3f8d262f4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:28.356681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bf4720b-e46f-4181-884e-a4c3f8d262f4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:28.357399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bf4720b-e46f-4181-884e-a4c3f8d262f4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:28.362722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bf4720b-e46f-4181-884e-a4c3f8d262f4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:28.362722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bf4720b-e46f-4181-884e-a4c3f8d262f4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:28.396235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9bf4720b-e46f-4181-884e-a4c3f8d262f4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055205 Aug 06 12:50:28.396832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 916/1823] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:28 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:50:29.408203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4a79d502-0119-47f2-9605-d079f46356cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:29.410395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4a79d502-0119-47f2-9605-d079f46356cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:29.416823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a79d502-0119-47f2-9605-d079f46356cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:29.417298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a79d502-0119-47f2-9605-d079f46356cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:29.417730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a79d502-0119-47f2-9605-d079f46356cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:29.418415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a79d502-0119-47f2-9605-d079f46356cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:29.418862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a79d502-0119-47f2-9605-d079f46356cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:29.419281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a79d502-0119-47f2-9605-d079f46356cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:29.450629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4a79d502-0119-47f2-9605-d079f46356cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046318 Aug 06 12:50:29.451515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 908/1824] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:30.463356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dfccf820-6f47-4062-83be-a32611b2819d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:30.465488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dfccf820-6f47-4062-83be-a32611b2819d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:30.472388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfccf820-6f47-4062-83be-a32611b2819d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:30.472892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfccf820-6f47-4062-83be-a32611b2819d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:30.473324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfccf820-6f47-4062-83be-a32611b2819d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:30.474006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfccf820-6f47-4062-83be-a32611b2819d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:30.474462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfccf820-6f47-4062-83be-a32611b2819d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:30.474876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfccf820-6f47-4062-83be-a32611b2819d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:30.502873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dfccf820-6f47-4062-83be-a32611b2819d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043382 Aug 06 12:50:30.503403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 917/1825] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:31.514866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9e512d0d-7a8a-4a53-ada6-082dc8e56ef1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:31.517047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9e512d0d-7a8a-4a53-ada6-082dc8e56ef1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:31.523448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e512d0d-7a8a-4a53-ada6-082dc8e56ef1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:31.523931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e512d0d-7a8a-4a53-ada6-082dc8e56ef1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:31.524411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e512d0d-7a8a-4a53-ada6-082dc8e56ef1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:31.525107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e512d0d-7a8a-4a53-ada6-082dc8e56ef1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:31.525570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e512d0d-7a8a-4a53-ada6-082dc8e56ef1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:31.525987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e512d0d-7a8a-4a53-ada6-082dc8e56ef1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:31.558144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9e512d0d-7a8a-4a53-ada6-082dc8e56ef1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047127 Aug 06 12:50:31.558702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 909/1826] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:32.570673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f3aa4340-75a1-4002-90b0-34ad0e024184 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:32.572822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f3aa4340-75a1-4002-90b0-34ad0e024184 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:32.579183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4340-75a1-4002-90b0-34ad0e024184 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:32.579658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4340-75a1-4002-90b0-34ad0e024184 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:32.580089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4340-75a1-4002-90b0-34ad0e024184 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:32.580803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4340-75a1-4002-90b0-34ad0e024184 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:32.581251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4340-75a1-4002-90b0-34ad0e024184 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:32.581666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4340-75a1-4002-90b0-34ad0e024184 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:32.609756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f3aa4340-75a1-4002-90b0-34ad0e024184 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043059 Aug 06 12:50:32.611147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 918/1827] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:33.622547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc3b5384-cd43-421c-bca1-28caffe78fb9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:33.624690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cc3b5384-cd43-421c-bca1-28caffe78fb9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:33.631734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc3b5384-cd43-421c-bca1-28caffe78fb9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:33.632212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc3b5384-cd43-421c-bca1-28caffe78fb9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:33.632680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc3b5384-cd43-421c-bca1-28caffe78fb9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:33.633367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc3b5384-cd43-421c-bca1-28caffe78fb9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:33.633818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc3b5384-cd43-421c-bca1-28caffe78fb9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:33.634239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc3b5384-cd43-421c-bca1-28caffe78fb9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:33.662042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc3b5384-cd43-421c-bca1-28caffe78fb9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043409 Aug 06 12:50:33.662592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 910/1828] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:34.674102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1516fd13-42fd-4512-974d-b3635eaa09fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:34.676216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1516fd13-42fd-4512-974d-b3635eaa09fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:34.682704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1516fd13-42fd-4512-974d-b3635eaa09fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:34.683180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1516fd13-42fd-4512-974d-b3635eaa09fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:34.683615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1516fd13-42fd-4512-974d-b3635eaa09fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:34.684318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1516fd13-42fd-4512-974d-b3635eaa09fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:34.684776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1516fd13-42fd-4512-974d-b3635eaa09fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:34.685198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1516fd13-42fd-4512-974d-b3635eaa09fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:34.714072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1516fd13-42fd-4512-974d-b3635eaa09fa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043966 Aug 06 12:50:34.714618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 919/1829] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:35.727316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e78c678b-c8f6-4621-911a-59e7fa29eebb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:35.729524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e78c678b-c8f6-4621-911a-59e7fa29eebb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:35.736065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e78c678b-c8f6-4621-911a-59e7fa29eebb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:35.736579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e78c678b-c8f6-4621-911a-59e7fa29eebb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:35.737013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e78c678b-c8f6-4621-911a-59e7fa29eebb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:35.737698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e78c678b-c8f6-4621-911a-59e7fa29eebb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:35.738151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e78c678b-c8f6-4621-911a-59e7fa29eebb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:35.738572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e78c678b-c8f6-4621-911a-59e7fa29eebb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:35.742199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:50:35.766425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e78c678b-c8f6-4621-911a-59e7fa29eebb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043104 Aug 06 12:50:35.767454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 911/1830] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:35 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:36.778825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d2132856-ffbf-48aa-abc7-f1768ce36cb0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:36.781022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d2132856-ffbf-48aa-abc7-f1768ce36cb0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:36.787353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2132856-ffbf-48aa-abc7-f1768ce36cb0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:36.787817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2132856-ffbf-48aa-abc7-f1768ce36cb0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:36.788241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2132856-ffbf-48aa-abc7-f1768ce36cb0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:36.788944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2132856-ffbf-48aa-abc7-f1768ce36cb0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:36.789383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2132856-ffbf-48aa-abc7-f1768ce36cb0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:36.789795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2132856-ffbf-48aa-abc7-f1768ce36cb0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:36.819112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d2132856-ffbf-48aa-abc7-f1768ce36cb0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Aug 06 12:50:36.819662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 920/1831] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:37.831626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-290d2483-dbd6-4670-9184-ab9ecbe3e94f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:37.833856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-290d2483-dbd6-4670-9184-ab9ecbe3e94f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:37.841042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290d2483-dbd6-4670-9184-ab9ecbe3e94f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:37.841529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290d2483-dbd6-4670-9184-ab9ecbe3e94f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:37.841971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290d2483-dbd6-4670-9184-ab9ecbe3e94f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:37.842693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290d2483-dbd6-4670-9184-ab9ecbe3e94f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:37.843145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290d2483-dbd6-4670-9184-ab9ecbe3e94f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:37.843571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290d2483-dbd6-4670-9184-ab9ecbe3e94f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:37.871995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-290d2483-dbd6-4670-9184-ab9ecbe3e94f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Aug 06 12:50:37.872599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 912/1832] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:37 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:38.884790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cf5d9684-eb9c-4a07-adcb-26bb734c8ea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:38.886900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cf5d9684-eb9c-4a07-adcb-26bb734c8ea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:38.893672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf5d9684-eb9c-4a07-adcb-26bb734c8ea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:38.894143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf5d9684-eb9c-4a07-adcb-26bb734c8ea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:38.894571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf5d9684-eb9c-4a07-adcb-26bb734c8ea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:38.895245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf5d9684-eb9c-4a07-adcb-26bb734c8ea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:38.895690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf5d9684-eb9c-4a07-adcb-26bb734c8ea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:38.896107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf5d9684-eb9c-4a07-adcb-26bb734c8ea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:38.924706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cf5d9684-eb9c-4a07-adcb-26bb734c8ea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Aug 06 12:50:38.925260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 921/1833] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:39.936913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-de24ae3f-8935-4f9c-a2fb-b2c4e2b51d64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:39.938963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-de24ae3f-8935-4f9c-a2fb-b2c4e2b51d64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:39.945323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24ae3f-8935-4f9c-a2fb-b2c4e2b51d64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:39.945804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24ae3f-8935-4f9c-a2fb-b2c4e2b51d64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:39.946237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24ae3f-8935-4f9c-a2fb-b2c4e2b51d64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:39.946921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24ae3f-8935-4f9c-a2fb-b2c4e2b51d64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:39.947370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24ae3f-8935-4f9c-a2fb-b2c4e2b51d64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:39.947798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de24ae3f-8935-4f9c-a2fb-b2c4e2b51d64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:39.975998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-de24ae3f-8935-4f9c-a2fb-b2c4e2b51d64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043177 Aug 06 12:50:39.976576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 913/1834] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:40.988931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f9f2803b-e179-42e7-9603-18ecffcefc42 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:40.991161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f9f2803b-e179-42e7-9603-18ecffcefc42 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:40.997614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9f2803b-e179-42e7-9603-18ecffcefc42 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:40.998098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9f2803b-e179-42e7-9603-18ecffcefc42 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:40.998533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9f2803b-e179-42e7-9603-18ecffcefc42 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:40.999226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9f2803b-e179-42e7-9603-18ecffcefc42 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:41.000046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9f2803b-e179-42e7-9603-18ecffcefc42 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:41.000149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9f2803b-e179-42e7-9603-18ecffcefc42 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:41.028977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f9f2803b-e179-42e7-9603-18ecffcefc42 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Aug 06 12:50:41.029523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 922/1835] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:42.041191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c328d51a-a1c8-45be-93a1-f51ad4eac828 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:42.043308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c328d51a-a1c8-45be-93a1-f51ad4eac828 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:42.050054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c328d51a-a1c8-45be-93a1-f51ad4eac828 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:42.050537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c328d51a-a1c8-45be-93a1-f51ad4eac828 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:42.050971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c328d51a-a1c8-45be-93a1-f51ad4eac828 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:42.051661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c328d51a-a1c8-45be-93a1-f51ad4eac828 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:42.052112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c328d51a-a1c8-45be-93a1-f51ad4eac828 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:42.052568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c328d51a-a1c8-45be-93a1-f51ad4eac828 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:42.081411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c328d51a-a1c8-45be-93a1-f51ad4eac828 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Aug 06 12:50:42.081953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 914/1836] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:42 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:43.093433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a6ccce01-9ddb-4fef-be04-2c47ab5222c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:43.095536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a6ccce01-9ddb-4fef-be04-2c47ab5222c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:43.101859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6ccce01-9ddb-4fef-be04-2c47ab5222c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:43.102330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6ccce01-9ddb-4fef-be04-2c47ab5222c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:43.102758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6ccce01-9ddb-4fef-be04-2c47ab5222c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:43.103430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6ccce01-9ddb-4fef-be04-2c47ab5222c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:43.103875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6ccce01-9ddb-4fef-be04-2c47ab5222c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:43.104291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6ccce01-9ddb-4fef-be04-2c47ab5222c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:43.133294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a6ccce01-9ddb-4fef-be04-2c47ab5222c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 Aug 06 12:50:43.133824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 923/1837] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:44.145517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9e390298-9d35-4293-894d-57e4409ebe6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:44.147729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9e390298-9d35-4293-894d-57e4409ebe6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:44.154426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e390298-9d35-4293-894d-57e4409ebe6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:44.154902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e390298-9d35-4293-894d-57e4409ebe6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:44.155337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e390298-9d35-4293-894d-57e4409ebe6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:44.156022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e390298-9d35-4293-894d-57e4409ebe6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:44.156513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e390298-9d35-4293-894d-57e4409ebe6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:44.156935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e390298-9d35-4293-894d-57e4409ebe6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:44.185998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9e390298-9d35-4293-894d-57e4409ebe6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Aug 06 12:50:44.186537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 915/1838] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:45.198133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d1d1d991-d213-4852-bcd5-325181af2064 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:45.200381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d1d1d991-d213-4852-bcd5-325181af2064 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:45.207263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1d1d991-d213-4852-bcd5-325181af2064 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:45.207740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1d1d991-d213-4852-bcd5-325181af2064 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:45.208177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1d1d991-d213-4852-bcd5-325181af2064 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:45.208882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1d1d991-d213-4852-bcd5-325181af2064 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:45.209334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1d1d991-d213-4852-bcd5-325181af2064 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:45.209752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1d1d991-d213-4852-bcd5-325181af2064 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:45.238536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d1d1d991-d213-4852-bcd5-325181af2064 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 Aug 06 12:50:45.239086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 924/1839] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:46.250657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9dbd8225-04e9-4112-bceb-49de970f1785 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:46.253145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9dbd8225-04e9-4112-bceb-49de970f1785 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:46.259514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dbd8225-04e9-4112-bceb-49de970f1785 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:46.259997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dbd8225-04e9-4112-bceb-49de970f1785 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:46.260465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dbd8225-04e9-4112-bceb-49de970f1785 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:46.261161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dbd8225-04e9-4112-bceb-49de970f1785 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:46.261611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dbd8225-04e9-4112-bceb-49de970f1785 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:46.262031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dbd8225-04e9-4112-bceb-49de970f1785 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:46.290460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9dbd8225-04e9-4112-bceb-49de970f1785 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Aug 06 12:50:46.291015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 916/1840] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:47.302949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0d639a91-93ee-43e7-9e0c-807547215549 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:47.305167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0d639a91-93ee-43e7-9e0c-807547215549 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:47.311566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d639a91-93ee-43e7-9e0c-807547215549 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:47.312055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d639a91-93ee-43e7-9e0c-807547215549 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:47.312520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d639a91-93ee-43e7-9e0c-807547215549 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:47.313229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d639a91-93ee-43e7-9e0c-807547215549 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:47.313683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d639a91-93ee-43e7-9e0c-807547215549 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:47.314107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d639a91-93ee-43e7-9e0c-807547215549 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:47.344886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0d639a91-93ee-43e7-9e0c-807547215549 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046580 Aug 06 12:50:47.345463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 925/1841] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:48.356962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-809ac36f-e00e-497e-9ca6-ded960a438b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:48.359187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-809ac36f-e00e-497e-9ca6-ded960a438b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:48.361775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=34 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:50:48.367348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-809ac36f-e00e-497e-9ca6-ded960a438b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:48.367833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-809ac36f-e00e-497e-9ca6-ded960a438b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:48.368268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-809ac36f-e00e-497e-9ca6-ded960a438b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:48.368976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-809ac36f-e00e-497e-9ca6-ded960a438b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:48.369428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-809ac36f-e00e-497e-9ca6-ded960a438b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:48.369854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-809ac36f-e00e-497e-9ca6-ded960a438b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:48.398243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-809ac36f-e00e-497e-9ca6-ded960a438b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045210 Aug 06 12:50:48.398781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 917/1842] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:49.409310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-678ab2b5-42ec-48b4-8c66-63cd5783c837 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:49.411895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-678ab2b5-42ec-48b4-8c66-63cd5783c837 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:49.414174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=36 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:50:49.419613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-678ab2b5-42ec-48b4-8c66-63cd5783c837 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:49.420077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-678ab2b5-42ec-48b4-8c66-63cd5783c837 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:49.420530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-678ab2b5-42ec-48b4-8c66-63cd5783c837 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:49.421200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-678ab2b5-42ec-48b4-8c66-63cd5783c837 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:49.421642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-678ab2b5-42ec-48b4-8c66-63cd5783c837 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:49.422055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-678ab2b5-42ec-48b4-8c66-63cd5783c837 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:49.450371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-678ab2b5-42ec-48b4-8c66-63cd5783c837 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044865 Aug 06 12:50:49.450843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 926/1843] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:50.462211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2b966c4e-4f91-491f-a600-403457510a8b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:50.464361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2b966c4e-4f91-491f-a600-403457510a8b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:50.470705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b966c4e-4f91-491f-a600-403457510a8b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:50.471189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b966c4e-4f91-491f-a600-403457510a8b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:50.471625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b966c4e-4f91-491f-a600-403457510a8b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:50.472344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b966c4e-4f91-491f-a600-403457510a8b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:50.472802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b966c4e-4f91-491f-a600-403457510a8b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:50.473221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b966c4e-4f91-491f-a600-403457510a8b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:50.501938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2b966c4e-4f91-491f-a600-403457510a8b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043637 Aug 06 12:50:50.502481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 918/1844] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:51.513455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-87b4e7ae-4be8-44dc-ac4b-10b06a85180e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:51.515565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-87b4e7ae-4be8-44dc-ac4b-10b06a85180e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:51.522528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87b4e7ae-4be8-44dc-ac4b-10b06a85180e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:51.523011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87b4e7ae-4be8-44dc-ac4b-10b06a85180e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:51.523442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87b4e7ae-4be8-44dc-ac4b-10b06a85180e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:51.524121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87b4e7ae-4be8-44dc-ac4b-10b06a85180e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:51.524601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87b4e7ae-4be8-44dc-ac4b-10b06a85180e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:51.525023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87b4e7ae-4be8-44dc-ac4b-10b06a85180e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:51.552747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-87b4e7ae-4be8-44dc-ac4b-10b06a85180e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Aug 06 12:50:51.553286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 927/1845] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:52.564585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e97d27e2-fff2-49e1-8e0c-db6be4fbf0b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:52.566690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e97d27e2-fff2-49e1-8e0c-db6be4fbf0b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:52.572981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e97d27e2-fff2-49e1-8e0c-db6be4fbf0b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:52.573462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e97d27e2-fff2-49e1-8e0c-db6be4fbf0b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:52.573889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e97d27e2-fff2-49e1-8e0c-db6be4fbf0b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:52.574570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e97d27e2-fff2-49e1-8e0c-db6be4fbf0b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:52.575013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e97d27e2-fff2-49e1-8e0c-db6be4fbf0b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:52.575434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e97d27e2-fff2-49e1-8e0c-db6be4fbf0b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:52.604100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e97d27e2-fff2-49e1-8e0c-db6be4fbf0b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Aug 06 12:50:52.604668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 919/1846] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:53.616873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-12e90784-e351-4785-87ea-fd15be90d4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:53.619011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-12e90784-e351-4785-87ea-fd15be90d4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:53.625480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12e90784-e351-4785-87ea-fd15be90d4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:53.625949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12e90784-e351-4785-87ea-fd15be90d4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:53.626373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12e90784-e351-4785-87ea-fd15be90d4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:53.627040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12e90784-e351-4785-87ea-fd15be90d4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:53.627481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12e90784-e351-4785-87ea-fd15be90d4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:53.627893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12e90784-e351-4785-87ea-fd15be90d4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:53.656513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-12e90784-e351-4785-87ea-fd15be90d4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Aug 06 12:50:53.657056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 928/1847] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:54.669223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db4e6023-4fa1-4fcb-bc78-beb560cef236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:54.671299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db4e6023-4fa1-4fcb-bc78-beb560cef236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:54.677682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db4e6023-4fa1-4fcb-bc78-beb560cef236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:54.678158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db4e6023-4fa1-4fcb-bc78-beb560cef236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:54.678592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db4e6023-4fa1-4fcb-bc78-beb560cef236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:54.679818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db4e6023-4fa1-4fcb-bc78-beb560cef236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:54.680558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db4e6023-4fa1-4fcb-bc78-beb560cef236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:54.680982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db4e6023-4fa1-4fcb-bc78-beb560cef236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:54.711525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db4e6023-4fa1-4fcb-bc78-beb560cef236 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046248 Aug 06 12:50:54.712074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 920/1848] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:55.723639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-800f8c35-3830-42c8-9428-590d42f11015 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:55.725709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-800f8c35-3830-42c8-9428-590d42f11015 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:55.732050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-800f8c35-3830-42c8-9428-590d42f11015 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:55.732565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-800f8c35-3830-42c8-9428-590d42f11015 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:55.732993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-800f8c35-3830-42c8-9428-590d42f11015 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:55.733665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-800f8c35-3830-42c8-9428-590d42f11015 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:55.734107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-800f8c35-3830-42c8-9428-590d42f11015 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:55.734521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-800f8c35-3830-42c8-9428-590d42f11015 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:55.738244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=87 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:50:55.762817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-800f8c35-3830-42c8-9428-590d42f11015 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043719 Aug 06 12:50:55.763349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 929/1849] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:56.774308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5817362a-8928-4718-9752-546b745ad977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:56.776449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5817362a-8928-4718-9752-546b745ad977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:56.782716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5817362a-8928-4718-9752-546b745ad977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:56.783186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5817362a-8928-4718-9752-546b745ad977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:56.783614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5817362a-8928-4718-9752-546b745ad977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:56.784886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5817362a-8928-4718-9752-546b745ad977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:56.785334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5817362a-8928-4718-9752-546b745ad977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:56.785751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5817362a-8928-4718-9752-546b745ad977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:56.813860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5817362a-8928-4718-9752-546b745ad977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 Aug 06 12:50:56.814335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 921/1850] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:57.825846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a0853920-564e-4a2b-a880-af525af9c3e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:57.827994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a0853920-564e-4a2b-a880-af525af9c3e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:57.834373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0853920-564e-4a2b-a880-af525af9c3e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:57.834853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0853920-564e-4a2b-a880-af525af9c3e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:57.835287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0853920-564e-4a2b-a880-af525af9c3e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:57.835967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0853920-564e-4a2b-a880-af525af9c3e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:57.836443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0853920-564e-4a2b-a880-af525af9c3e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:57.836863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0853920-564e-4a2b-a880-af525af9c3e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:57.865403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a0853920-564e-4a2b-a880-af525af9c3e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Aug 06 12:50:57.865944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 930/1851] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:58.877407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dde57f38-83cf-46db-9935-1fe87a0d153c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:58.879492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dde57f38-83cf-46db-9935-1fe87a0d153c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:58.885794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dde57f38-83cf-46db-9935-1fe87a0d153c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:58.886269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dde57f38-83cf-46db-9935-1fe87a0d153c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:58.886699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dde57f38-83cf-46db-9935-1fe87a0d153c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:58.887378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dde57f38-83cf-46db-9935-1fe87a0d153c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:58.887868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dde57f38-83cf-46db-9935-1fe87a0d153c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:58.888265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dde57f38-83cf-46db-9935-1fe87a0d153c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:58.917085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dde57f38-83cf-46db-9935-1fe87a0d153c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043661 Aug 06 12:50:58.917622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 922/1852] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:50:59.929671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-788d4a34-7340-4acd-a058-a61da068b1f1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:50:59.931785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-788d4a34-7340-4acd-a058-a61da068b1f1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:50:59.938020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-788d4a34-7340-4acd-a058-a61da068b1f1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:59.938492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-788d4a34-7340-4acd-a058-a61da068b1f1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:59.938916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-788d4a34-7340-4acd-a058-a61da068b1f1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:59.939588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-788d4a34-7340-4acd-a058-a61da068b1f1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:50:59.940031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-788d4a34-7340-4acd-a058-a61da068b1f1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:50:59.940490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-788d4a34-7340-4acd-a058-a61da068b1f1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:50:59.967885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-788d4a34-7340-4acd-a058-a61da068b1f1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042786 Aug 06 12:50:59.968447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 931/1853] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:50:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:00.982900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b991726e-ac97-4b0e-ac9a-e6d7e77a5468 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:00.986361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b991726e-ac97-4b0e-ac9a-e6d7e77a5468 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:00.996070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b991726e-ac97-4b0e-ac9a-e6d7e77a5468 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:00.996811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b991726e-ac97-4b0e-ac9a-e6d7e77a5468 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:00.997454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b991726e-ac97-4b0e-ac9a-e6d7e77a5468 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:00.998499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b991726e-ac97-4b0e-ac9a-e6d7e77a5468 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:00.999181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b991726e-ac97-4b0e-ac9a-e6d7e77a5468 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:01.000225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b991726e-ac97-4b0e-ac9a-e6d7e77a5468 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:01.034439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b991726e-ac97-4b0e-ac9a-e6d7e77a5468 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057482 Aug 06 12:51:01.035300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 923/1854] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:02.046975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e723276e-7236-45b8-8e50-19cb9cc82fe4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:02.049063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e723276e-7236-45b8-8e50-19cb9cc82fe4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:02.055416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e723276e-7236-45b8-8e50-19cb9cc82fe4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:02.055897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e723276e-7236-45b8-8e50-19cb9cc82fe4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:02.056350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e723276e-7236-45b8-8e50-19cb9cc82fe4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:02.057033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e723276e-7236-45b8-8e50-19cb9cc82fe4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:02.057479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e723276e-7236-45b8-8e50-19cb9cc82fe4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:02.057897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e723276e-7236-45b8-8e50-19cb9cc82fe4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:02.086950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e723276e-7236-45b8-8e50-19cb9cc82fe4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043925 Aug 06 12:51:02.087500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 932/1855] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:03.099725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad3b825b-6c0c-4356-bf63-6fd796a03f03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:03.101830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad3b825b-6c0c-4356-bf63-6fd796a03f03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:03.107817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad3b825b-6c0c-4356-bf63-6fd796a03f03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:03.108315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad3b825b-6c0c-4356-bf63-6fd796a03f03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:03.108770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad3b825b-6c0c-4356-bf63-6fd796a03f03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:03.109459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad3b825b-6c0c-4356-bf63-6fd796a03f03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:03.109916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad3b825b-6c0c-4356-bf63-6fd796a03f03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:03.110338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad3b825b-6c0c-4356-bf63-6fd796a03f03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:03.138693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad3b825b-6c0c-4356-bf63-6fd796a03f03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Aug 06 12:51:03.139235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 924/1856] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:04.150732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fe7d74fc-dc09-43bd-ad66-e41b5e344585 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:04.152910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fe7d74fc-dc09-43bd-ad66-e41b5e344585 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:04.159828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe7d74fc-dc09-43bd-ad66-e41b5e344585 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:04.160324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe7d74fc-dc09-43bd-ad66-e41b5e344585 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:04.160749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe7d74fc-dc09-43bd-ad66-e41b5e344585 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:04.161421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe7d74fc-dc09-43bd-ad66-e41b5e344585 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:04.161862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe7d74fc-dc09-43bd-ad66-e41b5e344585 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:04.162274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe7d74fc-dc09-43bd-ad66-e41b5e344585 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:04.189688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fe7d74fc-dc09-43bd-ad66-e41b5e344585 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042880 Aug 06 12:51:04.190715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 933/1857] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:05.201994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6fbf47fa-0868-4fb7-8620-df58da94bf96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:05.204136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6fbf47fa-0868-4fb7-8620-df58da94bf96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:05.210715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fbf47fa-0868-4fb7-8620-df58da94bf96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:05.211191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fbf47fa-0868-4fb7-8620-df58da94bf96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:05.211626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fbf47fa-0868-4fb7-8620-df58da94bf96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:05.212321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fbf47fa-0868-4fb7-8620-df58da94bf96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:05.212786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fbf47fa-0868-4fb7-8620-df58da94bf96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:05.213214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fbf47fa-0868-4fb7-8620-df58da94bf96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:05.242692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6fbf47fa-0868-4fb7-8620-df58da94bf96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Aug 06 12:51:05.243177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 925/1858] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:06.255588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a4965f6-57e0-42db-9bfd-39a7d11bf0b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:06.257836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0a4965f6-57e0-42db-9bfd-39a7d11bf0b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:06.264968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a4965f6-57e0-42db-9bfd-39a7d11bf0b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:06.265447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a4965f6-57e0-42db-9bfd-39a7d11bf0b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:06.265878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a4965f6-57e0-42db-9bfd-39a7d11bf0b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:06.266561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a4965f6-57e0-42db-9bfd-39a7d11bf0b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:06.267002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a4965f6-57e0-42db-9bfd-39a7d11bf0b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:06.267444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a4965f6-57e0-42db-9bfd-39a7d11bf0b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:06.301870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0a4965f6-57e0-42db-9bfd-39a7d11bf0b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050925 Aug 06 12:51:06.302428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 934/1859] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:07.313920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3aed3f5a-5c55-4d02-a148-b5cc360b903d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:07.316638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3aed3f5a-5c55-4d02-a148-b5cc360b903d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:07.322979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aed3f5a-5c55-4d02-a148-b5cc360b903d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:07.323455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aed3f5a-5c55-4d02-a148-b5cc360b903d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:07.323913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aed3f5a-5c55-4d02-a148-b5cc360b903d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:07.324626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aed3f5a-5c55-4d02-a148-b5cc360b903d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:07.325077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aed3f5a-5c55-4d02-a148-b5cc360b903d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:07.325497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aed3f5a-5c55-4d02-a148-b5cc360b903d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:07.327809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=89 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:51:07.355444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3aed3f5a-5c55-4d02-a148-b5cc360b903d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Aug 06 12:51:07.355992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 926/1860] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:08.367296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2955c3e9-ac25-41b2-a977-2f5c8ac85b6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:08.369496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2955c3e9-ac25-41b2-a977-2f5c8ac85b6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:08.375782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2955c3e9-ac25-41b2-a977-2f5c8ac85b6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:08.376262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2955c3e9-ac25-41b2-a977-2f5c8ac85b6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:08.376733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2955c3e9-ac25-41b2-a977-2f5c8ac85b6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:08.377419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2955c3e9-ac25-41b2-a977-2f5c8ac85b6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:08.377870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2955c3e9-ac25-41b2-a977-2f5c8ac85b6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:08.378294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2955c3e9-ac25-41b2-a977-2f5c8ac85b6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:08.407689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2955c3e9-ac25-41b2-a977-2f5c8ac85b6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Aug 06 12:51:08.408429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 935/1861] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:08 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:09.420355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-966ea1b4-fe08-4047-bd52-8bfc3fc405f3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:09.422524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-966ea1b4-fe08-4047-bd52-8bfc3fc405f3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:09.429411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966ea1b4-fe08-4047-bd52-8bfc3fc405f3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:09.429889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966ea1b4-fe08-4047-bd52-8bfc3fc405f3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:09.430313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966ea1b4-fe08-4047-bd52-8bfc3fc405f3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:09.430987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966ea1b4-fe08-4047-bd52-8bfc3fc405f3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:09.431458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966ea1b4-fe08-4047-bd52-8bfc3fc405f3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:09.431873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-966ea1b4-fe08-4047-bd52-8bfc3fc405f3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:09.460381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-966ea1b4-fe08-4047-bd52-8bfc3fc405f3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043878 Aug 06 12:51:09.460938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 927/1862] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:10.471783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d541629d-5b0b-415d-8b2f-3cadbeedb8f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:10.473979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d541629d-5b0b-415d-8b2f-3cadbeedb8f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:10.480282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d541629d-5b0b-415d-8b2f-3cadbeedb8f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:10.480779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d541629d-5b0b-415d-8b2f-3cadbeedb8f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:10.481204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d541629d-5b0b-415d-8b2f-3cadbeedb8f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:10.481882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d541629d-5b0b-415d-8b2f-3cadbeedb8f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:10.482324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d541629d-5b0b-415d-8b2f-3cadbeedb8f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:10.482755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d541629d-5b0b-415d-8b2f-3cadbeedb8f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:10.511346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d541629d-5b0b-415d-8b2f-3cadbeedb8f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043335 Aug 06 12:51:10.511827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 936/1863] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:11.523772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4f8f9b90-dbef-41e0-b40b-1a21c08073c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:11.525964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4f8f9b90-dbef-41e0-b40b-1a21c08073c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:11.532268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f8f9b90-dbef-41e0-b40b-1a21c08073c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:11.532779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f8f9b90-dbef-41e0-b40b-1a21c08073c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:11.533215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f8f9b90-dbef-41e0-b40b-1a21c08073c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:11.534459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f8f9b90-dbef-41e0-b40b-1a21c08073c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:11.534909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f8f9b90-dbef-41e0-b40b-1a21c08073c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:11.535334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f8f9b90-dbef-41e0-b40b-1a21c08073c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:11.562977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4f8f9b90-dbef-41e0-b40b-1a21c08073c5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043156 Aug 06 12:51:11.563469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 928/1864] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:12.575138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f438335e-676f-44ce-ac4d-1f70262dbc97 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:12.577914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f438335e-676f-44ce-ac4d-1f70262dbc97 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:12.584229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f438335e-676f-44ce-ac4d-1f70262dbc97 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:12.584747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f438335e-676f-44ce-ac4d-1f70262dbc97 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:12.585177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f438335e-676f-44ce-ac4d-1f70262dbc97 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:12.585865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f438335e-676f-44ce-ac4d-1f70262dbc97 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:12.586311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f438335e-676f-44ce-ac4d-1f70262dbc97 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:12.586734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f438335e-676f-44ce-ac4d-1f70262dbc97 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:12.616295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f438335e-676f-44ce-ac4d-1f70262dbc97 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045246 Aug 06 12:51:12.616815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 937/1865] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:13.628736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-390cb201-4ce2-4ec5-a032-f9b13fc069cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:13.630878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-390cb201-4ce2-4ec5-a032-f9b13fc069cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:13.636992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390cb201-4ce2-4ec5-a032-f9b13fc069cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:13.637478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390cb201-4ce2-4ec5-a032-f9b13fc069cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:13.637918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390cb201-4ce2-4ec5-a032-f9b13fc069cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:13.638613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390cb201-4ce2-4ec5-a032-f9b13fc069cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:13.639071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390cb201-4ce2-4ec5-a032-f9b13fc069cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:13.639498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-390cb201-4ce2-4ec5-a032-f9b13fc069cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:13.667584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-390cb201-4ce2-4ec5-a032-f9b13fc069cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043337 Aug 06 12:51:13.668133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 929/1866] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:14.681751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b683ca36-94b3-4800-8be1-26c2c9afb0c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:14.684606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b683ca36-94b3-4800-8be1-26c2c9afb0c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:14.692355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b683ca36-94b3-4800-8be1-26c2c9afb0c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:14.692836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b683ca36-94b3-4800-8be1-26c2c9afb0c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:14.693262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b683ca36-94b3-4800-8be1-26c2c9afb0c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:14.693948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b683ca36-94b3-4800-8be1-26c2c9afb0c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:14.694396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b683ca36-94b3-4800-8be1-26c2c9afb0c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:14.694812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b683ca36-94b3-4800-8be1-26c2c9afb0c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:14.723559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b683ca36-94b3-4800-8be1-26c2c9afb0c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047668 Aug 06 12:51:14.724093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 938/1867] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:15.735030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-021ea96e-399c-4bca-960c-1591d6cb5697 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:15.738117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-021ea96e-399c-4bca-960c-1591d6cb5697 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:15.744485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-021ea96e-399c-4bca-960c-1591d6cb5697 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:15.744970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-021ea96e-399c-4bca-960c-1591d6cb5697 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:15.745408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-021ea96e-399c-4bca-960c-1591d6cb5697 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:15.746101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-021ea96e-399c-4bca-960c-1591d6cb5697 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:15.746558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-021ea96e-399c-4bca-960c-1591d6cb5697 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:15.746981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-021ea96e-399c-4bca-960c-1591d6cb5697 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:15.775123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-021ea96e-399c-4bca-960c-1591d6cb5697 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 Aug 06 12:51:15.775666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 930/1868] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:15 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:16.787097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-048300b8-104e-476b-b011-06b651341b3b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:16.789324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-048300b8-104e-476b-b011-06b651341b3b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:16.795340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-048300b8-104e-476b-b011-06b651341b3b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:16.795834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-048300b8-104e-476b-b011-06b651341b3b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:16.796272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-048300b8-104e-476b-b011-06b651341b3b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:16.797007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-048300b8-104e-476b-b011-06b651341b3b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:16.797471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-048300b8-104e-476b-b011-06b651341b3b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:16.798115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-048300b8-104e-476b-b011-06b651341b3b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:16.828000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-048300b8-104e-476b-b011-06b651341b3b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044978 Aug 06 12:51:16.828576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 939/1869] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:17.838868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-88677566-a53f-4cbf-a81e-2f0ce92ff2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:17.841060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-88677566-a53f-4cbf-a81e-2f0ce92ff2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:17.847264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88677566-a53f-4cbf-a81e-2f0ce92ff2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:17.847752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88677566-a53f-4cbf-a81e-2f0ce92ff2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:17.848178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88677566-a53f-4cbf-a81e-2f0ce92ff2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:17.848911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88677566-a53f-4cbf-a81e-2f0ce92ff2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:17.849364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88677566-a53f-4cbf-a81e-2f0ce92ff2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:17.849786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88677566-a53f-4cbf-a81e-2f0ce92ff2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:17.879836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-88677566-a53f-4cbf-a81e-2f0ce92ff2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Aug 06 12:51:17.880409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 931/1870] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:18.892157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-38bdad21-bcce-45f9-b190-572264c71b54 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:18.895096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-38bdad21-bcce-45f9-b190-572264c71b54 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:18.901592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38bdad21-bcce-45f9-b190-572264c71b54 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:18.902261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38bdad21-bcce-45f9-b190-572264c71b54 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:18.902690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38bdad21-bcce-45f9-b190-572264c71b54 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:18.903373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38bdad21-bcce-45f9-b190-572264c71b54 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:18.903813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38bdad21-bcce-45f9-b190-572264c71b54 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:18.904225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38bdad21-bcce-45f9-b190-572264c71b54 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:18.935384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-38bdad21-bcce-45f9-b190-572264c71b54 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047145 Aug 06 12:51:18.936220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 940/1871] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:18 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:19.947081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-81dd61ae-8215-4029-90f9-b0d6838a2804 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:19.949230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-81dd61ae-8215-4029-90f9-b0d6838a2804 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:19.951540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=30 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:51:19.956490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81dd61ae-8215-4029-90f9-b0d6838a2804 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:19.957051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81dd61ae-8215-4029-90f9-b0d6838a2804 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:19.957496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81dd61ae-8215-4029-90f9-b0d6838a2804 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:19.958193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81dd61ae-8215-4029-90f9-b0d6838a2804 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:19.958648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81dd61ae-8215-4029-90f9-b0d6838a2804 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:19.959072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81dd61ae-8215-4029-90f9-b0d6838a2804 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:19.989513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-81dd61ae-8215-4029-90f9-b0d6838a2804 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046325 Aug 06 12:51:19.990072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 932/1872] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:21.001426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d74de54c-ea45-4683-8e17-022ce17f4322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:21.005196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d74de54c-ea45-4683-8e17-022ce17f4322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:21.007527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=30 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:51:21.012815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d74de54c-ea45-4683-8e17-022ce17f4322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:21.013293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d74de54c-ea45-4683-8e17-022ce17f4322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:21.013726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d74de54c-ea45-4683-8e17-022ce17f4322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:21.014412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d74de54c-ea45-4683-8e17-022ce17f4322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:21.014860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d74de54c-ea45-4683-8e17-022ce17f4322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:21.015282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d74de54c-ea45-4683-8e17-022ce17f4322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:21.045253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d74de54c-ea45-4683-8e17-022ce17f4322 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047661 Aug 06 12:51:21.045798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 941/1873] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:22.057531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-facdf5cd-8cd0-435d-812c-b034019c68b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:22.059662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-facdf5cd-8cd0-435d-812c-b034019c68b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:22.065995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-facdf5cd-8cd0-435d-812c-b034019c68b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:22.066473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-facdf5cd-8cd0-435d-812c-b034019c68b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:22.066905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-facdf5cd-8cd0-435d-812c-b034019c68b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:22.067601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-facdf5cd-8cd0-435d-812c-b034019c68b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:22.068046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-facdf5cd-8cd0-435d-812c-b034019c68b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:22.068491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-facdf5cd-8cd0-435d-812c-b034019c68b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:22.102784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-facdf5cd-8cd0-435d-812c-b034019c68b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049085 Aug 06 12:51:22.103769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 933/1874] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:23.115460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-17fc1fa5-b007-474e-b258-34d557d33b7f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:23.117884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-17fc1fa5-b007-474e-b258-34d557d33b7f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:23.125607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17fc1fa5-b007-474e-b258-34d557d33b7f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:23.126082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17fc1fa5-b007-474e-b258-34d557d33b7f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:23.126510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17fc1fa5-b007-474e-b258-34d557d33b7f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:23.127229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17fc1fa5-b007-474e-b258-34d557d33b7f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:23.127680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17fc1fa5-b007-474e-b258-34d557d33b7f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:23.128101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17fc1fa5-b007-474e-b258-34d557d33b7f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:23.157379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-17fc1fa5-b007-474e-b258-34d557d33b7f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 Aug 06 12:51:23.157913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 942/1875] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:24.257320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6a232baf-cb36-4fa5-b48e-e51f1b5c60d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:24.259693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6a232baf-cb36-4fa5-b48e-e51f1b5c60d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:24.265576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a232baf-cb36-4fa5-b48e-e51f1b5c60d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:24.266070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a232baf-cb36-4fa5-b48e-e51f1b5c60d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:24.266508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a232baf-cb36-4fa5-b48e-e51f1b5c60d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:24.267208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a232baf-cb36-4fa5-b48e-e51f1b5c60d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:24.267696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a232baf-cb36-4fa5-b48e-e51f1b5c60d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:24.268124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a232baf-cb36-4fa5-b48e-e51f1b5c60d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:24.296472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6a232baf-cb36-4fa5-b48e-e51f1b5c60d0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130593 Aug 06 12:51:24.297024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 934/1876] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:25.308887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-11bb6097-a1b8-4292-8adc-12e6575cc7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:25.311116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-11bb6097-a1b8-4292-8adc-12e6575cc7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:25.318448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11bb6097-a1b8-4292-8adc-12e6575cc7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:25.318922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11bb6097-a1b8-4292-8adc-12e6575cc7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:25.319350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11bb6097-a1b8-4292-8adc-12e6575cc7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:25.320032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11bb6097-a1b8-4292-8adc-12e6575cc7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:25.320501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11bb6097-a1b8-4292-8adc-12e6575cc7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:25.320915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11bb6097-a1b8-4292-8adc-12e6575cc7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:25.351177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-11bb6097-a1b8-4292-8adc-12e6575cc7ac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046172 Aug 06 12:51:25.351727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 943/1877] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:26.364211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dab4e7b1-b98f-40ed-8c32-00d8711f2819 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:26.366851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dab4e7b1-b98f-40ed-8c32-00d8711f2819 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:26.374298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dab4e7b1-b98f-40ed-8c32-00d8711f2819 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:26.374782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dab4e7b1-b98f-40ed-8c32-00d8711f2819 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:26.375221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dab4e7b1-b98f-40ed-8c32-00d8711f2819 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:26.375919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dab4e7b1-b98f-40ed-8c32-00d8711f2819 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:26.376401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dab4e7b1-b98f-40ed-8c32-00d8711f2819 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:26.377117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dab4e7b1-b98f-40ed-8c32-00d8711f2819 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:26.406574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dab4e7b1-b98f-40ed-8c32-00d8711f2819 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047459 Aug 06 12:51:26.407131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 935/1878] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:27.418998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7e3f2549-83a0-4f1e-ad0f-06376c8570d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:27.421169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7e3f2549-83a0-4f1e-ad0f-06376c8570d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:27.427617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e3f2549-83a0-4f1e-ad0f-06376c8570d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:27.428098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e3f2549-83a0-4f1e-ad0f-06376c8570d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:27.428561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e3f2549-83a0-4f1e-ad0f-06376c8570d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:27.429254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e3f2549-83a0-4f1e-ad0f-06376c8570d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:27.430004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e3f2549-83a0-4f1e-ad0f-06376c8570d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:27.430429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e3f2549-83a0-4f1e-ad0f-06376c8570d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:27.433981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=90 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:51:27.460738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7e3f2549-83a0-4f1e-ad0f-06376c8570d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045647 Aug 06 12:51:27.461294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 944/1879] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:28.473182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dfef8644-dcaf-4607-bc43-afcd63779cad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:28.475268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dfef8644-dcaf-4607-bc43-afcd63779cad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:28.481708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfef8644-dcaf-4607-bc43-afcd63779cad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:28.482188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfef8644-dcaf-4607-bc43-afcd63779cad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:28.482630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfef8644-dcaf-4607-bc43-afcd63779cad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:28.483319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfef8644-dcaf-4607-bc43-afcd63779cad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:28.483770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfef8644-dcaf-4607-bc43-afcd63779cad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:28.484190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfef8644-dcaf-4607-bc43-afcd63779cad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:28.513374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dfef8644-dcaf-4607-bc43-afcd63779cad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Aug 06 12:51:28.513929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 936/1880] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:28 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:29.525926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7192befb-7eda-4ea8-8c1b-139eca1f160e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:29.528166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7192befb-7eda-4ea8-8c1b-139eca1f160e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:29.535083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7192befb-7eda-4ea8-8c1b-139eca1f160e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:29.535576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7192befb-7eda-4ea8-8c1b-139eca1f160e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:29.536008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7192befb-7eda-4ea8-8c1b-139eca1f160e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:29.536933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7192befb-7eda-4ea8-8c1b-139eca1f160e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:29.537396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7192befb-7eda-4ea8-8c1b-139eca1f160e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:29.537817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7192befb-7eda-4ea8-8c1b-139eca1f160e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:29.571581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7192befb-7eda-4ea8-8c1b-139eca1f160e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049608 Aug 06 12:51:29.572159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 945/1881] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:30.584139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-327d778a-20ef-4ed1-a37d-74c8cdf08b72 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:30.586347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-327d778a-20ef-4ed1-a37d-74c8cdf08b72 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:30.592687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327d778a-20ef-4ed1-a37d-74c8cdf08b72 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:30.593279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327d778a-20ef-4ed1-a37d-74c8cdf08b72 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:30.593696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327d778a-20ef-4ed1-a37d-74c8cdf08b72 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:30.594263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327d778a-20ef-4ed1-a37d-74c8cdf08b72 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:30.594716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327d778a-20ef-4ed1-a37d-74c8cdf08b72 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:30.595138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327d778a-20ef-4ed1-a37d-74c8cdf08b72 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:30.624443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-327d778a-20ef-4ed1-a37d-74c8cdf08b72 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Aug 06 12:51:30.625010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 937/1882] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:31.636738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5d3351d8-4960-4438-bb23-303617d5f6c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:31.638934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5d3351d8-4960-4438-bb23-303617d5f6c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:31.646227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d3351d8-4960-4438-bb23-303617d5f6c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:31.646639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d3351d8-4960-4438-bb23-303617d5f6c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:31.647079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d3351d8-4960-4438-bb23-303617d5f6c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:31.648100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d3351d8-4960-4438-bb23-303617d5f6c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:31.648967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d3351d8-4960-4438-bb23-303617d5f6c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:31.649645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d3351d8-4960-4438-bb23-303617d5f6c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:31.680060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5d3351d8-4960-4438-bb23-303617d5f6c2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047349 Aug 06 12:51:31.680650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 946/1883] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:32.692068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-415a73d3-bb36-4bea-95d1-fad6931f21ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:32.694195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-415a73d3-bb36-4bea-95d1-fad6931f21ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:32.700448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-415a73d3-bb36-4bea-95d1-fad6931f21ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:32.700928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-415a73d3-bb36-4bea-95d1-fad6931f21ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:32.701354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-415a73d3-bb36-4bea-95d1-fad6931f21ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:32.702026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-415a73d3-bb36-4bea-95d1-fad6931f21ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:32.702474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-415a73d3-bb36-4bea-95d1-fad6931f21ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:32.702945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-415a73d3-bb36-4bea-95d1-fad6931f21ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:32.731525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-415a73d3-bb36-4bea-95d1-fad6931f21ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043338 Aug 06 12:51:32.732075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 938/1884] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:33.744561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4a83a9ca-b6fe-49bc-a27f-50c3fc7ebace tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:33.746678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4a83a9ca-b6fe-49bc-a27f-50c3fc7ebace tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:33.753582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a83a9ca-b6fe-49bc-a27f-50c3fc7ebace tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:33.754054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a83a9ca-b6fe-49bc-a27f-50c3fc7ebace tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:33.754480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a83a9ca-b6fe-49bc-a27f-50c3fc7ebace tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:33.755147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a83a9ca-b6fe-49bc-a27f-50c3fc7ebace tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:33.755589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a83a9ca-b6fe-49bc-a27f-50c3fc7ebace tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:33.756002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a83a9ca-b6fe-49bc-a27f-50c3fc7ebace tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:33.785252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4a83a9ca-b6fe-49bc-a27f-50c3fc7ebace tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Aug 06 12:51:33.785804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 947/1885] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:34.796483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f77651cf-b0e2-4baa-8453-eed345564274 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:34.798658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f77651cf-b0e2-4baa-8453-eed345564274 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:34.804737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f77651cf-b0e2-4baa-8453-eed345564274 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:34.805226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f77651cf-b0e2-4baa-8453-eed345564274 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:34.805662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f77651cf-b0e2-4baa-8453-eed345564274 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:34.806351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f77651cf-b0e2-4baa-8453-eed345564274 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:34.806803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f77651cf-b0e2-4baa-8453-eed345564274 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:34.807228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f77651cf-b0e2-4baa-8453-eed345564274 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:34.838546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f77651cf-b0e2-4baa-8453-eed345564274 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045920 Aug 06 12:51:34.839053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 939/1886] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:35.852130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ef4c7e97-0f9d-46cb-8c22-6bae21bbcba9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:35.854319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ef4c7e97-0f9d-46cb-8c22-6bae21bbcba9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:35.861524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4c7e97-0f9d-46cb-8c22-6bae21bbcba9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:35.862019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4c7e97-0f9d-46cb-8c22-6bae21bbcba9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:35.862538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4c7e97-0f9d-46cb-8c22-6bae21bbcba9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:35.863223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4c7e97-0f9d-46cb-8c22-6bae21bbcba9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:35.863670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4c7e97-0f9d-46cb-8c22-6bae21bbcba9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:35.864090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4c7e97-0f9d-46cb-8c22-6bae21bbcba9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:35.892857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ef4c7e97-0f9d-46cb-8c22-6bae21bbcba9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Aug 06 12:51:35.893351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 948/1887] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:35 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:36.905225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-652b1771-7026-4775-9703-703d58d70832 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:36.907328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-652b1771-7026-4775-9703-703d58d70832 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:36.913727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-652b1771-7026-4775-9703-703d58d70832 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:36.914199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-652b1771-7026-4775-9703-703d58d70832 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:36.914626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-652b1771-7026-4775-9703-703d58d70832 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:36.915302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-652b1771-7026-4775-9703-703d58d70832 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:36.915747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-652b1771-7026-4775-9703-703d58d70832 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:36.916161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-652b1771-7026-4775-9703-703d58d70832 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:36.946503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-652b1771-7026-4775-9703-703d58d70832 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Aug 06 12:51:36.946983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 940/1888] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:37.958294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8f1fddd1-e909-40f7-8000-0391f00bd76a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:37.960446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8f1fddd1-e909-40f7-8000-0391f00bd76a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:37.966754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1fddd1-e909-40f7-8000-0391f00bd76a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:37.967228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1fddd1-e909-40f7-8000-0391f00bd76a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:37.967657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1fddd1-e909-40f7-8000-0391f00bd76a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:37.968363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1fddd1-e909-40f7-8000-0391f00bd76a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:37.968814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1fddd1-e909-40f7-8000-0391f00bd76a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:37.969230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f1fddd1-e909-40f7-8000-0391f00bd76a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:37.997800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8f1fddd1-e909-40f7-8000-0391f00bd76a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Aug 06 12:51:38.002678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 949/1889] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:37 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:39.009949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e6558fd8-c85f-4ecf-84b3-ded866e8ec4a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:39.012127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e6558fd8-c85f-4ecf-84b3-ded866e8ec4a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:39.018444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6558fd8-c85f-4ecf-84b3-ded866e8ec4a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:39.018917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6558fd8-c85f-4ecf-84b3-ded866e8ec4a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:39.019346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6558fd8-c85f-4ecf-84b3-ded866e8ec4a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:39.020023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6558fd8-c85f-4ecf-84b3-ded866e8ec4a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:39.020596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6558fd8-c85f-4ecf-84b3-ded866e8ec4a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:39.021015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6558fd8-c85f-4ecf-84b3-ded866e8ec4a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:39.023297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=90 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:51:39.051278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e6558fd8-c85f-4ecf-84b3-ded866e8ec4a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045174 Aug 06 12:51:39.051751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 941/1890] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:40.063070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8cb2c9e8-e878-4aee-8c1a-f79e4958cea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:40.065829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8cb2c9e8-e878-4aee-8c1a-f79e4958cea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:40.072101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cb2c9e8-e878-4aee-8c1a-f79e4958cea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:40.072605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cb2c9e8-e878-4aee-8c1a-f79e4958cea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:40.073038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cb2c9e8-e878-4aee-8c1a-f79e4958cea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:40.073716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cb2c9e8-e878-4aee-8c1a-f79e4958cea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:40.074161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cb2c9e8-e878-4aee-8c1a-f79e4958cea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:40.074579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cb2c9e8-e878-4aee-8c1a-f79e4958cea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:40.102566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8cb2c9e8-e878-4aee-8c1a-f79e4958cea8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043374 Aug 06 12:51:40.103139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 950/1891] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:41.114974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a393710a-30f2-4f97-9e23-ee9ae3236f20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:41.117176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a393710a-30f2-4f97-9e23-ee9ae3236f20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:41.123455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a393710a-30f2-4f97-9e23-ee9ae3236f20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:41.123935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a393710a-30f2-4f97-9e23-ee9ae3236f20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:41.124404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a393710a-30f2-4f97-9e23-ee9ae3236f20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:41.125092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a393710a-30f2-4f97-9e23-ee9ae3236f20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:41.125544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a393710a-30f2-4f97-9e23-ee9ae3236f20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:41.125971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a393710a-30f2-4f97-9e23-ee9ae3236f20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:41.154936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a393710a-30f2-4f97-9e23-ee9ae3236f20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Aug 06 12:51:41.155480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 942/1892] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:41 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:42.166604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c12aa660-8995-4f8b-9dd2-903dee56953c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:42.168741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c12aa660-8995-4f8b-9dd2-903dee56953c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:42.175475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c12aa660-8995-4f8b-9dd2-903dee56953c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:42.175943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c12aa660-8995-4f8b-9dd2-903dee56953c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:42.176388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c12aa660-8995-4f8b-9dd2-903dee56953c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:42.177063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c12aa660-8995-4f8b-9dd2-903dee56953c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:42.177504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c12aa660-8995-4f8b-9dd2-903dee56953c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:42.177917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c12aa660-8995-4f8b-9dd2-903dee56953c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:42.205983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c12aa660-8995-4f8b-9dd2-903dee56953c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043328 Aug 06 12:51:42.206519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 951/1893] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:42 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:51:43.217906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-73c7a526-ae31-44d1-94ec-7fe44029c4b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:43.220071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-73c7a526-ae31-44d1-94ec-7fe44029c4b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:43.226380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c7a526-ae31-44d1-94ec-7fe44029c4b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:43.226860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c7a526-ae31-44d1-94ec-7fe44029c4b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:43.227296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c7a526-ae31-44d1-94ec-7fe44029c4b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:43.227984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c7a526-ae31-44d1-94ec-7fe44029c4b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:43.228474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c7a526-ae31-44d1-94ec-7fe44029c4b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:43.228897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73c7a526-ae31-44d1-94ec-7fe44029c4b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:43.257534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-73c7a526-ae31-44d1-94ec-7fe44029c4b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Aug 06 12:51:43.258016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 943/1894] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:44.269382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9ad4ea50-0d74-4c97-b973-0aa59b6bcf78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:44.271421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9ad4ea50-0d74-4c97-b973-0aa59b6bcf78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:44.277648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad4ea50-0d74-4c97-b973-0aa59b6bcf78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:44.278121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad4ea50-0d74-4c97-b973-0aa59b6bcf78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:44.278548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad4ea50-0d74-4c97-b973-0aa59b6bcf78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:44.279219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad4ea50-0d74-4c97-b973-0aa59b6bcf78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:44.279662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad4ea50-0d74-4c97-b973-0aa59b6bcf78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:44.280075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ad4ea50-0d74-4c97-b973-0aa59b6bcf78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:44.309568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9ad4ea50-0d74-4c97-b973-0aa59b6bcf78 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Aug 06 12:51:44.310138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 952/1895] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:45.321358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-35d56194-0fc2-47fd-b5ae-90cdc121e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:45.323486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-35d56194-0fc2-47fd-b5ae-90cdc121e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:45.329857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35d56194-0fc2-47fd-b5ae-90cdc121e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:45.330336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35d56194-0fc2-47fd-b5ae-90cdc121e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:45.330770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35d56194-0fc2-47fd-b5ae-90cdc121e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:45.331452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35d56194-0fc2-47fd-b5ae-90cdc121e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:45.331905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35d56194-0fc2-47fd-b5ae-90cdc121e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:45.332344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35d56194-0fc2-47fd-b5ae-90cdc121e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:45.361724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-35d56194-0fc2-47fd-b5ae-90cdc121e2b5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044213 Aug 06 12:51:45.362279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 944/1896] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:46.373778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-47c5d469-4bf5-4db1-af26-e96b988384a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:46.376420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-47c5d469-4bf5-4db1-af26-e96b988384a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:46.382331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47c5d469-4bf5-4db1-af26-e96b988384a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:46.382810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47c5d469-4bf5-4db1-af26-e96b988384a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:46.383245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47c5d469-4bf5-4db1-af26-e96b988384a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:46.383930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47c5d469-4bf5-4db1-af26-e96b988384a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:46.384410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47c5d469-4bf5-4db1-af26-e96b988384a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:46.384833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47c5d469-4bf5-4db1-af26-e96b988384a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:46.413318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-47c5d469-4bf5-4db1-af26-e96b988384a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043625 Aug 06 12:51:46.413856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 953/1897] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:47.425236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c66c4671-546b-451d-ac14-4c61b52a4984 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:47.427435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c66c4671-546b-451d-ac14-4c61b52a4984 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:47.433812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c66c4671-546b-451d-ac14-4c61b52a4984 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:47.434284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c66c4671-546b-451d-ac14-4c61b52a4984 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:47.434711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c66c4671-546b-451d-ac14-4c61b52a4984 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:47.435384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c66c4671-546b-451d-ac14-4c61b52a4984 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:47.435830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c66c4671-546b-451d-ac14-4c61b52a4984 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:47.436247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c66c4671-546b-451d-ac14-4c61b52a4984 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:47.464860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c66c4671-546b-451d-ac14-4c61b52a4984 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043573 Aug 06 12:51:47.465407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 945/1898] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:48.478173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-58f64369-60d3-4ca9-aec1-a3f98786a0a0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:48.480290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-58f64369-60d3-4ca9-aec1-a3f98786a0a0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:48.487647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f64369-60d3-4ca9-aec1-a3f98786a0a0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:48.488124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f64369-60d3-4ca9-aec1-a3f98786a0a0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:48.488608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f64369-60d3-4ca9-aec1-a3f98786a0a0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:48.489291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f64369-60d3-4ca9-aec1-a3f98786a0a0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:48.489739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f64369-60d3-4ca9-aec1-a3f98786a0a0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:48.490156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f64369-60d3-4ca9-aec1-a3f98786a0a0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:48.517960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-58f64369-60d3-4ca9-aec1-a3f98786a0a0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Aug 06 12:51:48.518500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 954/1899] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:49.529908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dc427bd3-5363-41d6-9d68-7c7e59252949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:49.532056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dc427bd3-5363-41d6-9d68-7c7e59252949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:49.538319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc427bd3-5363-41d6-9d68-7c7e59252949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:49.538788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc427bd3-5363-41d6-9d68-7c7e59252949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:49.539215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc427bd3-5363-41d6-9d68-7c7e59252949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:49.539887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc427bd3-5363-41d6-9d68-7c7e59252949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:49.540356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc427bd3-5363-41d6-9d68-7c7e59252949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:49.540774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc427bd3-5363-41d6-9d68-7c7e59252949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:49.569824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dc427bd3-5363-41d6-9d68-7c7e59252949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 Aug 06 12:51:49.570364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 946/1900] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:50.582084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9a9db6be-707d-4f89-ab48-c57dfab09da8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:50.584206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9a9db6be-707d-4f89-ab48-c57dfab09da8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:50.590614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a9db6be-707d-4f89-ab48-c57dfab09da8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:50.591094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a9db6be-707d-4f89-ab48-c57dfab09da8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:50.591522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a9db6be-707d-4f89-ab48-c57dfab09da8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:50.592205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a9db6be-707d-4f89-ab48-c57dfab09da8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:50.592675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a9db6be-707d-4f89-ab48-c57dfab09da8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:50.593092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a9db6be-707d-4f89-ab48-c57dfab09da8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:50.622661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9a9db6be-707d-4f89-ab48-c57dfab09da8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 06 12:51:50.623217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 955/1901] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:51.634800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-78789d1d-b320-4fd5-a199-782939ec7109 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:51.637200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-78789d1d-b320-4fd5-a199-782939ec7109 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:51.639411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=30 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:51:51.644507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78789d1d-b320-4fd5-a199-782939ec7109 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:51.644985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78789d1d-b320-4fd5-a199-782939ec7109 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:51.645424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78789d1d-b320-4fd5-a199-782939ec7109 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:51.646090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78789d1d-b320-4fd5-a199-782939ec7109 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:51.646538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78789d1d-b320-4fd5-a199-782939ec7109 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:51.646957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78789d1d-b320-4fd5-a199-782939ec7109 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:51.675977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-78789d1d-b320-4fd5-a199-782939ec7109 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045226 Aug 06 12:51:51.676549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 947/1902] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:52.686841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e926d18c-b469-4072-bc73-699b0864228f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:52.689626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e926d18c-b469-4072-bc73-699b0864228f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:52.691875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=30 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:51:52.697004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e926d18c-b469-4072-bc73-699b0864228f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:52.697475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e926d18c-b469-4072-bc73-699b0864228f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:52.697898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e926d18c-b469-4072-bc73-699b0864228f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:52.698573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e926d18c-b469-4072-bc73-699b0864228f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:52.699012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e926d18c-b469-4072-bc73-699b0864228f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:52.699422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e926d18c-b469-4072-bc73-699b0864228f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:52.727241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e926d18c-b469-4072-bc73-699b0864228f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Aug 06 12:51:52.727781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 956/1903] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:53.739108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6683d596-6f10-48d7-a8ed-34aec2803f4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:53.741345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6683d596-6f10-48d7-a8ed-34aec2803f4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:53.747833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6683d596-6f10-48d7-a8ed-34aec2803f4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:53.748330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6683d596-6f10-48d7-a8ed-34aec2803f4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:53.749131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6683d596-6f10-48d7-a8ed-34aec2803f4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:53.749821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6683d596-6f10-48d7-a8ed-34aec2803f4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:53.750270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6683d596-6f10-48d7-a8ed-34aec2803f4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:53.751194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6683d596-6f10-48d7-a8ed-34aec2803f4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:53.779695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6683d596-6f10-48d7-a8ed-34aec2803f4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Aug 06 12:51:53.780241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 948/1904] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:54.790912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2aa2aaea-7dee-472a-afdb-c4923e589692 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:54.793110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2aa2aaea-7dee-472a-afdb-c4923e589692 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:54.800063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa2aaea-7dee-472a-afdb-c4923e589692 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:54.800566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa2aaea-7dee-472a-afdb-c4923e589692 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:54.800999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa2aaea-7dee-472a-afdb-c4923e589692 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:54.801673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa2aaea-7dee-472a-afdb-c4923e589692 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:54.802119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa2aaea-7dee-472a-afdb-c4923e589692 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:54.802547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa2aaea-7dee-472a-afdb-c4923e589692 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:54.832246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2aa2aaea-7dee-472a-afdb-c4923e589692 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Aug 06 12:51:54.832841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 957/1905] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:55.844225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3025a9bc-d320-4a3c-9c14-c6c6ae1f528b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:55.846378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3025a9bc-d320-4a3c-9c14-c6c6ae1f528b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:55.852688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3025a9bc-d320-4a3c-9c14-c6c6ae1f528b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:55.853163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3025a9bc-d320-4a3c-9c14-c6c6ae1f528b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:55.853591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3025a9bc-d320-4a3c-9c14-c6c6ae1f528b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:55.854271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3025a9bc-d320-4a3c-9c14-c6c6ae1f528b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:55.854720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3025a9bc-d320-4a3c-9c14-c6c6ae1f528b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:55.855140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3025a9bc-d320-4a3c-9c14-c6c6ae1f528b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:55.884559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3025a9bc-d320-4a3c-9c14-c6c6ae1f528b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 Aug 06 12:51:55.885116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 949/1906] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:56.752789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:51:56.753366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:51:56.896937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d0c1b7c5-dca7-4820-98cd-7be10072c7e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:56.899057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d0c1b7c5-dca7-4820-98cd-7be10072c7e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:56.905398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0c1b7c5-dca7-4820-98cd-7be10072c7e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:56.905877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0c1b7c5-dca7-4820-98cd-7be10072c7e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:56.906307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0c1b7c5-dca7-4820-98cd-7be10072c7e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:56.907016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0c1b7c5-dca7-4820-98cd-7be10072c7e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:56.907459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0c1b7c5-dca7-4820-98cd-7be10072c7e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:56.907876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0c1b7c5-dca7-4820-98cd-7be10072c7e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:56.938522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d0c1b7c5-dca7-4820-98cd-7be10072c7e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044833 Aug 06 12:51:56.939076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 958/1907] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:57.712786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:51:57.713270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:51:57.950941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dc94552e-6699-4718-aff5-d33e885fab13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:57.953104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dc94552e-6699-4718-aff5-d33e885fab13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:57.959502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc94552e-6699-4718-aff5-d33e885fab13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:57.959977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc94552e-6699-4718-aff5-d33e885fab13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:57.960449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc94552e-6699-4718-aff5-d33e885fab13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:57.961155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc94552e-6699-4718-aff5-d33e885fab13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:57.961601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc94552e-6699-4718-aff5-d33e885fab13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:57.962016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc94552e-6699-4718-aff5-d33e885fab13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:57.991534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dc94552e-6699-4718-aff5-d33e885fab13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Aug 06 12:51:57.992031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 950/1908] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:51:59.003577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f2984877-3308-40f0-9917-d13f17b5e3a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:51:59.005730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f2984877-3308-40f0-9917-d13f17b5e3a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:51:59.012073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2984877-3308-40f0-9917-d13f17b5e3a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:59.012584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2984877-3308-40f0-9917-d13f17b5e3a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:59.013007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2984877-3308-40f0-9917-d13f17b5e3a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:59.013681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2984877-3308-40f0-9917-d13f17b5e3a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:51:59.014119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2984877-3308-40f0-9917-d13f17b5e3a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:51:59.014530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2984877-3308-40f0-9917-d13f17b5e3a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:51:59.017473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=90 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:51:59.043512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f2984877-3308-40f0-9917-d13f17b5e3a8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Aug 06 12:51:59.044057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 959/1909] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:51:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:00.055299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-88c7cad8-cb24-44e8-9c02-ed6f13b448fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:00.057435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-88c7cad8-cb24-44e8-9c02-ed6f13b448fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:00.063728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88c7cad8-cb24-44e8-9c02-ed6f13b448fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:00.064205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88c7cad8-cb24-44e8-9c02-ed6f13b448fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:00.064697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88c7cad8-cb24-44e8-9c02-ed6f13b448fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:00.065380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88c7cad8-cb24-44e8-9c02-ed6f13b448fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:00.065828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88c7cad8-cb24-44e8-9c02-ed6f13b448fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:00.066247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88c7cad8-cb24-44e8-9c02-ed6f13b448fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:00.094039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-88c7cad8-cb24-44e8-9c02-ed6f13b448fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 Aug 06 12:52:00.095145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 951/1910] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:01.107317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bbd9c4db-d01f-4a4d-8d4b-e29708cc57f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:01.109453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bbd9c4db-d01f-4a4d-8d4b-e29708cc57f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:01.116563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbd9c4db-d01f-4a4d-8d4b-e29708cc57f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:01.117036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbd9c4db-d01f-4a4d-8d4b-e29708cc57f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:01.117462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbd9c4db-d01f-4a4d-8d4b-e29708cc57f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:01.118139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbd9c4db-d01f-4a4d-8d4b-e29708cc57f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:01.118583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbd9c4db-d01f-4a4d-8d4b-e29708cc57f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:01.118996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bbd9c4db-d01f-4a4d-8d4b-e29708cc57f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:01.147211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bbd9c4db-d01f-4a4d-8d4b-e29708cc57f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044452 Aug 06 12:52:01.147778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 960/1911] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:01 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:02.159177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c8bc0f41-87a0-422a-9011-d00e461813e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:02.161511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c8bc0f41-87a0-422a-9011-d00e461813e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:02.167896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8bc0f41-87a0-422a-9011-d00e461813e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:02.168406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8bc0f41-87a0-422a-9011-d00e461813e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:02.168843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8bc0f41-87a0-422a-9011-d00e461813e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:02.169536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8bc0f41-87a0-422a-9011-d00e461813e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:02.169986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8bc0f41-87a0-422a-9011-d00e461813e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:02.170406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8bc0f41-87a0-422a-9011-d00e461813e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:02.198524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c8bc0f41-87a0-422a-9011-d00e461813e1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043237 Aug 06 12:52:02.199071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 952/1912] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:03.210144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-be696029-e004-4c67-bc6d-eb4f062944db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:03.212369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-be696029-e004-4c67-bc6d-eb4f062944db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:03.218664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be696029-e004-4c67-bc6d-eb4f062944db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:03.219781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be696029-e004-4c67-bc6d-eb4f062944db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:03.220219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be696029-e004-4c67-bc6d-eb4f062944db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:03.220957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be696029-e004-4c67-bc6d-eb4f062944db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:03.221411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be696029-e004-4c67-bc6d-eb4f062944db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:03.221834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be696029-e004-4c67-bc6d-eb4f062944db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:03.250517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-be696029-e004-4c67-bc6d-eb4f062944db tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Aug 06 12:52:03.250991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 961/1913] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:03.527662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:52:03.528164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:52:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:52:04.262444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-169c712a-1ac8-4785-92ee-26486d947b03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:04.264676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-169c712a-1ac8-4785-92ee-26486d947b03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:04.270799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-169c712a-1ac8-4785-92ee-26486d947b03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:04.271282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-169c712a-1ac8-4785-92ee-26486d947b03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:04.271717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-169c712a-1ac8-4785-92ee-26486d947b03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:04.272425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-169c712a-1ac8-4785-92ee-26486d947b03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:04.272892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-169c712a-1ac8-4785-92ee-26486d947b03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:04.273314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-169c712a-1ac8-4785-92ee-26486d947b03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:04.302948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-169c712a-1ac8-4785-92ee-26486d947b03 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Aug 06 12:52:04.303501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 953/1914] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:05.315419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c3b2bd36-1de6-4067-902a-a59e917fc62d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:05.317557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c3b2bd36-1de6-4067-902a-a59e917fc62d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:05.323769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3b2bd36-1de6-4067-902a-a59e917fc62d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:05.324243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3b2bd36-1de6-4067-902a-a59e917fc62d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:05.324714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3b2bd36-1de6-4067-902a-a59e917fc62d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:05.325391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3b2bd36-1de6-4067-902a-a59e917fc62d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:05.325833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3b2bd36-1de6-4067-902a-a59e917fc62d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:05.326246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3b2bd36-1de6-4067-902a-a59e917fc62d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:05.355121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c3b2bd36-1de6-4067-902a-a59e917fc62d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044090 Aug 06 12:52:05.355672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 962/1915] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:06.367364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-734f269c-d84e-44c3-b097-075a9afae739 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:06.369635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-734f269c-d84e-44c3-b097-075a9afae739 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:06.376002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-734f269c-d84e-44c3-b097-075a9afae739 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:06.376529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-734f269c-d84e-44c3-b097-075a9afae739 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:06.376975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-734f269c-d84e-44c3-b097-075a9afae739 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:06.377677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-734f269c-d84e-44c3-b097-075a9afae739 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:06.378134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-734f269c-d84e-44c3-b097-075a9afae739 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:06.378563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-734f269c-d84e-44c3-b097-075a9afae739 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:06.408782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-734f269c-d84e-44c3-b097-075a9afae739 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045366 Aug 06 12:52:06.409366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 954/1916] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:07.421694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9c065659-b035-4dcd-a368-ad1855bf8938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:07.425015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9c065659-b035-4dcd-a368-ad1855bf8938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:07.430952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c065659-b035-4dcd-a368-ad1855bf8938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:07.431425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c065659-b035-4dcd-a368-ad1855bf8938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:07.431853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c065659-b035-4dcd-a368-ad1855bf8938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:07.432558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c065659-b035-4dcd-a368-ad1855bf8938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:07.433001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c065659-b035-4dcd-a368-ad1855bf8938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:07.433417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c065659-b035-4dcd-a368-ad1855bf8938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:07.463127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9c065659-b035-4dcd-a368-ad1855bf8938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Aug 06 12:52:07.463706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 963/1917] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:08.474889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-20c89e77-6d1e-45b0-8765-b06113397aa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:08.477115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-20c89e77-6d1e-45b0-8765-b06113397aa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:08.483700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c89e77-6d1e-45b0-8765-b06113397aa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:08.484056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c89e77-6d1e-45b0-8765-b06113397aa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:08.485024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c89e77-6d1e-45b0-8765-b06113397aa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:08.485967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c89e77-6d1e-45b0-8765-b06113397aa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:08.486415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c89e77-6d1e-45b0-8765-b06113397aa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:08.486836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20c89e77-6d1e-45b0-8765-b06113397aa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:08.517757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-20c89e77-6d1e-45b0-8765-b06113397aa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Aug 06 12:52:08.518335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 955/1918] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:08 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:09.529828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ea4f99cd-8e61-4260-b13f-8129171fe26e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:09.531979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ea4f99cd-8e61-4260-b13f-8129171fe26e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:09.538663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea4f99cd-8e61-4260-b13f-8129171fe26e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:09.539177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea4f99cd-8e61-4260-b13f-8129171fe26e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:09.539622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea4f99cd-8e61-4260-b13f-8129171fe26e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:09.540227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea4f99cd-8e61-4260-b13f-8129171fe26e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:09.540704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea4f99cd-8e61-4260-b13f-8129171fe26e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:09.541124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea4f99cd-8e61-4260-b13f-8129171fe26e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:09.569943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ea4f99cd-8e61-4260-b13f-8129171fe26e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043959 Aug 06 12:52:09.570490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 964/1919] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:10.582640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1906c5c0-1c4b-42a4-9f6e-231a7eacba18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:10.584834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1906c5c0-1c4b-42a4-9f6e-231a7eacba18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:10.591259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1906c5c0-1c4b-42a4-9f6e-231a7eacba18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:10.591875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1906c5c0-1c4b-42a4-9f6e-231a7eacba18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:10.592322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1906c5c0-1c4b-42a4-9f6e-231a7eacba18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:10.593033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1906c5c0-1c4b-42a4-9f6e-231a7eacba18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:10.593480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1906c5c0-1c4b-42a4-9f6e-231a7eacba18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:10.593904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1906c5c0-1c4b-42a4-9f6e-231a7eacba18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:10.596979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=90 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:52:10.626188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1906c5c0-1c4b-42a4-9f6e-231a7eacba18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048044 Aug 06 12:52:10.626759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 956/1920] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:11.638215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-469a2826-e2c8-4315-a5ea-5ca75ef73107 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:11.640373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-469a2826-e2c8-4315-a5ea-5ca75ef73107 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:11.646597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-469a2826-e2c8-4315-a5ea-5ca75ef73107 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:11.647067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-469a2826-e2c8-4315-a5ea-5ca75ef73107 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:11.647494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-469a2826-e2c8-4315-a5ea-5ca75ef73107 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:11.648169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-469a2826-e2c8-4315-a5ea-5ca75ef73107 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:11.648636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-469a2826-e2c8-4315-a5ea-5ca75ef73107 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:11.649237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-469a2826-e2c8-4315-a5ea-5ca75ef73107 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:11.679444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-469a2826-e2c8-4315-a5ea-5ca75ef73107 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Aug 06 12:52:11.680008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 965/1921] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:12.691377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13ef4bf2-8c3d-4d7d-9cec-0d719d834e4d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:12.693532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-13ef4bf2-8c3d-4d7d-9cec-0d719d834e4d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:12.700105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13ef4bf2-8c3d-4d7d-9cec-0d719d834e4d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:12.700629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13ef4bf2-8c3d-4d7d-9cec-0d719d834e4d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:12.701063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13ef4bf2-8c3d-4d7d-9cec-0d719d834e4d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:12.701744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13ef4bf2-8c3d-4d7d-9cec-0d719d834e4d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:12.702191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13ef4bf2-8c3d-4d7d-9cec-0d719d834e4d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:12.702612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13ef4bf2-8c3d-4d7d-9cec-0d719d834e4d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:12.732020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-13ef4bf2-8c3d-4d7d-9cec-0d719d834e4d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Aug 06 12:52:12.732627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 957/1922] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:13.744027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9e26da3d-35cb-44c3-b515-3da28422238b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:13.746311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9e26da3d-35cb-44c3-b515-3da28422238b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:13.752689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e26da3d-35cb-44c3-b515-3da28422238b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:13.753163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e26da3d-35cb-44c3-b515-3da28422238b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:13.753590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e26da3d-35cb-44c3-b515-3da28422238b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:13.754270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e26da3d-35cb-44c3-b515-3da28422238b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:13.754712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e26da3d-35cb-44c3-b515-3da28422238b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:13.755127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e26da3d-35cb-44c3-b515-3da28422238b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:13.784575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9e26da3d-35cb-44c3-b515-3da28422238b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Aug 06 12:52:13.785127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 966/1923] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:14.796159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9044b8d6-1dc4-4fab-8a0a-0183ca7f8cd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:14.798866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9044b8d6-1dc4-4fab-8a0a-0183ca7f8cd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:14.805126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9044b8d6-1dc4-4fab-8a0a-0183ca7f8cd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:14.805604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9044b8d6-1dc4-4fab-8a0a-0183ca7f8cd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:14.806032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9044b8d6-1dc4-4fab-8a0a-0183ca7f8cd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:14.806714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9044b8d6-1dc4-4fab-8a0a-0183ca7f8cd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:14.807158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9044b8d6-1dc4-4fab-8a0a-0183ca7f8cd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:14.807574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9044b8d6-1dc4-4fab-8a0a-0183ca7f8cd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:14.839674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9044b8d6-1dc4-4fab-8a0a-0183ca7f8cd1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047290 Aug 06 12:52:14.840493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 958/1924] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:15.850821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7cf41d7a-b8aa-4e91-b5c3-1a7291e1266e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:15.853044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7cf41d7a-b8aa-4e91-b5c3-1a7291e1266e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:15.858936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf41d7a-b8aa-4e91-b5c3-1a7291e1266e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:15.859416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf41d7a-b8aa-4e91-b5c3-1a7291e1266e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:15.859845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf41d7a-b8aa-4e91-b5c3-1a7291e1266e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:15.861300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf41d7a-b8aa-4e91-b5c3-1a7291e1266e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:15.861741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf41d7a-b8aa-4e91-b5c3-1a7291e1266e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:15.862155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf41d7a-b8aa-4e91-b5c3-1a7291e1266e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:15.891087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7cf41d7a-b8aa-4e91-b5c3-1a7291e1266e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Aug 06 12:52:15.891655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 967/1925] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:15 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:16.902930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a721193f-2318-4758-9071-9afe536fc126 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:16.905066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a721193f-2318-4758-9071-9afe536fc126 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:16.911351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a721193f-2318-4758-9071-9afe536fc126 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:16.911824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a721193f-2318-4758-9071-9afe536fc126 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:16.912255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a721193f-2318-4758-9071-9afe536fc126 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:16.912959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a721193f-2318-4758-9071-9afe536fc126 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:16.913404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a721193f-2318-4758-9071-9afe536fc126 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:16.913872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a721193f-2318-4758-9071-9afe536fc126 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:16.942566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a721193f-2318-4758-9071-9afe536fc126 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043473 Aug 06 12:52:16.943122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 959/1926] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:17.954539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-769084f1-7c61-45fb-9a39-74309daaa512 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:17.956993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-769084f1-7c61-45fb-9a39-74309daaa512 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:17.965197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-769084f1-7c61-45fb-9a39-74309daaa512 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:17.965677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-769084f1-7c61-45fb-9a39-74309daaa512 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:17.966102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-769084f1-7c61-45fb-9a39-74309daaa512 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:17.966782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-769084f1-7c61-45fb-9a39-74309daaa512 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:17.967228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-769084f1-7c61-45fb-9a39-74309daaa512 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:17.967641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-769084f1-7c61-45fb-9a39-74309daaa512 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:18.000078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-769084f1-7c61-45fb-9a39-74309daaa512 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049436 Aug 06 12:52:18.001020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 968/1927] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:52:19.012411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0dfd6d1b-ae2f-4dde-8575-6e40e5460772 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:19.014525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0dfd6d1b-ae2f-4dde-8575-6e40e5460772 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:19.020877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d1b-ae2f-4dde-8575-6e40e5460772 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:19.021356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d1b-ae2f-4dde-8575-6e40e5460772 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:19.021811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d1b-ae2f-4dde-8575-6e40e5460772 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:19.022495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d1b-ae2f-4dde-8575-6e40e5460772 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:19.022939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d1b-ae2f-4dde-8575-6e40e5460772 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:19.023358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0dfd6d1b-ae2f-4dde-8575-6e40e5460772 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:19.052469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0dfd6d1b-ae2f-4dde-8575-6e40e5460772 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Aug 06 12:52:19.053031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 960/1928] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:20.065453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d84aea22-d7e8-444b-9d35-7d8a5d89051f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:20.067564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d84aea22-d7e8-444b-9d35-7d8a5d89051f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:20.073904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d84aea22-d7e8-444b-9d35-7d8a5d89051f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:20.074531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d84aea22-d7e8-444b-9d35-7d8a5d89051f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:20.074778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d84aea22-d7e8-444b-9d35-7d8a5d89051f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:20.075462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d84aea22-d7e8-444b-9d35-7d8a5d89051f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:20.075904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d84aea22-d7e8-444b-9d35-7d8a5d89051f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:20.076384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d84aea22-d7e8-444b-9d35-7d8a5d89051f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:20.105161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d84aea22-d7e8-444b-9d35-7d8a5d89051f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Aug 06 12:52:20.105710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 969/1929] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:21.117475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0eae1c2c-4329-4fcd-9b23-f9c6284f3d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:21.119644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0eae1c2c-4329-4fcd-9b23-f9c6284f3d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:21.126243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0eae1c2c-4329-4fcd-9b23-f9c6284f3d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:21.126724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0eae1c2c-4329-4fcd-9b23-f9c6284f3d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:21.127162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0eae1c2c-4329-4fcd-9b23-f9c6284f3d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:21.127860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0eae1c2c-4329-4fcd-9b23-f9c6284f3d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:21.128331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0eae1c2c-4329-4fcd-9b23-f9c6284f3d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:21.128761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0eae1c2c-4329-4fcd-9b23-f9c6284f3d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:21.158563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0eae1c2c-4329-4fcd-9b23-f9c6284f3d2b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Aug 06 12:52:21.159388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 961/1930] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:21 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:22.170459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f8e4d960-b2f8-4ba5-9421-258fc042b2b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:22.173322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f8e4d960-b2f8-4ba5-9421-258fc042b2b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:22.179998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8e4d960-b2f8-4ba5-9421-258fc042b2b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:22.180504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8e4d960-b2f8-4ba5-9421-258fc042b2b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:22.180930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8e4d960-b2f8-4ba5-9421-258fc042b2b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:22.182465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8e4d960-b2f8-4ba5-9421-258fc042b2b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:22.182920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8e4d960-b2f8-4ba5-9421-258fc042b2b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:22.183335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8e4d960-b2f8-4ba5-9421-258fc042b2b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:22.228331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f8e4d960-b2f8-4ba5-9421-258fc042b2b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061654 Aug 06 12:52:22.229074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 970/1931] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:22.814600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:52:22.814758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:52:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:52:23.240180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1f47e7df-d0ae-4979-8f71-5a978d7663cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:23.242327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1f47e7df-d0ae-4979-8f71-5a978d7663cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:23.244655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=30 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:52:23.250008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f47e7df-d0ae-4979-8f71-5a978d7663cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:23.250928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f47e7df-d0ae-4979-8f71-5a978d7663cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:23.251358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f47e7df-d0ae-4979-8f71-5a978d7663cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:23.252046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f47e7df-d0ae-4979-8f71-5a978d7663cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:23.252516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f47e7df-d0ae-4979-8f71-5a978d7663cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:23.252932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f47e7df-d0ae-4979-8f71-5a978d7663cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:23.283231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1f47e7df-d0ae-4979-8f71-5a978d7663cc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046837 Aug 06 12:52:23.283807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 962/1932] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:24.294914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-10719d84-2d72-4271-b7d0-a0bc36bffe5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:24.297087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-10719d84-2d72-4271-b7d0-a0bc36bffe5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:24.299864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=30 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:52:24.305417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10719d84-2d72-4271-b7d0-a0bc36bffe5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:24.305894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10719d84-2d72-4271-b7d0-a0bc36bffe5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:24.306326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10719d84-2d72-4271-b7d0-a0bc36bffe5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:24.307010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10719d84-2d72-4271-b7d0-a0bc36bffe5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:24.307457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10719d84-2d72-4271-b7d0-a0bc36bffe5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:24.307873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10719d84-2d72-4271-b7d0-a0bc36bffe5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:24.338220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-10719d84-2d72-4271-b7d0-a0bc36bffe5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047197 Aug 06 12:52:24.338775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 971/1933] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:25.350358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3bfd2b07-758f-41b1-a9dc-e7a41785a083 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:25.352507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3bfd2b07-758f-41b1-a9dc-e7a41785a083 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:25.358684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bfd2b07-758f-41b1-a9dc-e7a41785a083 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:25.359161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bfd2b07-758f-41b1-a9dc-e7a41785a083 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:25.359597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bfd2b07-758f-41b1-a9dc-e7a41785a083 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:25.360282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bfd2b07-758f-41b1-a9dc-e7a41785a083 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:25.361005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bfd2b07-758f-41b1-a9dc-e7a41785a083 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:25.361427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3bfd2b07-758f-41b1-a9dc-e7a41785a083 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:25.390034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3bfd2b07-758f-41b1-a9dc-e7a41785a083 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043536 Aug 06 12:52:25.390596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 963/1934] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:26.404963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5f227def-ba80-4a8b-a0eb-56bcb7611c89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:26.407842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5f227def-ba80-4a8b-a0eb-56bcb7611c89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:26.414353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f227def-ba80-4a8b-a0eb-56bcb7611c89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:26.414833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f227def-ba80-4a8b-a0eb-56bcb7611c89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:26.415263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f227def-ba80-4a8b-a0eb-56bcb7611c89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:26.415947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f227def-ba80-4a8b-a0eb-56bcb7611c89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:26.416422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f227def-ba80-4a8b-a0eb-56bcb7611c89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:26.416842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f227def-ba80-4a8b-a0eb-56bcb7611c89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:26.445225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5f227def-ba80-4a8b-a0eb-56bcb7611c89 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Aug 06 12:52:26.445924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 972/1935] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:27.456962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0fc93581-45ce-4730-b432-b18af2f3ad39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:27.459146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0fc93581-45ce-4730-b432-b18af2f3ad39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:27.465615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fc93581-45ce-4730-b432-b18af2f3ad39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:27.466087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fc93581-45ce-4730-b432-b18af2f3ad39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:27.466515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fc93581-45ce-4730-b432-b18af2f3ad39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:27.467194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fc93581-45ce-4730-b432-b18af2f3ad39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:27.467640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fc93581-45ce-4730-b432-b18af2f3ad39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:27.468047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fc93581-45ce-4730-b432-b18af2f3ad39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:27.496384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0fc93581-45ce-4730-b432-b18af2f3ad39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043756 Aug 06 12:52:27.497200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 964/1936] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:28.507617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c3210cdb-f6d0-4c80-b6f4-31f0cd5007c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:28.509746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c3210cdb-f6d0-4c80-b6f4-31f0cd5007c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:28.516610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3210cdb-f6d0-4c80-b6f4-31f0cd5007c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:28.517080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3210cdb-f6d0-4c80-b6f4-31f0cd5007c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:28.517506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3210cdb-f6d0-4c80-b6f4-31f0cd5007c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:28.518185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3210cdb-f6d0-4c80-b6f4-31f0cd5007c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:28.518626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3210cdb-f6d0-4c80-b6f4-31f0cd5007c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:28.519037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c3210cdb-f6d0-4c80-b6f4-31f0cd5007c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:28.548003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c3210cdb-f6d0-4c80-b6f4-31f0cd5007c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044238 Aug 06 12:52:28.548576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 973/1937] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:28 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:29.559982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5c3d4e19-db56-4e35-8360-6ca0e7371626 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:29.562371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5c3d4e19-db56-4e35-8360-6ca0e7371626 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:29.569003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c3d4e19-db56-4e35-8360-6ca0e7371626 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:29.569479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c3d4e19-db56-4e35-8360-6ca0e7371626 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:29.569909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c3d4e19-db56-4e35-8360-6ca0e7371626 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:29.570594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c3d4e19-db56-4e35-8360-6ca0e7371626 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:29.571085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c3d4e19-db56-4e35-8360-6ca0e7371626 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:29.571455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c3d4e19-db56-4e35-8360-6ca0e7371626 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:29.600812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5c3d4e19-db56-4e35-8360-6ca0e7371626 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Aug 06 12:52:29.601366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 965/1938] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:30.613666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c1a0669d-ec61-43bd-b2b0-949df3c6de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:30.628009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c1a0669d-ec61-43bd-b2b0-949df3c6de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:30.631795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1a0669d-ec61-43bd-b2b0-949df3c6de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:30.632275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1a0669d-ec61-43bd-b2b0-949df3c6de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:30.632726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1a0669d-ec61-43bd-b2b0-949df3c6de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:30.633413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1a0669d-ec61-43bd-b2b0-949df3c6de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:30.633855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1a0669d-ec61-43bd-b2b0-949df3c6de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:30.634266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1a0669d-ec61-43bd-b2b0-949df3c6de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:30.637903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=90 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:52:30.670246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c1a0669d-ec61-43bd-b2b0-949df3c6de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061236 Aug 06 12:52:30.670903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 974/1939] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:31.683271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0e98ba3c-8ca6-48ed-906b-3cbea16d1567 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:31.685433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0e98ba3c-8ca6-48ed-906b-3cbea16d1567 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:31.692395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e98ba3c-8ca6-48ed-906b-3cbea16d1567 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:31.692877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e98ba3c-8ca6-48ed-906b-3cbea16d1567 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:31.693308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e98ba3c-8ca6-48ed-906b-3cbea16d1567 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:31.694000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e98ba3c-8ca6-48ed-906b-3cbea16d1567 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:31.694451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e98ba3c-8ca6-48ed-906b-3cbea16d1567 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:31.694871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e98ba3c-8ca6-48ed-906b-3cbea16d1567 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:31.725487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0e98ba3c-8ca6-48ed-906b-3cbea16d1567 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046134 Aug 06 12:52:31.726068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 966/1940] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:32.737649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-33d98e32-9f14-47fc-86fa-f13a6fb33057 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:32.739893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-33d98e32-9f14-47fc-86fa-f13a6fb33057 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:32.746431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33d98e32-9f14-47fc-86fa-f13a6fb33057 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:32.746851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33d98e32-9f14-47fc-86fa-f13a6fb33057 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:32.747339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33d98e32-9f14-47fc-86fa-f13a6fb33057 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:32.747877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33d98e32-9f14-47fc-86fa-f13a6fb33057 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:32.748333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33d98e32-9f14-47fc-86fa-f13a6fb33057 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:32.748748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33d98e32-9f14-47fc-86fa-f13a6fb33057 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:32.778148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-33d98e32-9f14-47fc-86fa-f13a6fb33057 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044579 Aug 06 12:52:32.778708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 975/1941] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:33.790366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5d6e249b-abc3-4437-833c-dd64026eb7e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:33.792514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5d6e249b-abc3-4437-833c-dd64026eb7e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:33.799668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d6e249b-abc3-4437-833c-dd64026eb7e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:33.800151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d6e249b-abc3-4437-833c-dd64026eb7e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:33.800613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d6e249b-abc3-4437-833c-dd64026eb7e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:33.801303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d6e249b-abc3-4437-833c-dd64026eb7e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:33.801750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d6e249b-abc3-4437-833c-dd64026eb7e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:33.802169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d6e249b-abc3-4437-833c-dd64026eb7e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:33.832005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5d6e249b-abc3-4437-833c-dd64026eb7e4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045646 Aug 06 12:52:33.832599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 967/1942] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:34.845134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3b83cce4-5240-484d-b547-edade47458f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:34.847741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3b83cce4-5240-484d-b547-edade47458f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:34.854083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b83cce4-5240-484d-b547-edade47458f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:34.854558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b83cce4-5240-484d-b547-edade47458f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:34.854982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b83cce4-5240-484d-b547-edade47458f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:34.855844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b83cce4-5240-484d-b547-edade47458f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:34.856295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b83cce4-5240-484d-b547-edade47458f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:34.856730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b83cce4-5240-484d-b547-edade47458f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:34.886582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3b83cce4-5240-484d-b547-edade47458f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046334 Aug 06 12:52:34.887141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 976/1943] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:35.899228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1963b88e-c39e-4354-8ec7-ff40c231a8bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:35.901396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1963b88e-c39e-4354-8ec7-ff40c231a8bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:35.907761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1963b88e-c39e-4354-8ec7-ff40c231a8bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:35.908233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1963b88e-c39e-4354-8ec7-ff40c231a8bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:35.908708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1963b88e-c39e-4354-8ec7-ff40c231a8bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:35.909389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1963b88e-c39e-4354-8ec7-ff40c231a8bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:35.909832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1963b88e-c39e-4354-8ec7-ff40c231a8bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:35.910247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1963b88e-c39e-4354-8ec7-ff40c231a8bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:35.942339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1963b88e-c39e-4354-8ec7-ff40c231a8bd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047010 Aug 06 12:52:35.942908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 968/1944] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:35 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:36.954263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f2165364-ea9e-4718-9a2e-ca9e2f243397 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:36.956550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f2165364-ea9e-4718-9a2e-ca9e2f243397 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:36.962550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2165364-ea9e-4718-9a2e-ca9e2f243397 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:36.963026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2165364-ea9e-4718-9a2e-ca9e2f243397 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:36.963457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2165364-ea9e-4718-9a2e-ca9e2f243397 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:36.964144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2165364-ea9e-4718-9a2e-ca9e2f243397 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:36.964624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2165364-ea9e-4718-9a2e-ca9e2f243397 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:36.965040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2165364-ea9e-4718-9a2e-ca9e2f243397 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:36.995138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f2165364-ea9e-4718-9a2e-ca9e2f243397 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045242 Aug 06 12:52:36.995711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 977/1945] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:38.007007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d46c758e-8069-4c5a-a920-4126ab6e9db7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:38.009163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d46c758e-8069-4c5a-a920-4126ab6e9db7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:38.016100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d46c758e-8069-4c5a-a920-4126ab6e9db7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:38.016618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d46c758e-8069-4c5a-a920-4126ab6e9db7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:38.017051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d46c758e-8069-4c5a-a920-4126ab6e9db7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:38.017742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d46c758e-8069-4c5a-a920-4126ab6e9db7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:38.018188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d46c758e-8069-4c5a-a920-4126ab6e9db7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:38.018613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d46c758e-8069-4c5a-a920-4126ab6e9db7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:38.047148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d46c758e-8069-4c5a-a920-4126ab6e9db7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043776 Aug 06 12:52:38.047704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 969/1946] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:39.058823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-adf5918c-b184-4fcd-9872-eb8283f280b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:39.061027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-adf5918c-b184-4fcd-9872-eb8283f280b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:39.067462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5918c-b184-4fcd-9872-eb8283f280b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:39.067883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5918c-b184-4fcd-9872-eb8283f280b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:39.068334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5918c-b184-4fcd-9872-eb8283f280b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:39.069025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5918c-b184-4fcd-9872-eb8283f280b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:39.069468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5918c-b184-4fcd-9872-eb8283f280b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:39.069890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adf5918c-b184-4fcd-9872-eb8283f280b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:39.099974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-adf5918c-b184-4fcd-9872-eb8283f280b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Aug 06 12:52:39.104236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 978/1947] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:40.111592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7fbe1978-ee81-40ee-b46b-ebb8a7b51425 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:40.113832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7fbe1978-ee81-40ee-b46b-ebb8a7b51425 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:40.120294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fbe1978-ee81-40ee-b46b-ebb8a7b51425 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:40.120811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fbe1978-ee81-40ee-b46b-ebb8a7b51425 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:40.121245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fbe1978-ee81-40ee-b46b-ebb8a7b51425 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:40.121939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fbe1978-ee81-40ee-b46b-ebb8a7b51425 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:40.122391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fbe1978-ee81-40ee-b46b-ebb8a7b51425 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:40.122820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fbe1978-ee81-40ee-b46b-ebb8a7b51425 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:40.153469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7fbe1978-ee81-40ee-b46b-ebb8a7b51425 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Aug 06 12:52:40.154084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 970/1948] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:41.165357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b6d95358-763b-489d-8ebf-547f5943c814 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:41.167509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b6d95358-763b-489d-8ebf-547f5943c814 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:41.174714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6d95358-763b-489d-8ebf-547f5943c814 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:41.175187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6d95358-763b-489d-8ebf-547f5943c814 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:41.175619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6d95358-763b-489d-8ebf-547f5943c814 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:41.176323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6d95358-763b-489d-8ebf-547f5943c814 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:41.176766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6d95358-763b-489d-8ebf-547f5943c814 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:41.177178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6d95358-763b-489d-8ebf-547f5943c814 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:41.205541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b6d95358-763b-489d-8ebf-547f5943c814 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Aug 06 12:52:41.207608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 979/1949] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:41 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:42.217900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-89d7a1b6-c36f-45ea-9e77-2dd8e66ace98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:42.220666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-89d7a1b6-c36f-45ea-9e77-2dd8e66ace98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:42.227152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d7a1b6-c36f-45ea-9e77-2dd8e66ace98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:42.227658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d7a1b6-c36f-45ea-9e77-2dd8e66ace98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:42.228085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d7a1b6-c36f-45ea-9e77-2dd8e66ace98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:42.228798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d7a1b6-c36f-45ea-9e77-2dd8e66ace98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:42.229252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d7a1b6-c36f-45ea-9e77-2dd8e66ace98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:42.229670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d7a1b6-c36f-45ea-9e77-2dd8e66ace98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:42.233390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=90 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:52:42.258493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-89d7a1b6-c36f-45ea-9e77-2dd8e66ace98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044490 Aug 06 12:52:42.259041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 971/1950] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:42 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:43.270731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f0d0262c-d3d4-41ce-a07c-0343eb4a10f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:43.272932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f0d0262c-d3d4-41ce-a07c-0343eb4a10f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:43.279896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d0262c-d3d4-41ce-a07c-0343eb4a10f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:43.280416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d0262c-d3d4-41ce-a07c-0343eb4a10f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:43.281357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d0262c-d3d4-41ce-a07c-0343eb4a10f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:43.282078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d0262c-d3d4-41ce-a07c-0343eb4a10f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:43.282508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d0262c-d3d4-41ce-a07c-0343eb4a10f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:43.282940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d0262c-d3d4-41ce-a07c-0343eb4a10f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:43.311965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f0d0262c-d3d4-41ce-a07c-0343eb4a10f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Aug 06 12:52:43.312549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 980/1951] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:44.324155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dd5232ef-02b4-46db-9fe8-25266f8f4a21 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:44.326318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dd5232ef-02b4-46db-9fe8-25266f8f4a21 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:44.332697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd5232ef-02b4-46db-9fe8-25266f8f4a21 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:44.333178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd5232ef-02b4-46db-9fe8-25266f8f4a21 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:44.333637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd5232ef-02b4-46db-9fe8-25266f8f4a21 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:44.334332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd5232ef-02b4-46db-9fe8-25266f8f4a21 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:44.334860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd5232ef-02b4-46db-9fe8-25266f8f4a21 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:44.335291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd5232ef-02b4-46db-9fe8-25266f8f4a21 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:44.364730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dd5232ef-02b4-46db-9fe8-25266f8f4a21 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Aug 06 12:52:44.365319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 972/1952] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:45.377380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-41c86e69-330a-400b-9f5b-e9fa0daf75d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:45.379521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-41c86e69-330a-400b-9f5b-e9fa0daf75d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:45.385820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41c86e69-330a-400b-9f5b-e9fa0daf75d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:45.386266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41c86e69-330a-400b-9f5b-e9fa0daf75d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:45.386697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41c86e69-330a-400b-9f5b-e9fa0daf75d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:45.387369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41c86e69-330a-400b-9f5b-e9fa0daf75d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:45.387817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41c86e69-330a-400b-9f5b-e9fa0daf75d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:45.388231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41c86e69-330a-400b-9f5b-e9fa0daf75d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:45.417075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-41c86e69-330a-400b-9f5b-e9fa0daf75d7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Aug 06 12:52:45.417638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 981/1953] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 12:52:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:46.429347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a4b0b725-6e53-4180-b335-60c045107150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:52:46.431546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a4b0b725-6e53-4180-b335-60c045107150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:46.437850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4b0b725-6e53-4180-b335-60c045107150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:46.438330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4b0b725-6e53-4180-b335-60c045107150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:46.438763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4b0b725-6e53-4180-b335-60c045107150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:46.439446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4b0b725-6e53-4180-b335-60c045107150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:46.439901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4b0b725-6e53-4180-b335-60c045107150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:46.440349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4b0b725-6e53-4180-b335-60c045107150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:46.556420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a4b0b725-6e53-4180-b335-60c045107150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "POST /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/action" status: 200 len: 115356 microversion: 2.1 time: 0.130335 Aug 06 12:52:46.557120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 973/1954] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 12:52:46 2022] POST /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e/action => generated 115356 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:52:46.593828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c1180e4b-147d-4f50-a2d9-d2d4376e259e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:46.594934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c1180e4b-147d-4f50-a2d9-d2d4376e259e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:46.601033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1180e4b-147d-4f50-a2d9-d2d4376e259e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:46.601517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1180e4b-147d-4f50-a2d9-d2d4376e259e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:46.601950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1180e4b-147d-4f50-a2d9-d2d4376e259e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:46.602645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1180e4b-147d-4f50-a2d9-d2d4376e259e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:46.603103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1180e4b-147d-4f50-a2d9-d2d4376e259e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:46.603620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1180e4b-147d-4f50-a2d9-d2d4376e259e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:46.628894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c1180e4b-147d-4f50-a2d9-d2d4376e259e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 12:52:46.708610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c1180e4b-147d-4f50-a2d9-d2d4376e259e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 204 len: 0 microversion: 2.1 time: 0.118818 Aug 06 12:52:46.709314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 982/1955] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:52:46 2022] DELETE /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 12:52:46.710932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7f90576d-b033-4a0d-b7ef-7f71866f2ba2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] Calling method '.version_select at 0x7f541a9f53a0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:46.717773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c82820d4-cc71-4422-9461-ea3eb9ba1e85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:46.719422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c82820d4-cc71-4422-9461-ea3eb9ba1e85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:46.732172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c82820d4-cc71-4422-9461-ea3eb9ba1e85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:46.732953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c82820d4-cc71-4422-9461-ea3eb9ba1e85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:46.733421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c82820d4-cc71-4422-9461-ea3eb9ba1e85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:46.734203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c82820d4-cc71-4422-9461-ea3eb9ba1e85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:46.734809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c82820d4-cc71-4422-9461-ea3eb9ba1e85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:46.735223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c82820d4-cc71-4422-9461-ea3eb9ba1e85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:46.751877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7f90576d-b033-4a0d-b7ef-7f71866f2ba2 tempest-TestVolumeBootPattern-1615140679 tempest-TestVolumeBootPattern-1615140679-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1739615405" status: 202 len: 0 microversion: 2.1 time: 0.057102 Aug 06 12:52:46.753039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 974/1956] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Aug 6 12:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1739615405 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 12:52:46.935954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c82820d4-cc71-4422-9461-ea3eb9ba1e85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:46.944340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c82820d4-cc71-4422-9461-ea3eb9ba1e85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.230559 Aug 06 12:52:46.945011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 983/1957] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:46 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:47.608149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2c67546a-95bf-4670-940e-4b2b9bb65594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:47.609276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2c67546a-95bf-4670-940e-4b2b9bb65594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:47.616958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c67546a-95bf-4670-940e-4b2b9bb65594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:47.617444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c67546a-95bf-4670-940e-4b2b9bb65594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:47.617881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c67546a-95bf-4670-940e-4b2b9bb65594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:47.618582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c67546a-95bf-4670-940e-4b2b9bb65594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:47.619035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c67546a-95bf-4670-940e-4b2b9bb65594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:47.619467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c67546a-95bf-4670-940e-4b2b9bb65594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:47.644772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2c67546a-95bf-4670-940e-4b2b9bb65594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 12:52:47.744012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2c67546a-95bf-4670-940e-4b2b9bb65594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 204 len: 0 microversion: 2.1 time: 0.139337 Aug 06 12:52:47.745607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 975/1958] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:52:47 2022] DELETE /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 12:52:47.751013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6704b873-4e83-483c-98c8-5736a71f0dbe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:47.751522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6704b873-4e83-483c-98c8-5736a71f0dbe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:47.755355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8edeb57f-353c-4531-a9f4-5545a65da00d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:47.756207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8edeb57f-353c-4531-a9f4-5545a65da00d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:47.758039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6704b873-4e83-483c-98c8-5736a71f0dbe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:47.758522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6704b873-4e83-483c-98c8-5736a71f0dbe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:47.758953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6704b873-4e83-483c-98c8-5736a71f0dbe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:47.759644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6704b873-4e83-483c-98c8-5736a71f0dbe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:47.760088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6704b873-4e83-483c-98c8-5736a71f0dbe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:47.760540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6704b873-4e83-483c-98c8-5736a71f0dbe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:47.762665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8edeb57f-353c-4531-a9f4-5545a65da00d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:47.763218 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8edeb57f-353c-4531-a9f4-5545a65da00d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:47.763727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8edeb57f-353c-4531-a9f4-5545a65da00d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:47.764640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8edeb57f-353c-4531-a9f4-5545a65da00d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:47.765138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8edeb57f-353c-4531-a9f4-5545a65da00d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:47.765563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8edeb57f-353c-4531-a9f4-5545a65da00d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:47.791789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6704b873-4e83-483c-98c8-5736a71f0dbe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 12:52:47.879924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6704b873-4e83-483c-98c8-5736a71f0dbe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 204 len: 0 microversion: 2.20 time: 0.132810 Aug 06 12:52:47.881572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 984/1959] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Aug 6 12:52:47 2022] DELETE /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 06 12:52:47.890109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:47.890998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:47.896812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:47.897289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:47.897716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:47.898397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:47.898842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:47.899271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:48.026679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8edeb57f-353c-4531-a9f4-5545a65da00d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:48.035696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8edeb57f-353c-4531-a9f4-5545a65da00d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.285674 Aug 06 12:52:48.036847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 976/1960] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:48.041703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0fa98cbd-c1a3-441b-bed7-950ff2ccba37 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:48.042549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0fa98cbd-c1a3-441b-bed7-950ff2ccba37 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:48.049964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fa98cbd-c1a3-441b-bed7-950ff2ccba37 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:48.051048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fa98cbd-c1a3-441b-bed7-950ff2ccba37 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:48.051702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fa98cbd-c1a3-441b-bed7-950ff2ccba37 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:48.052557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fa98cbd-c1a3-441b-bed7-950ff2ccba37 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:48.053588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fa98cbd-c1a3-441b-bed7-950ff2ccba37 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:48.053928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fa98cbd-c1a3-441b-bed7-950ff2ccba37 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:48.058754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:48.067958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:48.069762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:48.071154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-10adf5be-caec-4113-a2db-8696b8231c97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1802 microversion: 2.20 time: 0.185194 Aug 06 12:52:48.072530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 985/1961] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1802 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:52:48.305513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0fa98cbd-c1a3-441b-bed7-950ff2ccba37 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:48.316614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0fa98cbd-c1a3-441b-bed7-950ff2ccba37 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.278332 Aug 06 12:52:48.317197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 977/1962] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:48 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:49.059921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-19d49f36-2585-4a34-acfe-f1dfb6b589d0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:49.060591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-19d49f36-2585-4a34-acfe-f1dfb6b589d0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:49.068246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19d49f36-2585-4a34-acfe-f1dfb6b589d0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:49.068767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19d49f36-2585-4a34-acfe-f1dfb6b589d0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:49.069198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19d49f36-2585-4a34-acfe-f1dfb6b589d0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:49.069894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19d49f36-2585-4a34-acfe-f1dfb6b589d0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:49.070477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19d49f36-2585-4a34-acfe-f1dfb6b589d0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:49.071319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-19d49f36-2585-4a34-acfe-f1dfb6b589d0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:49.095782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:49.097305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:49.106923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:49.107257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:49.107726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:49.108420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:49.109368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:49.109794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:49.301303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-19d49f36-2585-4a34-acfe-f1dfb6b589d0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:49.311934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-19d49f36-2585-4a34-acfe-f1dfb6b589d0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.255812 Aug 06 12:52:49.317924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 986/1963] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:49.338666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c62a184d-592c-4378-b22c-75c796841c38 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:49.339283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c62a184d-592c-4378-b22c-75c796841c38 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:49.346128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c62a184d-592c-4378-b22c-75c796841c38 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:49.346619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c62a184d-592c-4378-b22c-75c796841c38 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:49.347055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c62a184d-592c-4378-b22c-75c796841c38 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:49.347765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c62a184d-592c-4378-b22c-75c796841c38 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:49.348218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c62a184d-592c-4378-b22c-75c796841c38 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:49.348668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c62a184d-592c-4378-b22c-75c796841c38 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:49.365382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:52:49.489791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c62a184d-592c-4378-b22c-75c796841c38 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:49.497904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c62a184d-592c-4378-b22c-75c796841c38 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.163141 Aug 06 12:52:49.498482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 987/1964] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:49 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:52:49.744118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:49.752778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:49.754353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:49.755597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4c4d0f40-df10-4cae-8ddd-96c032e79efd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1802 microversion: 2.20 time: 0.664325 Aug 06 12:52:49.756284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 978/1965] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1802 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:52:50.341123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-31122b91-2253-4a06-9a31-469c82dbd4f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:50.341795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-31122b91-2253-4a06-9a31-469c82dbd4f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:50.349539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31122b91-2253-4a06-9a31-469c82dbd4f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:50.350570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31122b91-2253-4a06-9a31-469c82dbd4f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:50.351222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31122b91-2253-4a06-9a31-469c82dbd4f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:50.352119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31122b91-2253-4a06-9a31-469c82dbd4f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:50.353140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31122b91-2253-4a06-9a31-469c82dbd4f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:50.354050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31122b91-2253-4a06-9a31-469c82dbd4f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:50.497909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-31122b91-2253-4a06-9a31-469c82dbd4f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:50.506568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-31122b91-2253-4a06-9a31-469c82dbd4f6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.171043 Aug 06 12:52:50.507128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 988/1966] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:50 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:50.519010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e41c73eb-f8c6-494f-96f2-7f5ba9341f63 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:50.519646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e41c73eb-f8c6-494f-96f2-7f5ba9341f63 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:50.526274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e41c73eb-f8c6-494f-96f2-7f5ba9341f63 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:50.526769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e41c73eb-f8c6-494f-96f2-7f5ba9341f63 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:50.527196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e41c73eb-f8c6-494f-96f2-7f5ba9341f63 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:50.527878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e41c73eb-f8c6-494f-96f2-7f5ba9341f63 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:50.528341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e41c73eb-f8c6-494f-96f2-7f5ba9341f63 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:50.528758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e41c73eb-f8c6-494f-96f2-7f5ba9341f63 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:50.781264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:50.781967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:50.788592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:50.789210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:50.789759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:50.790558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:50.791110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:50.792332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:50.865384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e41c73eb-f8c6-494f-96f2-7f5ba9341f63 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:50.876510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:50.887134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:50.889079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e41c73eb-f8c6-494f-96f2-7f5ba9341f63 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.370486 Aug 06 12:52:50.889507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:50.891166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b7ff47fe-8672-47d3-bc96-2082539a6aa9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1734 microversion: 2.20 time: 0.115136 Aug 06 12:52:50.892545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 989/1967] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1734 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:52:50.900528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 979/1968] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:50 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:51.053652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-090c2969-21b1-42fa-a87f-1a398baec854 req-90bd0f88-dd11-47f7-9885-60dc689ea139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc407ff3-fc1e-44bf-9c20-73203361a20f", "name": "network-vif-deleted", "tag": "38e012d9-8547-43fd-8f63-fc6e18d35361"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:52:51.065903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-090c2969-21b1-42fa-a87f-1a398baec854 req-90bd0f88-dd11-47f7-9885-60dc689ea139 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:51.066811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-090c2969-21b1-42fa-a87f-1a398baec854 req-90bd0f88-dd11-47f7-9885-60dc689ea139 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:51.067319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-090c2969-21b1-42fa-a87f-1a398baec854 req-90bd0f88-dd11-47f7-9885-60dc689ea139 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:51.078885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-090c2969-21b1-42fa-a87f-1a398baec854 req-90bd0f88-dd11-47f7-9885-60dc689ea139 service nova] Creating event network-vif-deleted:38e012d9-8547-43fd-8f63-fc6e18d35361 for instance dc407ff3-fc1e-44bf-9c20-73203361a20f on hv-cinder-85199 Aug 06 12:52:51.083962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-090c2969-21b1-42fa-a87f-1a398baec854 req-90bd0f88-dd11-47f7-9885-60dc689ea139 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117291 Aug 06 12:52:51.084755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 990/1969] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:52:51.527448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2737decd-c6e5-47d9-b586-11238aaaf516 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:51.528285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2737decd-c6e5-47d9-b586-11238aaaf516 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:51.536759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2737decd-c6e5-47d9-b586-11238aaaf516 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:51.537341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2737decd-c6e5-47d9-b586-11238aaaf516 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:51.537930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2737decd-c6e5-47d9-b586-11238aaaf516 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:51.538656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2737decd-c6e5-47d9-b586-11238aaaf516 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:51.539206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2737decd-c6e5-47d9-b586-11238aaaf516 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:51.539692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2737decd-c6e5-47d9-b586-11238aaaf516 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:51.685722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2737decd-c6e5-47d9-b586-11238aaaf516 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:51.694121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2737decd-c6e5-47d9-b586-11238aaaf516 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.170425 Aug 06 12:52:51.694982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 980/1970] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:51.928019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8c9ca40-17f1-4937-baa2-72e21bfb0ba5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:51.929053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:51.930043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8c9ca40-17f1-4937-baa2-72e21bfb0ba5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:51.930521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:51.938085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c9ca40-17f1-4937-baa2-72e21bfb0ba5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:51.940282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:51.940815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:51.941251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:51.942069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:51.942512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:51.942817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:51.947931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c9ca40-17f1-4937-baa2-72e21bfb0ba5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:51.948734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c9ca40-17f1-4937-baa2-72e21bfb0ba5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:51.949911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c9ca40-17f1-4937-baa2-72e21bfb0ba5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:51.950587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c9ca40-17f1-4937-baa2-72e21bfb0ba5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:51.951246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8c9ca40-17f1-4937-baa2-72e21bfb0ba5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:52.051743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:52.060421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:52.063000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:52.065505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-23f17902-4296-4d91-bae5-af7f032833cf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.141077 Aug 06 12:52:52.074586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 991/1971] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:52:52.098719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8c9ca40-17f1-4937-baa2-72e21bfb0ba5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:52.107453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8c9ca40-17f1-4937-baa2-72e21bfb0ba5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.183118 Aug 06 12:52:52.108200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 981/1972] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:51 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:52.715021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7fcd186e-dace-4c9f-bf97-ff45a020d050 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:52.715630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7fcd186e-dace-4c9f-bf97-ff45a020d050 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:52.723068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fcd186e-dace-4c9f-bf97-ff45a020d050 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:52.723772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fcd186e-dace-4c9f-bf97-ff45a020d050 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:52.724639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fcd186e-dace-4c9f-bf97-ff45a020d050 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:52.725853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fcd186e-dace-4c9f-bf97-ff45a020d050 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:52.726315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fcd186e-dace-4c9f-bf97-ff45a020d050 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:52.726901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fcd186e-dace-4c9f-bf97-ff45a020d050 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:52.946268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7fcd186e-dace-4c9f-bf97-ff45a020d050 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:52.955547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7fcd186e-dace-4c9f-bf97-ff45a020d050 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.244375 Aug 06 12:52:52.956141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 992/1973] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:52 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:53.088676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:53.089337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:53.096168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:53.096688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:53.097126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:53.097877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:53.098280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:53.098705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:53.128964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-581bd886-6888-45ea-bc82-efa76a0ace01 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:53.129597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-581bd886-6888-45ea-bc82-efa76a0ace01 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:53.145769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-581bd886-6888-45ea-bc82-efa76a0ace01 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:53.148339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-581bd886-6888-45ea-bc82-efa76a0ace01 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:53.148990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-581bd886-6888-45ea-bc82-efa76a0ace01 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:53.149867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-581bd886-6888-45ea-bc82-efa76a0ace01 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:53.151330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-581bd886-6888-45ea-bc82-efa76a0ace01 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:53.153603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-581bd886-6888-45ea-bc82-efa76a0ace01 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:53.167828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:53.181840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:53.183754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:53.185165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-28b4c0e2-f22b-4ded-b3da-476e236dfcc6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.100469 Aug 06 12:52:53.186004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 982/1974] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:52:53.399711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-581bd886-6888-45ea-bc82-efa76a0ace01 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:53.408544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-581bd886-6888-45ea-bc82-efa76a0ace01 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.283262 Aug 06 12:52:53.419546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 993/1975] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:53 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:53.977195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c0d96bd5-fd9c-4c6a-81cb-2a9e2dc27634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:53.977909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c0d96bd5-fd9c-4c6a-81cb-2a9e2dc27634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:53.980046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:52:53.988562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0d96bd5-fd9c-4c6a-81cb-2a9e2dc27634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:53.989120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0d96bd5-fd9c-4c6a-81cb-2a9e2dc27634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:53.989598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0d96bd5-fd9c-4c6a-81cb-2a9e2dc27634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:53.990324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0d96bd5-fd9c-4c6a-81cb-2a9e2dc27634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:53.990836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0d96bd5-fd9c-4c6a-81cb-2a9e2dc27634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:53.991273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0d96bd5-fd9c-4c6a-81cb-2a9e2dc27634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:54.137661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c0d96bd5-fd9c-4c6a-81cb-2a9e2dc27634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:54.145940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c0d96bd5-fd9c-4c6a-81cb-2a9e2dc27634 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.172862 Aug 06 12:52:54.160946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 983/1976] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:53 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:54.214655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:54.215470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:54.222598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:54.223497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:54.224154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:54.225017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:54.225639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:54.226163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:54.294500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:54.303544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:54.305070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:54.306205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b023956e-8d86-4716-bb49-04d538354e3d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.096501 Aug 06 12:52:54.306802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 994/1977] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:52:54.430227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d5c4ab2-4085-4fbb-93b0-c591ce1561ca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:54.430800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d5c4ab2-4085-4fbb-93b0-c591ce1561ca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:54.437195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d5c4ab2-4085-4fbb-93b0-c591ce1561ca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:54.437711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d5c4ab2-4085-4fbb-93b0-c591ce1561ca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:54.438153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d5c4ab2-4085-4fbb-93b0-c591ce1561ca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:54.438850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d5c4ab2-4085-4fbb-93b0-c591ce1561ca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:54.439307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d5c4ab2-4085-4fbb-93b0-c591ce1561ca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:54.439785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d5c4ab2-4085-4fbb-93b0-c591ce1561ca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:54.632782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d5c4ab2-4085-4fbb-93b0-c591ce1561ca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:54.641240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d5c4ab2-4085-4fbb-93b0-c591ce1561ca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.214852 Aug 06 12:52:54.641953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 984/1978] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:54 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:55.176002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7fb530da-9a22-4e74-8fac-2e022f429c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:55.176639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7fb530da-9a22-4e74-8fac-2e022f429c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:55.179939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:52:55.202093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fb530da-9a22-4e74-8fac-2e022f429c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:55.202594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fb530da-9a22-4e74-8fac-2e022f429c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:55.203024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fb530da-9a22-4e74-8fac-2e022f429c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:55.203731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fb530da-9a22-4e74-8fac-2e022f429c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:55.204369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fb530da-9a22-4e74-8fac-2e022f429c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:55.204802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fb530da-9a22-4e74-8fac-2e022f429c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:55.331363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:55.332293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:55.339118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:55.339746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:55.340179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:55.340964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:55.341414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:55.341829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:55.346268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7fb530da-9a22-4e74-8fac-2e022f429c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:55.357287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7fb530da-9a22-4e74-8fac-2e022f429c5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.185136 Aug 06 12:52:55.358074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 995/1979] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:55 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:55.416498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:55.425245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:55.426780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:55.427912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-309a99b0-2e88-4a28-9057-877e38fce26b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.102494 Aug 06 12:52:55.428489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 985/1980] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:52:55.662906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a560e14-df03-4409-b628-e1306fa90437 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:55.663546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a560e14-df03-4409-b628-e1306fa90437 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:55.669415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a560e14-df03-4409-b628-e1306fa90437 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:55.670040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a560e14-df03-4409-b628-e1306fa90437 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:55.670557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a560e14-df03-4409-b628-e1306fa90437 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:55.671319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a560e14-df03-4409-b628-e1306fa90437 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:55.671779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a560e14-df03-4409-b628-e1306fa90437 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:55.672239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a560e14-df03-4409-b628-e1306fa90437 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:55.810652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a560e14-df03-4409-b628-e1306fa90437 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:55.818612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a560e14-df03-4409-b628-e1306fa90437 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.159658 Aug 06 12:52:55.819206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 996/1981] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:55 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:56.380007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-58927ccf-15b8-43c5-9709-77dafb3d0faa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:56.380633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-58927ccf-15b8-43c5-9709-77dafb3d0faa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:56.386970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58927ccf-15b8-43c5-9709-77dafb3d0faa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:56.387442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58927ccf-15b8-43c5-9709-77dafb3d0faa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:56.387870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58927ccf-15b8-43c5-9709-77dafb3d0faa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:56.388572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58927ccf-15b8-43c5-9709-77dafb3d0faa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:56.389019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58927ccf-15b8-43c5-9709-77dafb3d0faa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:56.389440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58927ccf-15b8-43c5-9709-77dafb3d0faa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:56.450432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:56.451025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:56.457304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:56.457780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:56.458202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:56.459070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:56.459518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:56.459936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:56.521971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-58927ccf-15b8-43c5-9709-77dafb3d0faa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:56.524011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:56.529535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-58927ccf-15b8-43c5-9709-77dafb3d0faa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153312 Aug 06 12:52:56.530101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 986/1982] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:56.532462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:56.533942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:56.535122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-20ec48b6-57b4-440d-bc70-6e789ba5a590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088628 Aug 06 12:52:56.535664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 997/1983] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:56 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:52:56.840737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1b5171bc-e8f3-4029-9025-210e1fa58302 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:56.841339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1b5171bc-e8f3-4029-9025-210e1fa58302 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:56.847687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b5171bc-e8f3-4029-9025-210e1fa58302 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:56.848186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b5171bc-e8f3-4029-9025-210e1fa58302 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:56.848642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b5171bc-e8f3-4029-9025-210e1fa58302 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:56.849315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b5171bc-e8f3-4029-9025-210e1fa58302 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:56.849787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b5171bc-e8f3-4029-9025-210e1fa58302 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:56.850205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b5171bc-e8f3-4029-9025-210e1fa58302 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:56.865370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:52:56.980069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1b5171bc-e8f3-4029-9025-210e1fa58302 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:56.988796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1b5171bc-e8f3-4029-9025-210e1fa58302 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151879 Aug 06 12:52:56.989589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 987/1984] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:56 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:57.550417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4107d4e-8288-485c-af13-414d86264412 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:57.551021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c4107d4e-8288-485c-af13-414d86264412 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:57.557361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:57.557803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4107d4e-8288-485c-af13-414d86264412 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:57.557905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4107d4e-8288-485c-af13-414d86264412 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:57.557997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:57.558284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4107d4e-8288-485c-af13-414d86264412 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:57.558963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4107d4e-8288-485c-af13-414d86264412 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:57.559529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4107d4e-8288-485c-af13-414d86264412 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:57.559814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4107d4e-8288-485c-af13-414d86264412 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:57.564773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:57.565260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:57.565699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:57.566408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:57.566846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:57.567275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:57.630202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:57.639102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:57.640670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:57.642545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0447f966-6149-41e8-b9d0-3145015a762f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089000 Aug 06 12:52:57.643399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 988/1985] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:52:57.693478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c4107d4e-8288-485c-af13-414d86264412 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:57.701332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c4107d4e-8288-485c-af13-414d86264412 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.154745 Aug 06 12:52:57.701878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 998/1986] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:57 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:58.009791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d038df3-dccf-4513-88c1-78afdac5296d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:58.010394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3d038df3-dccf-4513-88c1-78afdac5296d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:58.016779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d038df3-dccf-4513-88c1-78afdac5296d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:58.017250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d038df3-dccf-4513-88c1-78afdac5296d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:58.017675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d038df3-dccf-4513-88c1-78afdac5296d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:58.018346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d038df3-dccf-4513-88c1-78afdac5296d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:58.018788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d038df3-dccf-4513-88c1-78afdac5296d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:58.019202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d038df3-dccf-4513-88c1-78afdac5296d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:58.147105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3d038df3-dccf-4513-88c1-78afdac5296d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:58.154932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3d038df3-dccf-4513-88c1-78afdac5296d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149039 Aug 06 12:52:58.155492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 989/1987] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:58 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:58.665296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:58.666036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:58.672687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:58.673167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:58.673591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:58.674273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:58.674716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:58.675135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:58.723444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-52945559-c48d-4c6c-b14c-87a020a08141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:58.724021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-52945559-c48d-4c6c-b14c-87a020a08141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:58.730526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52945559-c48d-4c6c-b14c-87a020a08141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:58.731006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52945559-c48d-4c6c-b14c-87a020a08141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:58.731435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52945559-c48d-4c6c-b14c-87a020a08141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:58.732148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52945559-c48d-4c6c-b14c-87a020a08141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:58.732634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52945559-c48d-4c6c-b14c-87a020a08141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:58.733051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52945559-c48d-4c6c-b14c-87a020a08141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:58.743262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:58.751948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:58.753588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:58.754814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-682a640e-3713-424a-9afb-90df3f7e0e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.093886 Aug 06 12:52:58.755370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 999/1988] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:52:58.864476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-52945559-c48d-4c6c-b14c-87a020a08141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:58.872333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-52945559-c48d-4c6c-b14c-87a020a08141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153460 Aug 06 12:52:58.872910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 990/1989] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:52:59.176899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5fd5a392-a7c9-43a4-82e3-e082a7687d4b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:59.177497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5fd5a392-a7c9-43a4-82e3-e082a7687d4b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:59.183475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd5a392-a7c9-43a4-82e3-e082a7687d4b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:59.183944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd5a392-a7c9-43a4-82e3-e082a7687d4b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:59.184395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd5a392-a7c9-43a4-82e3-e082a7687d4b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:59.185069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd5a392-a7c9-43a4-82e3-e082a7687d4b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:59.185510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd5a392-a7c9-43a4-82e3-e082a7687d4b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:59.185926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd5a392-a7c9-43a4-82e3-e082a7687d4b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:59.311791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5fd5a392-a7c9-43a4-82e3-e082a7687d4b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:59.320191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5fd5a392-a7c9-43a4-82e3-e082a7687d4b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147236 Aug 06 12:52:59.320775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1000/1990] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:59 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:52:59.777891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:59.778488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:59.785350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:59.785822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:59.786247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:59.786923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:59.787367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:59.787784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:59.847530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:59.855734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:59.857241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:52:59.858366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16da0051-9fb8-4a76-b8c2-68ab3c248d8f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084370 Aug 06 12:52:59.858915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 991/1991] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:52:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:52:59.894472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-91e0c87c-f81d-4b48-a8da-8f0a5ba34359 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:52:59.895074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-91e0c87c-f81d-4b48-a8da-8f0a5ba34359 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:52:59.901604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91e0c87c-f81d-4b48-a8da-8f0a5ba34359 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:59.902074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91e0c87c-f81d-4b48-a8da-8f0a5ba34359 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:59.902501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91e0c87c-f81d-4b48-a8da-8f0a5ba34359 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:52:59.903171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91e0c87c-f81d-4b48-a8da-8f0a5ba34359 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:52:59.903615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91e0c87c-f81d-4b48-a8da-8f0a5ba34359 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:52:59.904047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91e0c87c-f81d-4b48-a8da-8f0a5ba34359 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:00.231939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-91e0c87c-f81d-4b48-a8da-8f0a5ba34359 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:00.240550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-91e0c87c-f81d-4b48-a8da-8f0a5ba34359 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.350448 Aug 06 12:53:00.241105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1001/1992] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:52:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:00.345030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db9590a1-755b-4820-8d1a-55fef10dad79 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:00.345636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db9590a1-755b-4820-8d1a-55fef10dad79 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:00.351535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db9590a1-755b-4820-8d1a-55fef10dad79 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:00.352013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db9590a1-755b-4820-8d1a-55fef10dad79 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:00.352476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db9590a1-755b-4820-8d1a-55fef10dad79 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:00.353158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db9590a1-755b-4820-8d1a-55fef10dad79 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:00.353606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db9590a1-755b-4820-8d1a-55fef10dad79 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:00.354026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db9590a1-755b-4820-8d1a-55fef10dad79 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:00.481271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db9590a1-755b-4820-8d1a-55fef10dad79 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:00.490029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db9590a1-755b-4820-8d1a-55fef10dad79 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150879 Aug 06 12:53:00.490647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 992/1993] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:00 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:00.881368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:00.881975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:00.887982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:00.888501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:00.888936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:00.889624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:00.890075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:00.890495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:00.950969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:00.960032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:00.961577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:00.962709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-872add3a-a1a9-4299-a4aa-c5b8279fe002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085330 Aug 06 12:53:00.963258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1002/1994] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:01.261886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3b1cf17-a1bc-4238-9cfa-eb10ca580ec2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:01.262489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d3b1cf17-a1bc-4238-9cfa-eb10ca580ec2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:01.269603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b1cf17-a1bc-4238-9cfa-eb10ca580ec2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:01.270083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b1cf17-a1bc-4238-9cfa-eb10ca580ec2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:01.270517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b1cf17-a1bc-4238-9cfa-eb10ca580ec2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:01.271204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b1cf17-a1bc-4238-9cfa-eb10ca580ec2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:01.271660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b1cf17-a1bc-4238-9cfa-eb10ca580ec2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:01.272085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b1cf17-a1bc-4238-9cfa-eb10ca580ec2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:01.400326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d3b1cf17-a1bc-4238-9cfa-eb10ca580ec2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:01.408098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3b1cf17-a1bc-4238-9cfa-eb10ca580ec2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150091 Aug 06 12:53:01.408681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 993/1995] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:01 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:01.510905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ec75a2ab-54fb-414c-8abf-1b4759dab080 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:01.511533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ec75a2ab-54fb-414c-8abf-1b4759dab080 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:01.517442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec75a2ab-54fb-414c-8abf-1b4759dab080 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:01.517919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec75a2ab-54fb-414c-8abf-1b4759dab080 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:01.518346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec75a2ab-54fb-414c-8abf-1b4759dab080 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:01.519025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec75a2ab-54fb-414c-8abf-1b4759dab080 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:01.519473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec75a2ab-54fb-414c-8abf-1b4759dab080 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:01.519893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec75a2ab-54fb-414c-8abf-1b4759dab080 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:01.648414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ec75a2ab-54fb-414c-8abf-1b4759dab080 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:01.656183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ec75a2ab-54fb-414c-8abf-1b4759dab080 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149091 Aug 06 12:53:01.656780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1003/1996] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:01 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:01.987302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:01.987829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:01.993850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:01.994336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:01.994886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:01.995577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:01.996115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:01.996563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:02.059289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:02.068077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:02.069616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:02.070744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1d18c8ec-c200-4f8d-9e30-5056631cf494 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087727 Aug 06 12:53:02.071301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 994/1997] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:02.427919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-63efed9c-3c30-4bd5-85a1-40f670b190b0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:02.428551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-63efed9c-3c30-4bd5-85a1-40f670b190b0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:02.435026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63efed9c-3c30-4bd5-85a1-40f670b190b0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:02.435515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63efed9c-3c30-4bd5-85a1-40f670b190b0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:02.435947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63efed9c-3c30-4bd5-85a1-40f670b190b0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:02.436674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63efed9c-3c30-4bd5-85a1-40f670b190b0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:02.437129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63efed9c-3c30-4bd5-85a1-40f670b190b0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:02.437552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63efed9c-3c30-4bd5-85a1-40f670b190b0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:02.562814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-63efed9c-3c30-4bd5-85a1-40f670b190b0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:02.565007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:02.571895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-63efed9c-3c30-4bd5-85a1-40f670b190b0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147838 Aug 06 12:53:02.572489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1004/1998] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:02 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:02.676714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5b661cc7-13fb-4af1-9ba1-4e9e60b2937e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:02.677315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5b661cc7-13fb-4af1-9ba1-4e9e60b2937e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:02.683562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b661cc7-13fb-4af1-9ba1-4e9e60b2937e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:02.684034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b661cc7-13fb-4af1-9ba1-4e9e60b2937e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:02.684492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b661cc7-13fb-4af1-9ba1-4e9e60b2937e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:02.685169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b661cc7-13fb-4af1-9ba1-4e9e60b2937e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:02.685611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b661cc7-13fb-4af1-9ba1-4e9e60b2937e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:02.686027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b661cc7-13fb-4af1-9ba1-4e9e60b2937e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:02.817627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b661cc7-13fb-4af1-9ba1-4e9e60b2937e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:02.825431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5b661cc7-13fb-4af1-9ba1-4e9e60b2937e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152560 Aug 06 12:53:02.825985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 995/1999] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:02 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:03.094609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:03.095152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:03.101056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:03.101533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:03.101966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:03.102655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:03.103109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:03.103534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:03.165509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:03.173878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:03.175380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:03.176541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-db419bc7-2138-4605-b476-290746292be7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086783 Aug 06 12:53:03.177102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1005/2000] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:03.593449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f772e83e-4b76-4dc8-a64f-85c878fdc550 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:03.594060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f772e83e-4b76-4dc8-a64f-85c878fdc550 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:03.600014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f772e83e-4b76-4dc8-a64f-85c878fdc550 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:03.600532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f772e83e-4b76-4dc8-a64f-85c878fdc550 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:03.601002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f772e83e-4b76-4dc8-a64f-85c878fdc550 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:03.601687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f772e83e-4b76-4dc8-a64f-85c878fdc550 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:03.602150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f772e83e-4b76-4dc8-a64f-85c878fdc550 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:03.602574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f772e83e-4b76-4dc8-a64f-85c878fdc550 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:03.737224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f772e83e-4b76-4dc8-a64f-85c878fdc550 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:03.745093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f772e83e-4b76-4dc8-a64f-85c878fdc550 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.155518 Aug 06 12:53:03.745654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 996/2001] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:03 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:03.846982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b67e1186-70fa-4b18-925b-e3533ea01833 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:03.847520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b67e1186-70fa-4b18-925b-e3533ea01833 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:03.853909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67e1186-70fa-4b18-925b-e3533ea01833 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:03.854386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67e1186-70fa-4b18-925b-e3533ea01833 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:03.854811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67e1186-70fa-4b18-925b-e3533ea01833 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:03.855492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67e1186-70fa-4b18-925b-e3533ea01833 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:03.855945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67e1186-70fa-4b18-925b-e3533ea01833 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:03.856389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67e1186-70fa-4b18-925b-e3533ea01833 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:03.989784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b67e1186-70fa-4b18-925b-e3533ea01833 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:03.998058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b67e1186-70fa-4b18-925b-e3533ea01833 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154977 Aug 06 12:53:03.998617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1006/2002] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:03 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:04.199108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:04.199655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:04.205546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:04.206017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:04.206443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:04.207110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:04.207550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:04.207964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:04.270277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:04.278501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:04.279987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:04.281136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5b2cf988-fe9d-4c30-adf8-ea1153c4e47b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085996 Aug 06 12:53:04.282216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 997/2003] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:04.768978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-63dcb0ab-4954-435a-a3b2-27f140d090ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:04.769583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-63dcb0ab-4954-435a-a3b2-27f140d090ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:04.775472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63dcb0ab-4954-435a-a3b2-27f140d090ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:04.775949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63dcb0ab-4954-435a-a3b2-27f140d090ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:04.776402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63dcb0ab-4954-435a-a3b2-27f140d090ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:04.777084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63dcb0ab-4954-435a-a3b2-27f140d090ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:04.777559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63dcb0ab-4954-435a-a3b2-27f140d090ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:04.777979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63dcb0ab-4954-435a-a3b2-27f140d090ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:04.906669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-63dcb0ab-4954-435a-a3b2-27f140d090ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:04.914532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-63dcb0ab-4954-435a-a3b2-27f140d090ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149980 Aug 06 12:53:04.915084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1007/2004] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:05.020069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9f1f88fd-e41d-4899-b309-37ca7b9a5a32 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:05.020641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9f1f88fd-e41d-4899-b309-37ca7b9a5a32 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:05.027152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f1f88fd-e41d-4899-b309-37ca7b9a5a32 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:05.027626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f1f88fd-e41d-4899-b309-37ca7b9a5a32 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:05.028052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f1f88fd-e41d-4899-b309-37ca7b9a5a32 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:05.028761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f1f88fd-e41d-4899-b309-37ca7b9a5a32 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:05.029208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f1f88fd-e41d-4899-b309-37ca7b9a5a32 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:05.029624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f1f88fd-e41d-4899-b309-37ca7b9a5a32 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:05.154859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9f1f88fd-e41d-4899-b309-37ca7b9a5a32 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:05.162592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9f1f88fd-e41d-4899-b309-37ca7b9a5a32 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146985 Aug 06 12:53:05.163159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 998/2005] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:05 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:05.303555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:05.304157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:05.310108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:05.310585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:05.311014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:05.311694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:05.312140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:05.313223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:05.373603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:05.383003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:05.384729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:05.385874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-57063170-43b0-4386-ae8b-ceeb97c77918 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086261 Aug 06 12:53:05.386481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1008/2006] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:05.935141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d67a66ab-1ebf-4522-ad9a-5bed10bcc386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:05.935775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d67a66ab-1ebf-4522-ad9a-5bed10bcc386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:05.942318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d67a66ab-1ebf-4522-ad9a-5bed10bcc386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:05.942796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d67a66ab-1ebf-4522-ad9a-5bed10bcc386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:05.943230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d67a66ab-1ebf-4522-ad9a-5bed10bcc386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:05.943909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d67a66ab-1ebf-4522-ad9a-5bed10bcc386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:05.944381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d67a66ab-1ebf-4522-ad9a-5bed10bcc386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:05.944805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d67a66ab-1ebf-4522-ad9a-5bed10bcc386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:06.076378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d67a66ab-1ebf-4522-ad9a-5bed10bcc386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:06.084225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d67a66ab-1ebf-4522-ad9a-5bed10bcc386 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152932 Aug 06 12:53:06.084804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 999/2007] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:05 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:06.182977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d71509b3-2342-4898-a64a-2fc0a9295fc8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:06.183503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d71509b3-2342-4898-a64a-2fc0a9295fc8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:06.190536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d71509b3-2342-4898-a64a-2fc0a9295fc8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:06.191013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d71509b3-2342-4898-a64a-2fc0a9295fc8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:06.191438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d71509b3-2342-4898-a64a-2fc0a9295fc8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:06.192108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d71509b3-2342-4898-a64a-2fc0a9295fc8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:06.192574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d71509b3-2342-4898-a64a-2fc0a9295fc8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:06.192989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d71509b3-2342-4898-a64a-2fc0a9295fc8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:06.321560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d71509b3-2342-4898-a64a-2fc0a9295fc8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:06.329333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d71509b3-2342-4898-a64a-2fc0a9295fc8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150308 Aug 06 12:53:06.329910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1009/2008] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:06 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:06.409922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:06.410529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:06.416492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:06.416974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:06.417407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:06.418095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:06.418549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:06.418972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:06.481905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:06.490981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:06.492512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:06.493645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4c2cdd0e-d110-4d7f-b2e3-a0ada0f4f33e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088141 Aug 06 12:53:06.494201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1000/2009] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:06 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:07.105783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f0621185-41ba-4364-81f5-f43b6c15af77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:07.106391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f0621185-41ba-4364-81f5-f43b6c15af77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:07.112725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0621185-41ba-4364-81f5-f43b6c15af77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:07.113216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0621185-41ba-4364-81f5-f43b6c15af77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:07.113627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0621185-41ba-4364-81f5-f43b6c15af77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:07.114336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0621185-41ba-4364-81f5-f43b6c15af77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:07.114783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0621185-41ba-4364-81f5-f43b6c15af77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:07.115252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0621185-41ba-4364-81f5-f43b6c15af77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:07.240741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0621185-41ba-4364-81f5-f43b6c15af77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:07.248608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f0621185-41ba-4364-81f5-f43b6c15af77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147228 Aug 06 12:53:07.249177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1010/2010] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:07 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:07.350470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2a0033c8-1130-47dc-a014-5b2fe8744ed4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:07.351078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2a0033c8-1130-47dc-a014-5b2fe8744ed4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:07.357457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a0033c8-1130-47dc-a014-5b2fe8744ed4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:07.357946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a0033c8-1130-47dc-a014-5b2fe8744ed4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:07.358379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a0033c8-1130-47dc-a014-5b2fe8744ed4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:07.359066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a0033c8-1130-47dc-a014-5b2fe8744ed4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:07.359520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a0033c8-1130-47dc-a014-5b2fe8744ed4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:07.359945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a0033c8-1130-47dc-a014-5b2fe8744ed4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:07.487040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2a0033c8-1130-47dc-a014-5b2fe8744ed4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:07.494886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2a0033c8-1130-47dc-a014-5b2fe8744ed4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148308 Aug 06 12:53:07.495443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1001/2011] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:07 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:07.516503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:07.517108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:07.522885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:07.523362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:07.523793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:07.524518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:07.524964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:07.525387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:07.584870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:07.593066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:07.594560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:07.595682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c7eb808-3768-4e1d-a8c0-c3ec80d2117d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083111 Aug 06 12:53:07.596223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1011/2012] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:07 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:08.270739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e0063cc-7b86-4888-9bbe-e1d4628197de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:08.271272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e0063cc-7b86-4888-9bbe-e1d4628197de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:08.277237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e0063cc-7b86-4888-9bbe-e1d4628197de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:08.277743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e0063cc-7b86-4888-9bbe-e1d4628197de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:08.278173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e0063cc-7b86-4888-9bbe-e1d4628197de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:08.278857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e0063cc-7b86-4888-9bbe-e1d4628197de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:08.279305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e0063cc-7b86-4888-9bbe-e1d4628197de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:08.279729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e0063cc-7b86-4888-9bbe-e1d4628197de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:08.403751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e0063cc-7b86-4888-9bbe-e1d4628197de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:08.412169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e0063cc-7b86-4888-9bbe-e1d4628197de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145482 Aug 06 12:53:08.412763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1002/2013] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:08 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:08.516922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-10515302-855f-4614-83dc-99a4f36d6f8a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:08.517519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-10515302-855f-4614-83dc-99a4f36d6f8a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:08.523822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10515302-855f-4614-83dc-99a4f36d6f8a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:08.524254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10515302-855f-4614-83dc-99a4f36d6f8a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:08.524757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10515302-855f-4614-83dc-99a4f36d6f8a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:08.525433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10515302-855f-4614-83dc-99a4f36d6f8a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:08.525875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10515302-855f-4614-83dc-99a4f36d6f8a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:08.526289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10515302-855f-4614-83dc-99a4f36d6f8a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:08.618641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:08.619328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:08.625822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:08.626394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:08.626826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:08.627503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:08.627954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:08.628397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:08.655839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10515302-855f-4614-83dc-99a4f36d6f8a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:08.663950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-10515302-855f-4614-83dc-99a4f36d6f8a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151297 Aug 06 12:53:08.665627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1012/2014] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:08 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:08.691621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:08.699862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:08.701374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:08.702493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-93a016d9-d74c-421d-ae88-f003c8ed3e01 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087728 Aug 06 12:53:08.703669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1003/2015] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:08 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:53:09.432365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6e85d4ed-79dc-4269-aeee-0b7d47a725b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:09.432971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6e85d4ed-79dc-4269-aeee-0b7d47a725b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:09.439377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e85d4ed-79dc-4269-aeee-0b7d47a725b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:09.439854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e85d4ed-79dc-4269-aeee-0b7d47a725b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:09.440285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e85d4ed-79dc-4269-aeee-0b7d47a725b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:09.440986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e85d4ed-79dc-4269-aeee-0b7d47a725b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:09.441435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e85d4ed-79dc-4269-aeee-0b7d47a725b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:09.441855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e85d4ed-79dc-4269-aeee-0b7d47a725b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:09.569568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6e85d4ed-79dc-4269-aeee-0b7d47a725b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:09.577413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6e85d4ed-79dc-4269-aeee-0b7d47a725b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148906 Aug 06 12:53:09.577969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1013/2016] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:09 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:09.685676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-92c501b5-fe48-4900-a7fb-d00210e4ae68 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:09.686347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-92c501b5-fe48-4900-a7fb-d00210e4ae68 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:09.693210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92c501b5-fe48-4900-a7fb-d00210e4ae68 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:09.693692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92c501b5-fe48-4900-a7fb-d00210e4ae68 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:09.694124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92c501b5-fe48-4900-a7fb-d00210e4ae68 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:09.694812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92c501b5-fe48-4900-a7fb-d00210e4ae68 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:09.695263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92c501b5-fe48-4900-a7fb-d00210e4ae68 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:09.695690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92c501b5-fe48-4900-a7fb-d00210e4ae68 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:09.698204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:09.724610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:09.725237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:09.731057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:09.731534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:09.731966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:09.732678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:09.733127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:09.733547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:09.795748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:09.804716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:09.806209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:09.807347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9f25311f-72bc-4ac5-82aa-97db474328f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086513 Aug 06 12:53:09.807932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1014/2017] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:53:09.824755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-92c501b5-fe48-4900-a7fb-d00210e4ae68 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:09.832669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-92c501b5-fe48-4900-a7fb-d00210e4ae68 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150925 Aug 06 12:53:09.833229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1004/2018] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:09 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:10.599016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a25f6a85-bf36-44ad-b14c-a3f931568645 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:10.599619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a25f6a85-bf36-44ad-b14c-a3f931568645 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:10.605910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a25f6a85-bf36-44ad-b14c-a3f931568645 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:10.606381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a25f6a85-bf36-44ad-b14c-a3f931568645 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:10.606806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a25f6a85-bf36-44ad-b14c-a3f931568645 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:10.607478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a25f6a85-bf36-44ad-b14c-a3f931568645 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:10.607922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a25f6a85-bf36-44ad-b14c-a3f931568645 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:10.608358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a25f6a85-bf36-44ad-b14c-a3f931568645 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:10.741948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a25f6a85-bf36-44ad-b14c-a3f931568645 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:10.749770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a25f6a85-bf36-44ad-b14c-a3f931568645 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.154567 Aug 06 12:53:10.750875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1015/2019] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:10 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:10.830476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:10.831080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:10.837512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:10.837990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:10.838421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:10.839105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:10.839558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:10.839970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:10.853525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-11f0cfeb-1cd1-4781-94f7-2b7650e71a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:10.854055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-11f0cfeb-1cd1-4781-94f7-2b7650e71a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:10.860675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11f0cfeb-1cd1-4781-94f7-2b7650e71a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:10.861150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11f0cfeb-1cd1-4781-94f7-2b7650e71a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:10.861575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11f0cfeb-1cd1-4781-94f7-2b7650e71a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:10.862256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11f0cfeb-1cd1-4781-94f7-2b7650e71a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:10.862698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11f0cfeb-1cd1-4781-94f7-2b7650e71a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:10.863115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11f0cfeb-1cd1-4781-94f7-2b7650e71a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:10.902144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:10.911136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:10.912734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:10.913876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9612fd2f-26e4-48db-84ab-55726a4d97af tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087333 Aug 06 12:53:10.914440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1005/2020] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:10 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:10.990000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-11f0cfeb-1cd1-4781-94f7-2b7650e71a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:10.998119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-11f0cfeb-1cd1-4781-94f7-2b7650e71a25 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148450 Aug 06 12:53:10.998703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1016/2021] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:10 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:11.771470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-21401e22-e88c-47b0-a20b-59f55fb68a13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:11.772080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-21401e22-e88c-47b0-a20b-59f55fb68a13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:11.778118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21401e22-e88c-47b0-a20b-59f55fb68a13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:11.778595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21401e22-e88c-47b0-a20b-59f55fb68a13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:11.779026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21401e22-e88c-47b0-a20b-59f55fb68a13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:11.779706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21401e22-e88c-47b0-a20b-59f55fb68a13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:11.780156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21401e22-e88c-47b0-a20b-59f55fb68a13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:11.780608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21401e22-e88c-47b0-a20b-59f55fb68a13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:11.907765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-21401e22-e88c-47b0-a20b-59f55fb68a13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:11.915617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-21401e22-e88c-47b0-a20b-59f55fb68a13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148053 Aug 06 12:53:11.916173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1006/2022] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:11 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:11.936466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:11.937056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:11.943285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:11.943735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:11.944157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:11.944860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:11.945302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:11.945714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:12.010066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:12.019025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:12.019343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-571e5b84-1c87-440f-989a-564d4d20ec4a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:12.019904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-571e5b84-1c87-440f-989a-564d4d20ec4a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:12.020534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:12.021715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-38c3397f-d2ad-432c-a028-972e5a686f74 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089066 Aug 06 12:53:12.022213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1017/2023] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:11 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:12.025861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-571e5b84-1c87-440f-989a-564d4d20ec4a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:12.026337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-571e5b84-1c87-440f-989a-564d4d20ec4a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:12.026764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-571e5b84-1c87-440f-989a-564d4d20ec4a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:12.027466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-571e5b84-1c87-440f-989a-564d4d20ec4a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:12.027896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-571e5b84-1c87-440f-989a-564d4d20ec4a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:12.028334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-571e5b84-1c87-440f-989a-564d4d20ec4a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:12.153619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-571e5b84-1c87-440f-989a-564d4d20ec4a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:12.162034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-571e5b84-1c87-440f-989a-564d4d20ec4a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147022 Aug 06 12:53:12.162589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1007/2024] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:12 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:12.936578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-34f2fbc5-528d-4f4b-811b-e902010057b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:12.937166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-34f2fbc5-528d-4f4b-811b-e902010057b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:12.943247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f2fbc5-528d-4f4b-811b-e902010057b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:12.943715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f2fbc5-528d-4f4b-811b-e902010057b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:12.944139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f2fbc5-528d-4f4b-811b-e902010057b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:12.944852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f2fbc5-528d-4f4b-811b-e902010057b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:12.945296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f2fbc5-528d-4f4b-811b-e902010057b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:12.945713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34f2fbc5-528d-4f4b-811b-e902010057b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:13.044486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:13.045110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:13.051251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:13.051723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:13.052152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:13.052858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:13.053308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:13.053721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:13.075906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34f2fbc5-528d-4f4b-811b-e902010057b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:13.084281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-34f2fbc5-528d-4f4b-811b-e902010057b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151503 Aug 06 12:53:13.084964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1018/2025] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:12 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:13.115702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:13.123862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:13.125869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:13.126988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f7c6d85e-1150-49bf-9335-82a9d890db85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086466 Aug 06 12:53:13.127536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1008/2026] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:13 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:53:13.182331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-faab3d41-008b-4446-81f8-097b5eb1de1e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:13.182937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-faab3d41-008b-4446-81f8-097b5eb1de1e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:13.189365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faab3d41-008b-4446-81f8-097b5eb1de1e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:13.189773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faab3d41-008b-4446-81f8-097b5eb1de1e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:13.190194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faab3d41-008b-4446-81f8-097b5eb1de1e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:13.190896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faab3d41-008b-4446-81f8-097b5eb1de1e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:13.191338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faab3d41-008b-4446-81f8-097b5eb1de1e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:13.191752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-faab3d41-008b-4446-81f8-097b5eb1de1e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:13.316061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-faab3d41-008b-4446-81f8-097b5eb1de1e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:13.323842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-faab3d41-008b-4446-81f8-097b5eb1de1e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145326 Aug 06 12:53:13.324417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1019/2027] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:13 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:14.105893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2750771e-e2f7-4abd-a333-735a5bab93da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:14.106491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2750771e-e2f7-4abd-a333-735a5bab93da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:14.113094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2750771e-e2f7-4abd-a333-735a5bab93da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:14.113568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2750771e-e2f7-4abd-a333-735a5bab93da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:14.113997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2750771e-e2f7-4abd-a333-735a5bab93da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:14.114676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2750771e-e2f7-4abd-a333-735a5bab93da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:14.115122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2750771e-e2f7-4abd-a333-735a5bab93da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:14.115538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2750771e-e2f7-4abd-a333-735a5bab93da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:14.148978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:14.149616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:14.155972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:14.156486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:14.156914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:14.157607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:14.158049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:14.158465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:14.222518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:14.230917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:14.232447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:14.233577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5001a680-0b5e-4f72-ae17-4af9e664013d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088514 Aug 06 12:53:14.234659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1020/2028] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:53:14.246282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2750771e-e2f7-4abd-a333-735a5bab93da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:14.254682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2750771e-e2f7-4abd-a333-735a5bab93da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152597 Aug 06 12:53:14.255228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1009/2029] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:14 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:14.344437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-55de8831-ebd9-4698-ad49-14a55a7e965e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:14.345040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-55de8831-ebd9-4698-ad49-14a55a7e965e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:14.350889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55de8831-ebd9-4698-ad49-14a55a7e965e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:14.351358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55de8831-ebd9-4698-ad49-14a55a7e965e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:14.351788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55de8831-ebd9-4698-ad49-14a55a7e965e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:14.352494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55de8831-ebd9-4698-ad49-14a55a7e965e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:14.352947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55de8831-ebd9-4698-ad49-14a55a7e965e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:14.353367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55de8831-ebd9-4698-ad49-14a55a7e965e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:14.368358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:14.480434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-55de8831-ebd9-4698-ad49-14a55a7e965e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:14.488936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-55de8831-ebd9-4698-ad49-14a55a7e965e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148346 Aug 06 12:53:14.489494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1021/2030] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:14 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:15.256451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:15.257054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:15.263325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:15.263800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:15.264229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:15.264931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:15.265880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:15.266298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:15.275799 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-04563fbb-7bd3-4c2a-bb47-f8cf46a6095b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:15.276458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-04563fbb-7bd3-4c2a-bb47-f8cf46a6095b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:15.283318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04563fbb-7bd3-4c2a-bb47-f8cf46a6095b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:15.283789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04563fbb-7bd3-4c2a-bb47-f8cf46a6095b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:15.284212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04563fbb-7bd3-4c2a-bb47-f8cf46a6095b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:15.284914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04563fbb-7bd3-4c2a-bb47-f8cf46a6095b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:15.285628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04563fbb-7bd3-4c2a-bb47-f8cf46a6095b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:15.286051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04563fbb-7bd3-4c2a-bb47-f8cf46a6095b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:15.328341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:15.336810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:15.338295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:15.339424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-33472326-6d85-4779-b815-892891d0d179 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086941 Aug 06 12:53:15.339980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1010/2031] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:15 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:15.415947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-04563fbb-7bd3-4c2a-bb47-f8cf46a6095b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:15.423687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-04563fbb-7bd3-4c2a-bb47-f8cf46a6095b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151603 Aug 06 12:53:15.424241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1022/2032] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:15 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:15.510330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-66eb5c42-59cd-4a34-83fa-5831557a58fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:15.510934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-66eb5c42-59cd-4a34-83fa-5831557a58fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:15.517431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66eb5c42-59cd-4a34-83fa-5831557a58fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:15.517904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66eb5c42-59cd-4a34-83fa-5831557a58fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:15.518333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66eb5c42-59cd-4a34-83fa-5831557a58fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:15.519010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66eb5c42-59cd-4a34-83fa-5831557a58fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:15.519456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66eb5c42-59cd-4a34-83fa-5831557a58fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:15.519874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66eb5c42-59cd-4a34-83fa-5831557a58fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:15.644072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-66eb5c42-59cd-4a34-83fa-5831557a58fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:15.651798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-66eb5c42-59cd-4a34-83fa-5831557a58fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145263 Aug 06 12:53:15.652373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1011/2033] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:15 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:16.364147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:16.364795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:16.370764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:16.371244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:16.371675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:16.372386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:16.372839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:16.373261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:16.436805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:16.445253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:16.445457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-516bd94c-f0bf-447f-9323-8d66e55e10a9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:16.446071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-516bd94c-f0bf-447f-9323-8d66e55e10a9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:16.446757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:16.449593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-396065c9-a167-4452-a44e-b7152ec75adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090260 Aug 06 12:53:16.450156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1023/2034] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:16.452291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516bd94c-f0bf-447f-9323-8d66e55e10a9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:16.452788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516bd94c-f0bf-447f-9323-8d66e55e10a9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:16.453215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516bd94c-f0bf-447f-9323-8d66e55e10a9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:16.453926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516bd94c-f0bf-447f-9323-8d66e55e10a9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:16.454372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516bd94c-f0bf-447f-9323-8d66e55e10a9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:16.454787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-516bd94c-f0bf-447f-9323-8d66e55e10a9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:16.587795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-516bd94c-f0bf-447f-9323-8d66e55e10a9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:16.596137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-516bd94c-f0bf-447f-9323-8d66e55e10a9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.154608 Aug 06 12:53:16.596737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1012/2035] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:16 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:16.672650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5333d4b3-be7b-4ed5-8469-59cc49e4cb0f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:16.673166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5333d4b3-be7b-4ed5-8469-59cc49e4cb0f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:16.678904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5333d4b3-be7b-4ed5-8469-59cc49e4cb0f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:16.679371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5333d4b3-be7b-4ed5-8469-59cc49e4cb0f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:16.679791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5333d4b3-be7b-4ed5-8469-59cc49e4cb0f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:16.680485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5333d4b3-be7b-4ed5-8469-59cc49e4cb0f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:16.680928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5333d4b3-be7b-4ed5-8469-59cc49e4cb0f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:16.681342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5333d4b3-be7b-4ed5-8469-59cc49e4cb0f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:16.806639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5333d4b3-be7b-4ed5-8469-59cc49e4cb0f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:16.814512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5333d4b3-be7b-4ed5-8469-59cc49e4cb0f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145701 Aug 06 12:53:16.815089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1024/2036] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:16 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:17.472500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:17.473108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:17.479445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:17.479928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:17.480408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:17.481100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:17.481553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:17.481978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:17.542491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:17.551189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:17.552697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:17.553822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-daa65d97-88dd-4532-96ee-847e5af51092 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085309 Aug 06 12:53:17.554375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1013/2037] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:17 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:17.617027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-82edd785-f63a-49ff-b94b-c73be67a84c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:17.617624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-82edd785-f63a-49ff-b94b-c73be67a84c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:17.623901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82edd785-f63a-49ff-b94b-c73be67a84c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:17.624395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82edd785-f63a-49ff-b94b-c73be67a84c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:17.624855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82edd785-f63a-49ff-b94b-c73be67a84c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:17.625530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82edd785-f63a-49ff-b94b-c73be67a84c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:17.625972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82edd785-f63a-49ff-b94b-c73be67a84c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:17.626388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82edd785-f63a-49ff-b94b-c73be67a84c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:17.750693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-82edd785-f63a-49ff-b94b-c73be67a84c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:17.758390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-82edd785-f63a-49ff-b94b-c73be67a84c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145140 Aug 06 12:53:17.758946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1025/2038] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:17 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:17.834793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-97bfecd5-0b61-46fe-9e6e-584913212908 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:17.835424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-97bfecd5-0b61-46fe-9e6e-584913212908 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:17.841254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97bfecd5-0b61-46fe-9e6e-584913212908 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:17.841727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97bfecd5-0b61-46fe-9e6e-584913212908 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:17.842156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97bfecd5-0b61-46fe-9e6e-584913212908 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:17.842833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97bfecd5-0b61-46fe-9e6e-584913212908 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:17.843766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97bfecd5-0b61-46fe-9e6e-584913212908 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:17.844188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97bfecd5-0b61-46fe-9e6e-584913212908 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:17.966381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-97bfecd5-0b61-46fe-9e6e-584913212908 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:17.974664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-97bfecd5-0b61-46fe-9e6e-584913212908 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.143704 Aug 06 12:53:17.975223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1014/2039] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:17 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:18.576744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:18.577342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:18.583908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:18.584403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:18.584828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:18.585499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:18.585943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:18.586355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:18.651348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:18.659611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:18.661151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:18.662278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0cdc9236-9a04-4be5-bbf9-cc6453939f6e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089386 Aug 06 12:53:18.662826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1026/2040] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:18.779070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8dbe32d6-28b8-4d85-9566-a2f55a6239d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:18.779704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8dbe32d6-28b8-4d85-9566-a2f55a6239d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:18.786080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8dbe32d6-28b8-4d85-9566-a2f55a6239d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:18.786556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8dbe32d6-28b8-4d85-9566-a2f55a6239d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:18.786992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8dbe32d6-28b8-4d85-9566-a2f55a6239d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:18.787676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8dbe32d6-28b8-4d85-9566-a2f55a6239d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:18.788128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8dbe32d6-28b8-4d85-9566-a2f55a6239d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:18.788572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8dbe32d6-28b8-4d85-9566-a2f55a6239d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:18.920174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8dbe32d6-28b8-4d85-9566-a2f55a6239d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:18.928583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8dbe32d6-28b8-4d85-9566-a2f55a6239d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153438 Aug 06 12:53:18.929152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1015/2041] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:18 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:18.996541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e6759c8b-6223-4864-a92b-9a401988c3bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:18.997183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e6759c8b-6223-4864-a92b-9a401988c3bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:19.003804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6759c8b-6223-4864-a92b-9a401988c3bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:19.004284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6759c8b-6223-4864-a92b-9a401988c3bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:19.004750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6759c8b-6223-4864-a92b-9a401988c3bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:19.005476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6759c8b-6223-4864-a92b-9a401988c3bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:19.005934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6759c8b-6223-4864-a92b-9a401988c3bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:19.006356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6759c8b-6223-4864-a92b-9a401988c3bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:19.136939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e6759c8b-6223-4864-a92b-9a401988c3bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:19.144826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e6759c8b-6223-4864-a92b-9a401988c3bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152219 Aug 06 12:53:19.145387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1027/2042] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:18 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:19.685877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:19.686506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:19.692407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:19.692890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:19.693323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:19.694022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:19.694455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:19.694877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:19.754653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:19.762875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:19.764404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:19.766041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b64c7a52-ca50-41ed-8662-e2fe2b29a3bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084108 Aug 06 12:53:19.766597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1016/2043] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:19.950501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a266052-a73c-408a-8bf1-714b8e59f878 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:19.951020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a266052-a73c-408a-8bf1-714b8e59f878 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:19.957969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a266052-a73c-408a-8bf1-714b8e59f878 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:19.958446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a266052-a73c-408a-8bf1-714b8e59f878 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:19.958881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a266052-a73c-408a-8bf1-714b8e59f878 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:19.959564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a266052-a73c-408a-8bf1-714b8e59f878 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:19.960022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a266052-a73c-408a-8bf1-714b8e59f878 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:19.960495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a266052-a73c-408a-8bf1-714b8e59f878 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:20.085341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a266052-a73c-408a-8bf1-714b8e59f878 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:20.093206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a266052-a73c-408a-8bf1-714b8e59f878 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146661 Aug 06 12:53:20.093769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1028/2044] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:19 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:20.165571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9e0873d-2825-4ce3-a6d9-dc61626a8697 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:20.166177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9e0873d-2825-4ce3-a6d9-dc61626a8697 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:20.172463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e0873d-2825-4ce3-a6d9-dc61626a8697 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:20.172933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e0873d-2825-4ce3-a6d9-dc61626a8697 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:20.173358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e0873d-2825-4ce3-a6d9-dc61626a8697 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:20.174030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e0873d-2825-4ce3-a6d9-dc61626a8697 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:20.174476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e0873d-2825-4ce3-a6d9-dc61626a8697 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:20.174891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e0873d-2825-4ce3-a6d9-dc61626a8697 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:20.302079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9e0873d-2825-4ce3-a6d9-dc61626a8697 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:20.309831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9e0873d-2825-4ce3-a6d9-dc61626a8697 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148024 Aug 06 12:53:20.310389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1017/2045] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:20 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:20.788989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:20.789582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:20.795720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:20.796197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:20.797226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:20.797906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:20.798353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:20.798816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:20.866433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:20.874935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:20.876503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:20.877578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-21173cd3-8dd7-47e6-ab8f-408d671d1536 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.092501 Aug 06 12:53:20.878121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1029/2046] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:21.114475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5ba4b6a9-a931-4943-9dc0-24f5eac21101 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:21.115075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5ba4b6a9-a931-4943-9dc0-24f5eac21101 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:21.121286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ba4b6a9-a931-4943-9dc0-24f5eac21101 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:21.122031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ba4b6a9-a931-4943-9dc0-24f5eac21101 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:21.122460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ba4b6a9-a931-4943-9dc0-24f5eac21101 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:21.123135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ba4b6a9-a931-4943-9dc0-24f5eac21101 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:21.123579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ba4b6a9-a931-4943-9dc0-24f5eac21101 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:21.123993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ba4b6a9-a931-4943-9dc0-24f5eac21101 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:21.250120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5ba4b6a9-a931-4943-9dc0-24f5eac21101 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:21.258590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5ba4b6a9-a931-4943-9dc0-24f5eac21101 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148194 Aug 06 12:53:21.259159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1018/2047] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:21 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:21.330805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-47b39e79-6f77-4be7-8ed9-1cd31387b89e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:21.331446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-47b39e79-6f77-4be7-8ed9-1cd31387b89e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:21.339050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47b39e79-6f77-4be7-8ed9-1cd31387b89e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:21.339923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47b39e79-6f77-4be7-8ed9-1cd31387b89e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:21.340745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47b39e79-6f77-4be7-8ed9-1cd31387b89e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:21.342044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47b39e79-6f77-4be7-8ed9-1cd31387b89e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:21.342863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47b39e79-6f77-4be7-8ed9-1cd31387b89e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:21.344149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-47b39e79-6f77-4be7-8ed9-1cd31387b89e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:21.473733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-47b39e79-6f77-4be7-8ed9-1cd31387b89e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:21.481576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-47b39e79-6f77-4be7-8ed9-1cd31387b89e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154571 Aug 06 12:53:21.482138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1030/2048] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:21 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:21.900046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:21.900744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:21.907557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:21.908026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:21.908492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:21.909170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:21.909615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:21.910030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:21.970257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:21.980913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:21.982449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:21.983619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ae043957-bead-4285-92d7-c83d17ea436b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087448 Aug 06 12:53:21.984177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1019/2049] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:21 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:22.280067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d410f0ae-7f81-4c8f-b2ee-8687ca890ec3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:22.280651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d410f0ae-7f81-4c8f-b2ee-8687ca890ec3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:22.286592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d410f0ae-7f81-4c8f-b2ee-8687ca890ec3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:22.287066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d410f0ae-7f81-4c8f-b2ee-8687ca890ec3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:22.287491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d410f0ae-7f81-4c8f-b2ee-8687ca890ec3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:22.288168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d410f0ae-7f81-4c8f-b2ee-8687ca890ec3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:22.288636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d410f0ae-7f81-4c8f-b2ee-8687ca890ec3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:22.289052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d410f0ae-7f81-4c8f-b2ee-8687ca890ec3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:22.416951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d410f0ae-7f81-4c8f-b2ee-8687ca890ec3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:22.424895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d410f0ae-7f81-4c8f-b2ee-8687ca890ec3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148879 Aug 06 12:53:22.425460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1031/2050] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:22 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:22.503596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27fcbc3e-57f0-48b0-859c-51ae85c5f510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:22.504206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27fcbc3e-57f0-48b0-859c-51ae85c5f510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:22.510916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27fcbc3e-57f0-48b0-859c-51ae85c5f510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:22.511389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27fcbc3e-57f0-48b0-859c-51ae85c5f510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:22.511815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27fcbc3e-57f0-48b0-859c-51ae85c5f510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:22.512611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27fcbc3e-57f0-48b0-859c-51ae85c5f510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:22.513067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27fcbc3e-57f0-48b0-859c-51ae85c5f510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:22.513484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27fcbc3e-57f0-48b0-859c-51ae85c5f510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:22.645415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-27fcbc3e-57f0-48b0-859c-51ae85c5f510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:22.647645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:22.655501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27fcbc3e-57f0-48b0-859c-51ae85c5f510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.156267 Aug 06 12:53:22.656186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1020/2051] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:22 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:23.006403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:23.007000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:23.013021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:23.013492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:23.013917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:23.014590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:23.015032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:23.015444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:23.078352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:23.086644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:23.088134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:23.089277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-92a72e7a-e703-45cd-b9e4-567ce5f7fc22 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086688 Aug 06 12:53:23.089820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1032/2052] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:23.446368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-858f382e-940d-43ed-a50c-a91005a5d157 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:23.446964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-858f382e-940d-43ed-a50c-a91005a5d157 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:23.453460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-858f382e-940d-43ed-a50c-a91005a5d157 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:23.453930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-858f382e-940d-43ed-a50c-a91005a5d157 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:23.454352 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-858f382e-940d-43ed-a50c-a91005a5d157 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:23.455026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-858f382e-940d-43ed-a50c-a91005a5d157 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:23.455476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-858f382e-940d-43ed-a50c-a91005a5d157 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:23.455888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-858f382e-940d-43ed-a50c-a91005a5d157 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:23.579482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-858f382e-940d-43ed-a50c-a91005a5d157 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:23.587201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-858f382e-940d-43ed-a50c-a91005a5d157 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.144657 Aug 06 12:53:23.587753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1021/2053] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:23.676665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27008e03-93c7-4338-9e53-0dc687d4e4cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:23.677268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-27008e03-93c7-4338-9e53-0dc687d4e4cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:23.683583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27008e03-93c7-4338-9e53-0dc687d4e4cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:23.684057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27008e03-93c7-4338-9e53-0dc687d4e4cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:23.684523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27008e03-93c7-4338-9e53-0dc687d4e4cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:23.685212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27008e03-93c7-4338-9e53-0dc687d4e4cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:23.685660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27008e03-93c7-4338-9e53-0dc687d4e4cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:23.686080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27008e03-93c7-4338-9e53-0dc687d4e4cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:23.813352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-27008e03-93c7-4338-9e53-0dc687d4e4cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:23.822232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-27008e03-93c7-4338-9e53-0dc687d4e4cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149093 Aug 06 12:53:23.823333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1033/2054] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:23 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:24.112917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:24.113516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:24.115365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=78 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:24.120508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:24.120984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:24.121412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:24.122084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:24.122529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:24.122946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:24.182749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:24.191914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:24.193456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:24.194603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4d1c45d-1a97-4a7c-b0c4-3118416c47c0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086349 Aug 06 12:53:24.195164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1022/2055] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:24.609444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0827836e-a0cd-4f61-bb73-50c8d360b4ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:24.610048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0827836e-a0cd-4f61-bb73-50c8d360b4ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:24.616159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0827836e-a0cd-4f61-bb73-50c8d360b4ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:24.616659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0827836e-a0cd-4f61-bb73-50c8d360b4ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:24.617087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0827836e-a0cd-4f61-bb73-50c8d360b4ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:24.617759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0827836e-a0cd-4f61-bb73-50c8d360b4ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:24.618205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0827836e-a0cd-4f61-bb73-50c8d360b4ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:24.618619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0827836e-a0cd-4f61-bb73-50c8d360b4ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:24.743283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0827836e-a0cd-4f61-bb73-50c8d360b4ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:24.751017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0827836e-a0cd-4f61-bb73-50c8d360b4ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146028 Aug 06 12:53:24.751564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1034/2056] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:24.844798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d6a0f2db-3a50-4a18-92f0-52615032b08d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:24.845404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d6a0f2db-3a50-4a18-92f0-52615032b08d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:24.851882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2db-3a50-4a18-92f0-52615032b08d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:24.852392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2db-3a50-4a18-92f0-52615032b08d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:24.852829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2db-3a50-4a18-92f0-52615032b08d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:24.853537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2db-3a50-4a18-92f0-52615032b08d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:24.853989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2db-3a50-4a18-92f0-52615032b08d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:24.854411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2db-3a50-4a18-92f0-52615032b08d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:24.985577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d6a0f2db-3a50-4a18-92f0-52615032b08d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:24.993714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d6a0f2db-3a50-4a18-92f0-52615032b08d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153367 Aug 06 12:53:24.994514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1023/2057] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:24 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:25.216533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:25.217084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:25.222971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:25.223451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:25.223877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:25.224605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:25.225061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:25.225487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:25.289503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:25.297871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:25.299370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:25.300531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bc8648e8-2a86-46fa-85ef-ae76fea7faf6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087967 Aug 06 12:53:25.301083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1035/2058] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:25.772509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-00800190-c977-48f0-a5c0-a4b32dfbb6c2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:25.773129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-00800190-c977-48f0-a5c0-a4b32dfbb6c2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:25.779101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00800190-c977-48f0-a5c0-a4b32dfbb6c2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:25.779580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00800190-c977-48f0-a5c0-a4b32dfbb6c2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:25.780014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00800190-c977-48f0-a5c0-a4b32dfbb6c2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:25.781369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00800190-c977-48f0-a5c0-a4b32dfbb6c2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:25.781817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00800190-c977-48f0-a5c0-a4b32dfbb6c2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:25.782241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00800190-c977-48f0-a5c0-a4b32dfbb6c2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:25.907007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-00800190-c977-48f0-a5c0-a4b32dfbb6c2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:25.915053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-00800190-c977-48f0-a5c0-a4b32dfbb6c2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146417 Aug 06 12:53:25.915640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1024/2059] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:25 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:26.015602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5ee7ed44-ad3a-4548-a238-8833b4bc6c7c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:26.016208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5ee7ed44-ad3a-4548-a238-8833b4bc6c7c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:26.018511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=82 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:26.023899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee7ed44-ad3a-4548-a238-8833b4bc6c7c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:26.024323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee7ed44-ad3a-4548-a238-8833b4bc6c7c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:26.024751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee7ed44-ad3a-4548-a238-8833b4bc6c7c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:26.025428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee7ed44-ad3a-4548-a238-8833b4bc6c7c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:26.025871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee7ed44-ad3a-4548-a238-8833b4bc6c7c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:26.026292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee7ed44-ad3a-4548-a238-8833b4bc6c7c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:26.152100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5ee7ed44-ad3a-4548-a238-8833b4bc6c7c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:26.159915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5ee7ed44-ad3a-4548-a238-8833b4bc6c7c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148801 Aug 06 12:53:26.160487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1036/2060] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:26 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:26.322837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:26.323461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:26.329296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:26.329768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:26.330193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:26.330868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:26.331315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:26.331730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:26.391730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:26.399922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:26.401429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:26.402543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c276b42a-ff6c-4545-9dd3-4ee9e880c4a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083557 Aug 06 12:53:26.403096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1025/2061] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:26.936443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-464708b0-68de-4595-8f01-ff19b0c08628 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:26.937038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-464708b0-68de-4595-8f01-ff19b0c08628 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:26.942895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-464708b0-68de-4595-8f01-ff19b0c08628 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:26.943365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-464708b0-68de-4595-8f01-ff19b0c08628 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:26.943790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-464708b0-68de-4595-8f01-ff19b0c08628 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:26.944490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-464708b0-68de-4595-8f01-ff19b0c08628 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:26.944934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-464708b0-68de-4595-8f01-ff19b0c08628 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:26.945345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-464708b0-68de-4595-8f01-ff19b0c08628 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:27.074263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-464708b0-68de-4595-8f01-ff19b0c08628 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:27.082704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-464708b0-68de-4595-8f01-ff19b0c08628 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150113 Aug 06 12:53:27.083249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1037/2062] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:27.180997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5ceec7e-a8e9-4df0-8138-31ef13ca83f6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:27.181613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5ceec7e-a8e9-4df0-8138-31ef13ca83f6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:27.188006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ceec7e-a8e9-4df0-8138-31ef13ca83f6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:27.188460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ceec7e-a8e9-4df0-8138-31ef13ca83f6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:27.188898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ceec7e-a8e9-4df0-8138-31ef13ca83f6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:27.189621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ceec7e-a8e9-4df0-8138-31ef13ca83f6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:27.190075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ceec7e-a8e9-4df0-8138-31ef13ca83f6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:27.190501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5ceec7e-a8e9-4df0-8138-31ef13ca83f6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:27.319037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5ceec7e-a8e9-4df0-8138-31ef13ca83f6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:27.326907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5ceec7e-a8e9-4df0-8138-31ef13ca83f6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149766 Aug 06 12:53:27.327999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1026/2063] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:27 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:27.425012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:27.425616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:27.431367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:27.431844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:27.432274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:27.432974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:27.433424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:27.433843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:27.436373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:27.496167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:27.504471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:27.505958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:27.507075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-94901946-7258-4d30-a50a-4cbec9f0359b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086525 Aug 06 12:53:27.507615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1038/2064] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:28.104512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38cc7909-1e13-44b0-815d-9baca0274a1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:28.105115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38cc7909-1e13-44b0-815d-9baca0274a1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:28.111341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38cc7909-1e13-44b0-815d-9baca0274a1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:28.111806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38cc7909-1e13-44b0-815d-9baca0274a1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:28.112237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38cc7909-1e13-44b0-815d-9baca0274a1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:28.112935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38cc7909-1e13-44b0-815d-9baca0274a1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:28.113379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38cc7909-1e13-44b0-815d-9baca0274a1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:28.113796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38cc7909-1e13-44b0-815d-9baca0274a1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:28.237837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-38cc7909-1e13-44b0-815d-9baca0274a1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:28.245706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38cc7909-1e13-44b0-815d-9baca0274a1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145070 Aug 06 12:53:28.246261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1027/2065] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:28 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:28.348704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4129eae5-5b06-48ac-97aa-12b51d0e9e47 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:28.349306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4129eae5-5b06-48ac-97aa-12b51d0e9e47 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:28.355581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4129eae5-5b06-48ac-97aa-12b51d0e9e47 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:28.356056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4129eae5-5b06-48ac-97aa-12b51d0e9e47 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:28.356526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4129eae5-5b06-48ac-97aa-12b51d0e9e47 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:28.357199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4129eae5-5b06-48ac-97aa-12b51d0e9e47 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:28.357640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4129eae5-5b06-48ac-97aa-12b51d0e9e47 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:28.358053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4129eae5-5b06-48ac-97aa-12b51d0e9e47 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:28.485558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4129eae5-5b06-48ac-97aa-12b51d0e9e47 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:28.493339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4129eae5-5b06-48ac-97aa-12b51d0e9e47 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148409 Aug 06 12:53:28.493895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1039/2066] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:28 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:28.529051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:28.529658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:28.536111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:28.536627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:28.537060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:28.537741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:28.538193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:28.538615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:28.598983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:28.607161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:28.608719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:28.609847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-156f683b-c113-4d21-bfe3-a0e6adab5fea tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084631 Aug 06 12:53:28.610659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1028/2067] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:53:29.267490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4a8d0cb-f7a3-4a38-8f26-b0a7405bae1c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:29.268047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c4a8d0cb-f7a3-4a38-8f26-b0a7405bae1c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:29.273942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4a8d0cb-f7a3-4a38-8f26-b0a7405bae1c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:29.274417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4a8d0cb-f7a3-4a38-8f26-b0a7405bae1c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:29.274844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4a8d0cb-f7a3-4a38-8f26-b0a7405bae1c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:29.275525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4a8d0cb-f7a3-4a38-8f26-b0a7405bae1c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:29.276002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4a8d0cb-f7a3-4a38-8f26-b0a7405bae1c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:29.276449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4a8d0cb-f7a3-4a38-8f26-b0a7405bae1c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:29.404527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c4a8d0cb-f7a3-4a38-8f26-b0a7405bae1c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:29.412483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c4a8d0cb-f7a3-4a38-8f26-b0a7405bae1c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148858 Aug 06 12:53:29.413062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1040/2068] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:29 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:29.513910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d81747c2-3260-4acf-91ae-1072d1b657b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:29.514520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d81747c2-3260-4acf-91ae-1072d1b657b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:29.520958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d81747c2-3260-4acf-91ae-1072d1b657b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:29.521380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d81747c2-3260-4acf-91ae-1072d1b657b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:29.521812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d81747c2-3260-4acf-91ae-1072d1b657b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:29.522502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d81747c2-3260-4acf-91ae-1072d1b657b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:29.522950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d81747c2-3260-4acf-91ae-1072d1b657b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:29.523374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d81747c2-3260-4acf-91ae-1072d1b657b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:29.632286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:29.632916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:29.638650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:29.639128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:29.639559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:29.640240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:29.640712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:29.641136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:29.652256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d81747c2-3260-4acf-91ae-1072d1b657b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:29.660864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d81747c2-3260-4acf-91ae-1072d1b657b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150768 Aug 06 12:53:29.661429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1029/2069] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:29 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:29.702016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:29.710311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:29.711801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:29.712960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ea2fa2dc-3c4a-4bba-be8d-8b7610fda6c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084582 Aug 06 12:53:29.713505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1041/2070] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:53:30.434079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4b2e97e8-c59b-4732-ad58-d7a4616561a6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:30.434689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4b2e97e8-c59b-4732-ad58-d7a4616561a6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:30.441247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b2e97e8-c59b-4732-ad58-d7a4616561a6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:30.441744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b2e97e8-c59b-4732-ad58-d7a4616561a6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:30.442180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b2e97e8-c59b-4732-ad58-d7a4616561a6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:30.442882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b2e97e8-c59b-4732-ad58-d7a4616561a6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:30.443340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b2e97e8-c59b-4732-ad58-d7a4616561a6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:30.443768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b2e97e8-c59b-4732-ad58-d7a4616561a6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:30.647411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4b2e97e8-c59b-4732-ad58-d7a4616561a6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:30.655252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4b2e97e8-c59b-4732-ad58-d7a4616561a6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.225051 Aug 06 12:53:30.655812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1030/2071] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:30 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:30.683391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c0fc91fa-03a4-4185-9093-9c075d452454 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:30.683997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c0fc91fa-03a4-4185-9093-9c075d452454 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:30.691470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0fc91fa-03a4-4185-9093-9c075d452454 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:30.692293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0fc91fa-03a4-4185-9093-9c075d452454 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:30.692744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0fc91fa-03a4-4185-9093-9c075d452454 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:30.693430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0fc91fa-03a4-4185-9093-9c075d452454 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:30.694141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0fc91fa-03a4-4185-9093-9c075d452454 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:30.694562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0fc91fa-03a4-4185-9093-9c075d452454 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:30.735682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:30.736286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:30.742101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:30.742574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:30.742999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:30.743680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:30.744122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:30.744576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:30.806995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:30.816280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:30.817799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:30.818939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ec8f5b8-c24e-4bcd-8cef-60bf43abd543 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087900 Aug 06 12:53:30.819699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1031/2072] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:53:30.825873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c0fc91fa-03a4-4185-9093-9c075d452454 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:30.834097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c0fc91fa-03a4-4185-9093-9c075d452454 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.155707 Aug 06 12:53:30.834653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1042/2073] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:30 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:31.676574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3796a88-6105-4462-8d90-028069a70846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:31.677190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d3796a88-6105-4462-8d90-028069a70846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:31.683494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3796a88-6105-4462-8d90-028069a70846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:31.683969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3796a88-6105-4462-8d90-028069a70846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:31.684429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3796a88-6105-4462-8d90-028069a70846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:31.685117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3796a88-6105-4462-8d90-028069a70846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:31.685570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3796a88-6105-4462-8d90-028069a70846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:31.685991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3796a88-6105-4462-8d90-028069a70846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:31.811722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d3796a88-6105-4462-8d90-028069a70846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:31.819764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3796a88-6105-4462-8d90-028069a70846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147118 Aug 06 12:53:31.820409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1032/2074] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:31 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:31.840636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:31.841233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:31.848110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:31.848605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:31.849032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:31.849791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:31.850247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:31.850664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:31.854891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2b7e11e1-eb66-4265-a2af-73850f8870dc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:31.855556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2b7e11e1-eb66-4265-a2af-73850f8870dc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:31.861717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b7e11e1-eb66-4265-a2af-73850f8870dc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:31.862216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b7e11e1-eb66-4265-a2af-73850f8870dc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:31.862632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b7e11e1-eb66-4265-a2af-73850f8870dc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:31.863318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b7e11e1-eb66-4265-a2af-73850f8870dc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:31.863767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b7e11e1-eb66-4265-a2af-73850f8870dc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:31.864191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b7e11e1-eb66-4265-a2af-73850f8870dc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:31.915191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:31.923800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:31.925345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:31.926490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6114f1f2-1b50-4297-8685-caed1a7aa586 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089644 Aug 06 12:53:31.927068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1043/2075] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:31.993791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2b7e11e1-eb66-4265-a2af-73850f8870dc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:32.002432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2b7e11e1-eb66-4265-a2af-73850f8870dc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151405 Aug 06 12:53:32.002999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1033/2076] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:31 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:32.841544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cb5def2c-2a19-452e-86d2-3a840956697e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:32.842136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cb5def2c-2a19-452e-86d2-3a840956697e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:32.849261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb5def2c-2a19-452e-86d2-3a840956697e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:32.849742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb5def2c-2a19-452e-86d2-3a840956697e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:32.850243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb5def2c-2a19-452e-86d2-3a840956697e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:32.850958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb5def2c-2a19-452e-86d2-3a840956697e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:32.851417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb5def2c-2a19-452e-86d2-3a840956697e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:32.851845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb5def2c-2a19-452e-86d2-3a840956697e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:32.949915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:32.950736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:32.958406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:32.959032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:32.959473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:32.960184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:32.960794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:32.961226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:32.982860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cb5def2c-2a19-452e-86d2-3a840956697e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:32.991699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cb5def2c-2a19-452e-86d2-3a840956697e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153830 Aug 06 12:53:32.992489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1044/2077] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:33.023902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-65e4fec3-82b4-4149-96a7-afb240c218fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:33.024558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-65e4fec3-82b4-4149-96a7-afb240c218fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:33.028346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:33.031666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65e4fec3-82b4-4149-96a7-afb240c218fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:33.032518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65e4fec3-82b4-4149-96a7-afb240c218fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:33.033182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65e4fec3-82b4-4149-96a7-afb240c218fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:33.033869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65e4fec3-82b4-4149-96a7-afb240c218fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:33.034314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65e4fec3-82b4-4149-96a7-afb240c218fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:33.034733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65e4fec3-82b4-4149-96a7-afb240c218fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:33.037355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:33.039914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:33.040095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b15320a4-861b-4606-af99-79d9006f5e00 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.094303 Aug 06 12:53:33.040554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1034/2078] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:53:33.164518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-65e4fec3-82b4-4149-96a7-afb240c218fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:33.172286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-65e4fec3-82b4-4149-96a7-afb240c218fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152312 Aug 06 12:53:33.172850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1045/2079] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:33 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:34.014309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7e644520-e904-428d-8a73-c49b3cd443a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:34.015410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7e644520-e904-428d-8a73-c49b3cd443a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:34.023090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e644520-e904-428d-8a73-c49b3cd443a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:34.023575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e644520-e904-428d-8a73-c49b3cd443a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:34.024010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e644520-e904-428d-8a73-c49b3cd443a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:34.024740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e644520-e904-428d-8a73-c49b3cd443a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:34.025195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e644520-e904-428d-8a73-c49b3cd443a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:34.025618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e644520-e904-428d-8a73-c49b3cd443a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:34.062669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:34.063268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:34.069622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:34.070100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:34.070522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:34.071207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:34.071653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:34.072070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:34.137539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:34.146452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:34.147851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:34.149001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-29ba73dc-87ed-4bb5-b576-a8c56ce6d6cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090205 Aug 06 12:53:34.149556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1046/2080] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:53:34.161359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7e644520-e904-428d-8a73-c49b3cd443a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:34.169277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7e644520-e904-428d-8a73-c49b3cd443a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.158897 Aug 06 12:53:34.169827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1035/2081] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:34 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:34.193184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f1c45e47-0479-4e5e-a1f5-005cdfbc21cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:34.193783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f1c45e47-0479-4e5e-a1f5-005cdfbc21cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:34.199572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c45e47-0479-4e5e-a1f5-005cdfbc21cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:34.200038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c45e47-0479-4e5e-a1f5-005cdfbc21cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:34.200503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c45e47-0479-4e5e-a1f5-005cdfbc21cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:34.201175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c45e47-0479-4e5e-a1f5-005cdfbc21cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:34.201621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c45e47-0479-4e5e-a1f5-005cdfbc21cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:34.202698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1c45e47-0479-4e5e-a1f5-005cdfbc21cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:34.335074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f1c45e47-0479-4e5e-a1f5-005cdfbc21cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:34.343767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f1c45e47-0479-4e5e-a1f5-005cdfbc21cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154262 Aug 06 12:53:34.344340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1047/2082] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:34 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:35.170945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:35.171547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:35.177932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:35.178405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:35.178833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:35.179535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:35.179983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:35.180430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:35.190656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4f067de8-1ea9-42ca-a0c4-f374bcd0f31b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:35.191396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4f067de8-1ea9-42ca-a0c4-f374bcd0f31b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:35.197802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f067de8-1ea9-42ca-a0c4-f374bcd0f31b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:35.198282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f067de8-1ea9-42ca-a0c4-f374bcd0f31b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:35.198707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f067de8-1ea9-42ca-a0c4-f374bcd0f31b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:35.199393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f067de8-1ea9-42ca-a0c4-f374bcd0f31b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:35.199838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f067de8-1ea9-42ca-a0c4-f374bcd0f31b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:35.200255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f067de8-1ea9-42ca-a0c4-f374bcd0f31b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:35.245667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:35.255898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:35.257406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:35.258535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-923d7af2-4259-4162-885c-94d47cef2175 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.091522 Aug 06 12:53:35.259091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1036/2083] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:35.329561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4f067de8-1ea9-42ca-a0c4-f374bcd0f31b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:35.337472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4f067de8-1ea9-42ca-a0c4-f374bcd0f31b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151111 Aug 06 12:53:35.338040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1048/2084] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:35 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:35.365329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f1875827-b791-497d-b1b8-a1dcfe756dc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:35.365929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f1875827-b791-497d-b1b8-a1dcfe756dc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:35.371941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1875827-b791-497d-b1b8-a1dcfe756dc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:35.372460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1875827-b791-497d-b1b8-a1dcfe756dc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:35.372892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1875827-b791-497d-b1b8-a1dcfe756dc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:35.373577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1875827-b791-497d-b1b8-a1dcfe756dc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:35.374810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1875827-b791-497d-b1b8-a1dcfe756dc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:35.375271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1875827-b791-497d-b1b8-a1dcfe756dc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:35.391791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:35.503722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1875827-b791-497d-b1b8-a1dcfe756dc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:35.511480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f1875827-b791-497d-b1b8-a1dcfe756dc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150018 Aug 06 12:53:35.512038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1037/2085] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:35 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:36.281442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:36.282025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:36.288375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:36.288852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:36.289274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:36.289938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:36.290381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:36.290792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:36.355032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:36.358965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cf631863-d913-4ea2-90e4-232a343a1d3a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:36.359636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cf631863-d913-4ea2-90e4-232a343a1d3a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:36.363654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:36.365169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:36.366290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-af769e02-b567-41ee-be03-af88c61ba6c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089440 Aug 06 12:53:36.366411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf631863-d913-4ea2-90e4-232a343a1d3a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:36.366806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf631863-d913-4ea2-90e4-232a343a1d3a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:36.366942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1049/2086] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:36.367235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf631863-d913-4ea2-90e4-232a343a1d3a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:36.367915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf631863-d913-4ea2-90e4-232a343a1d3a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:36.368626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf631863-d913-4ea2-90e4-232a343a1d3a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:36.369046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf631863-d913-4ea2-90e4-232a343a1d3a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:36.502438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cf631863-d913-4ea2-90e4-232a343a1d3a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:36.510637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cf631863-d913-4ea2-90e4-232a343a1d3a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.155577 Aug 06 12:53:36.511207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1038/2087] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:36 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:36.531725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3e134d0b-809d-4b3f-ad58-2a5db2b4cd24 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:36.532264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e134d0b-809d-4b3f-ad58-2a5db2b4cd24 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:36.538091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e134d0b-809d-4b3f-ad58-2a5db2b4cd24 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:36.538572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e134d0b-809d-4b3f-ad58-2a5db2b4cd24 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:36.538999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e134d0b-809d-4b3f-ad58-2a5db2b4cd24 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:36.539668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e134d0b-809d-4b3f-ad58-2a5db2b4cd24 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:36.540116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e134d0b-809d-4b3f-ad58-2a5db2b4cd24 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:36.540565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e134d0b-809d-4b3f-ad58-2a5db2b4cd24 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:36.666451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3e134d0b-809d-4b3f-ad58-2a5db2b4cd24 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:36.674155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3e134d0b-809d-4b3f-ad58-2a5db2b4cd24 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146248 Aug 06 12:53:36.674704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1050/2088] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:36 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:37.389534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:37.390142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:37.396598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:37.397079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:37.397511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:37.398200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:37.398653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:37.399075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:37.462903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:37.471707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:37.473732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:37.474404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5dcc834c-a747-408e-9e5d-42d055799ce7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088817 Aug 06 12:53:37.479563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1039/2089] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:37.533103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a34878af-fc12-4462-b0bd-9771d52e08eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:37.533714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a34878af-fc12-4462-b0bd-9771d52e08eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:37.540110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a34878af-fc12-4462-b0bd-9771d52e08eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:37.540615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a34878af-fc12-4462-b0bd-9771d52e08eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:37.541046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a34878af-fc12-4462-b0bd-9771d52e08eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:37.541724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a34878af-fc12-4462-b0bd-9771d52e08eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:37.542174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a34878af-fc12-4462-b0bd-9771d52e08eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:37.542602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a34878af-fc12-4462-b0bd-9771d52e08eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:37.666856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a34878af-fc12-4462-b0bd-9771d52e08eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:37.674741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a34878af-fc12-4462-b0bd-9771d52e08eb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146110 Aug 06 12:53:37.675306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1051/2090] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:37.697692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1a252a9a-e19f-44b9-a857-2824354e7510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:37.698294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1a252a9a-e19f-44b9-a857-2824354e7510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:37.704729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a252a9a-e19f-44b9-a857-2824354e7510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:37.705204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a252a9a-e19f-44b9-a857-2824354e7510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:37.705627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a252a9a-e19f-44b9-a857-2824354e7510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:37.706303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a252a9a-e19f-44b9-a857-2824354e7510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:37.706743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a252a9a-e19f-44b9-a857-2824354e7510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:37.707158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a252a9a-e19f-44b9-a857-2824354e7510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:37.832157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1a252a9a-e19f-44b9-a857-2824354e7510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:37.840344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1a252a9a-e19f-44b9-a857-2824354e7510 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147024 Aug 06 12:53:37.840902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1040/2091] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:37 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:38.497192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:38.497782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:38.504325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:38.504810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:38.505236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:38.505908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:38.506351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:38.506764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:38.569720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:38.578236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:38.579734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:38.580888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5b7957da-74ef-469d-8a77-2f2d49ea10cd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087571 Aug 06 12:53:38.581438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1052/2092] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:38.698678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5018e884-75c1-40cf-9122-dc865eddcaa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:38.699285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5018e884-75c1-40cf-9122-dc865eddcaa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:38.705985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5018e884-75c1-40cf-9122-dc865eddcaa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:38.706462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5018e884-75c1-40cf-9122-dc865eddcaa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:38.706893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5018e884-75c1-40cf-9122-dc865eddcaa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:38.707582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5018e884-75c1-40cf-9122-dc865eddcaa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:38.708030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5018e884-75c1-40cf-9122-dc865eddcaa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:38.708534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5018e884-75c1-40cf-9122-dc865eddcaa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:38.834131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5018e884-75c1-40cf-9122-dc865eddcaa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:38.841981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5018e884-75c1-40cf-9122-dc865eddcaa3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147182 Aug 06 12:53:38.843046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1041/2093] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:38.862903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2f3d071f-431f-4703-bffd-ebbfabd16e0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:38.863535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2f3d071f-431f-4703-bffd-ebbfabd16e0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:38.869388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f3d071f-431f-4703-bffd-ebbfabd16e0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:38.869859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f3d071f-431f-4703-bffd-ebbfabd16e0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:38.870288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f3d071f-431f-4703-bffd-ebbfabd16e0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:38.870966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f3d071f-431f-4703-bffd-ebbfabd16e0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:38.871409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f3d071f-431f-4703-bffd-ebbfabd16e0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:38.871828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f3d071f-431f-4703-bffd-ebbfabd16e0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:39.004321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2f3d071f-431f-4703-bffd-ebbfabd16e0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:39.012294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2f3d071f-431f-4703-bffd-ebbfabd16e0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154058 Aug 06 12:53:39.012908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1053/2094] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:38 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:39.603570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:39.604200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:39.610349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:39.610816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:39.611242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:39.611915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:39.612386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:39.612803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:39.674986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:39.683172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:39.684671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:39.685794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a4477292-8472-4b6a-9c44-e19271fc5045 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086104 Aug 06 12:53:39.686836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1042/2095] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:39.864391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fe6ec38e-bf19-4844-abc7-a21494a485e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:39.864933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fe6ec38e-bf19-4844-abc7-a21494a485e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:39.871282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6ec38e-bf19-4844-abc7-a21494a485e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:39.871750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6ec38e-bf19-4844-abc7-a21494a485e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:39.872172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6ec38e-bf19-4844-abc7-a21494a485e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:39.872879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6ec38e-bf19-4844-abc7-a21494a485e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:39.873319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6ec38e-bf19-4844-abc7-a21494a485e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:39.874403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe6ec38e-bf19-4844-abc7-a21494a485e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:40.001922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fe6ec38e-bf19-4844-abc7-a21494a485e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:40.004129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:40.015087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fe6ec38e-bf19-4844-abc7-a21494a485e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.154788 Aug 06 12:53:40.015654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1054/2096] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:39 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:40.033081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f65aabab-d640-4d90-9b5d-5ddfecee5ce8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:40.033693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f65aabab-d640-4d90-9b5d-5ddfecee5ce8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:40.040071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f65aabab-d640-4d90-9b5d-5ddfecee5ce8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:40.040615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f65aabab-d640-4d90-9b5d-5ddfecee5ce8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:40.041052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f65aabab-d640-4d90-9b5d-5ddfecee5ce8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:40.041741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f65aabab-d640-4d90-9b5d-5ddfecee5ce8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:40.042192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f65aabab-d640-4d90-9b5d-5ddfecee5ce8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:40.042615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f65aabab-d640-4d90-9b5d-5ddfecee5ce8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:40.169265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f65aabab-d640-4d90-9b5d-5ddfecee5ce8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:40.177585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f65aabab-d640-4d90-9b5d-5ddfecee5ce8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148352 Aug 06 12:53:40.178146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1043/2097] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:40 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:40.708805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:40.709400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:40.715292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:40.715761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:40.716187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:40.716882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:40.717881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:40.718316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:40.781113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:40.789319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:40.790786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:40.791895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ec6514cf-4486-4c96-85b9-c8c3bbedd99a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086967 Aug 06 12:53:40.792476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1055/2098] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:41.036547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7a709ac8-c55f-4db1-b4b7-f4313f3e03e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:41.037155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7a709ac8-c55f-4db1-b4b7-f4313f3e03e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:41.043556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a709ac8-c55f-4db1-b4b7-f4313f3e03e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:41.044032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a709ac8-c55f-4db1-b4b7-f4313f3e03e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:41.044494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a709ac8-c55f-4db1-b4b7-f4313f3e03e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:41.045180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a709ac8-c55f-4db1-b4b7-f4313f3e03e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:41.045631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a709ac8-c55f-4db1-b4b7-f4313f3e03e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:41.046054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a709ac8-c55f-4db1-b4b7-f4313f3e03e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:41.078352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:53:41.078865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:53:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:53:41.173387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a709ac8-c55f-4db1-b4b7-f4313f3e03e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:41.181200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7a709ac8-c55f-4db1-b4b7-f4313f3e03e0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148575 Aug 06 12:53:41.181762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1044/2099] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:41 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:41.201504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-15bd6723-4d37-40d2-8d8b-3ac695fc4694 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:41.202723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-15bd6723-4d37-40d2-8d8b-3ac695fc4694 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:41.209020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15bd6723-4d37-40d2-8d8b-3ac695fc4694 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:41.209490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15bd6723-4d37-40d2-8d8b-3ac695fc4694 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:41.209910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15bd6723-4d37-40d2-8d8b-3ac695fc4694 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:41.210583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15bd6723-4d37-40d2-8d8b-3ac695fc4694 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:41.211022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15bd6723-4d37-40d2-8d8b-3ac695fc4694 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:41.211433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15bd6723-4d37-40d2-8d8b-3ac695fc4694 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:41.338933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-15bd6723-4d37-40d2-8d8b-3ac695fc4694 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:41.346767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-15bd6723-4d37-40d2-8d8b-3ac695fc4694 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150442 Aug 06 12:53:41.347318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1056/2100] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:41 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:41.813432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:41.814319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:41.820234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:41.820737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:41.821170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:41.821874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:41.822361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:41.822781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:41.887434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:41.895763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:41.897270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:41.898404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4e3d1615-b338-4478-baa5-84d43dfb6a91 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088842 Aug 06 12:53:41.898957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1045/2101] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:42.202668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-320107e5-b47a-4c44-a8c2-d5cabbe18323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:42.203272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-320107e5-b47a-4c44-a8c2-d5cabbe18323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:42.209865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-320107e5-b47a-4c44-a8c2-d5cabbe18323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:42.210602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-320107e5-b47a-4c44-a8c2-d5cabbe18323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:42.210772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-320107e5-b47a-4c44-a8c2-d5cabbe18323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:42.211463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-320107e5-b47a-4c44-a8c2-d5cabbe18323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:42.211950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-320107e5-b47a-4c44-a8c2-d5cabbe18323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:42.212443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-320107e5-b47a-4c44-a8c2-d5cabbe18323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:42.339783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-320107e5-b47a-4c44-a8c2-d5cabbe18323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:42.348435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-320107e5-b47a-4c44-a8c2-d5cabbe18323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149644 Aug 06 12:53:42.349337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1057/2102] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:42 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:42.368637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db05d6c2-b8c5-49b0-9508-b4d1e1357975 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:42.369197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db05d6c2-b8c5-49b0-9508-b4d1e1357975 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:42.375574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db05d6c2-b8c5-49b0-9508-b4d1e1357975 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:42.376041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db05d6c2-b8c5-49b0-9508-b4d1e1357975 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:42.376506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db05d6c2-b8c5-49b0-9508-b4d1e1357975 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:42.377181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db05d6c2-b8c5-49b0-9508-b4d1e1357975 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:42.377625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db05d6c2-b8c5-49b0-9508-b4d1e1357975 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:42.378044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db05d6c2-b8c5-49b0-9508-b4d1e1357975 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:42.505584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db05d6c2-b8c5-49b0-9508-b4d1e1357975 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:42.513391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db05d6c2-b8c5-49b0-9508-b4d1e1357975 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148682 Aug 06 12:53:42.513948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1046/2103] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:42 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:42.921219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:42.921814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:42.927685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:42.928152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:42.928608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:42.929278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:42.929720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:42.930132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:42.998814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:43.007128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:43.008641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:43.009912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e943b0f9-f4ce-44e6-a655-0bc20a1f3bdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.092522 Aug 06 12:53:43.010594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1058/2104] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:43.370848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ed67ef16-604a-4710-97d7-302d81993ec5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:43.371451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ed67ef16-604a-4710-97d7-302d81993ec5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:43.377938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed67ef16-604a-4710-97d7-302d81993ec5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:43.378408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed67ef16-604a-4710-97d7-302d81993ec5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:43.378831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed67ef16-604a-4710-97d7-302d81993ec5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:43.379504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed67ef16-604a-4710-97d7-302d81993ec5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:43.379955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed67ef16-604a-4710-97d7-302d81993ec5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:43.380395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed67ef16-604a-4710-97d7-302d81993ec5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:43.503828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ed67ef16-604a-4710-97d7-302d81993ec5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:43.511661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ed67ef16-604a-4710-97d7-302d81993ec5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.144719 Aug 06 12:53:43.512239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1047/2105] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:43.534404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5533b9c3-617f-41d4-b857-5586062ff576 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:43.535139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5533b9c3-617f-41d4-b857-5586062ff576 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:43.541524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5533b9c3-617f-41d4-b857-5586062ff576 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:43.542005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5533b9c3-617f-41d4-b857-5586062ff576 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:43.542436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5533b9c3-617f-41d4-b857-5586062ff576 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:43.543111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5533b9c3-617f-41d4-b857-5586062ff576 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:43.543559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5533b9c3-617f-41d4-b857-5586062ff576 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:43.543981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5533b9c3-617f-41d4-b857-5586062ff576 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:43.672398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5533b9c3-617f-41d4-b857-5586062ff576 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:43.680110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5533b9c3-617f-41d4-b857-5586062ff576 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150151 Aug 06 12:53:43.680685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1059/2106] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:43 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:44.033160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:44.033768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:44.039687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:44.040168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:44.040632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:44.041319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:44.041771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:44.042194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:44.104405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:44.112903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:44.114405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:44.115533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fcd9c4bd-55e6-48da-990c-d02ed14533f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086306 Aug 06 12:53:44.116083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1048/2107] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:44.532821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9346b466-4b9f-43dc-b5f1-1c7be54fdce5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:44.533363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9346b466-4b9f-43dc-b5f1-1c7be54fdce5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:44.539672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9346b466-4b9f-43dc-b5f1-1c7be54fdce5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:44.540221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9346b466-4b9f-43dc-b5f1-1c7be54fdce5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:44.540593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9346b466-4b9f-43dc-b5f1-1c7be54fdce5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:44.541272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9346b466-4b9f-43dc-b5f1-1c7be54fdce5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:44.541722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9346b466-4b9f-43dc-b5f1-1c7be54fdce5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:44.542142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9346b466-4b9f-43dc-b5f1-1c7be54fdce5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:44.668676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9346b466-4b9f-43dc-b5f1-1c7be54fdce5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:44.677144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9346b466-4b9f-43dc-b5f1-1c7be54fdce5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148222 Aug 06 12:53:44.677698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1060/2108] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:44.700366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5f60f68a-6aa0-4839-a6f0-62930e7d4db0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:44.700971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5f60f68a-6aa0-4839-a6f0-62930e7d4db0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:44.707303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f60f68a-6aa0-4839-a6f0-62930e7d4db0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:44.707774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f60f68a-6aa0-4839-a6f0-62930e7d4db0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:44.708198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f60f68a-6aa0-4839-a6f0-62930e7d4db0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:44.708902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f60f68a-6aa0-4839-a6f0-62930e7d4db0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:44.709346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f60f68a-6aa0-4839-a6f0-62930e7d4db0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:44.709764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f60f68a-6aa0-4839-a6f0-62930e7d4db0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:44.835483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f60f68a-6aa0-4839-a6f0-62930e7d4db0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:44.844886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5f60f68a-6aa0-4839-a6f0-62930e7d4db0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148265 Aug 06 12:53:44.845448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1049/2109] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:44 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:45.138570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:45.139681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:45.145693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:45.146172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:45.146609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:45.147298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:45.147746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:45.148169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:45.213594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:45.222563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:45.224062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:45.225230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bd6a1b25-9c24-4e5d-823a-9da54f2b8e58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090877 Aug 06 12:53:45.225780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1061/2110] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:45.697723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c7086d1f-52e9-4110-8f23-a5d3d246ca1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:45.698403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c7086d1f-52e9-4110-8f23-a5d3d246ca1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:45.705429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7086d1f-52e9-4110-8f23-a5d3d246ca1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:45.706007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7086d1f-52e9-4110-8f23-a5d3d246ca1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:45.706329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7086d1f-52e9-4110-8f23-a5d3d246ca1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:45.707022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7086d1f-52e9-4110-8f23-a5d3d246ca1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:45.707479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7086d1f-52e9-4110-8f23-a5d3d246ca1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:45.707904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7086d1f-52e9-4110-8f23-a5d3d246ca1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:45.837680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7086d1f-52e9-4110-8f23-a5d3d246ca1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:45.845519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c7086d1f-52e9-4110-8f23-a5d3d246ca1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151620 Aug 06 12:53:45.846086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1050/2111] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:45.866690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-936d96a1-4538-47a3-b839-26ff70e70c18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:45.867290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-936d96a1-4538-47a3-b839-26ff70e70c18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:45.873204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936d96a1-4538-47a3-b839-26ff70e70c18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:45.874238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936d96a1-4538-47a3-b839-26ff70e70c18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:45.874667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936d96a1-4538-47a3-b839-26ff70e70c18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:45.875348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936d96a1-4538-47a3-b839-26ff70e70c18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:45.875793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936d96a1-4538-47a3-b839-26ff70e70c18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:45.876210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-936d96a1-4538-47a3-b839-26ff70e70c18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:46.002345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-936d96a1-4538-47a3-b839-26ff70e70c18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:46.010280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-936d96a1-4538-47a3-b839-26ff70e70c18 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147574 Aug 06 12:53:46.010838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1062/2112] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:45 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:46.247691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:46.248224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:46.254215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:46.254689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:46.255118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:46.255793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:46.256239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:46.256685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:46.319471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:46.327766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:46.329297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:46.330426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2f04e40f-7b7c-4bab-a0d1-a2f0dc63cfd0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086693 Aug 06 12:53:46.330975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1051/2113] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:46.867565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a5147ad-6d0a-40a6-b5b3-fde0473dbc42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:46.868159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a5147ad-6d0a-40a6-b5b3-fde0473dbc42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:46.874496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a5147ad-6d0a-40a6-b5b3-fde0473dbc42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:46.874971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a5147ad-6d0a-40a6-b5b3-fde0473dbc42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:46.875392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a5147ad-6d0a-40a6-b5b3-fde0473dbc42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:46.876354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a5147ad-6d0a-40a6-b5b3-fde0473dbc42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:46.876800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a5147ad-6d0a-40a6-b5b3-fde0473dbc42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:46.877214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a5147ad-6d0a-40a6-b5b3-fde0473dbc42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:47.005943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a5147ad-6d0a-40a6-b5b3-fde0473dbc42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:47.013762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a5147ad-6d0a-40a6-b5b3-fde0473dbc42 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150268 Aug 06 12:53:47.014309 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1063/2114] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:47.031689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e4d7c1a9-46d7-4942-ba14-0751c9103bf9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:47.032345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e4d7c1a9-46d7-4942-ba14-0751c9103bf9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:47.038844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d7c1a9-46d7-4942-ba14-0751c9103bf9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:47.039319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d7c1a9-46d7-4942-ba14-0751c9103bf9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:47.039752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d7c1a9-46d7-4942-ba14-0751c9103bf9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:47.040473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d7c1a9-46d7-4942-ba14-0751c9103bf9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:47.040926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d7c1a9-46d7-4942-ba14-0751c9103bf9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:47.041347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4d7c1a9-46d7-4942-ba14-0751c9103bf9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:47.171325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e4d7c1a9-46d7-4942-ba14-0751c9103bf9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:47.179180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e4d7c1a9-46d7-4942-ba14-0751c9103bf9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151869 Aug 06 12:53:47.179734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1052/2115] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:47 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:47.352888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:47.353491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:47.359284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:47.359762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:47.360490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:47.361174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:47.361625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:47.362048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:47.425426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:47.433726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:47.435205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:47.436362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b45ed89d-a0e4-497d-be9d-7216e6a7782a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087281 Aug 06 12:53:47.436921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1064/2116] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:48.034750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bfa5cd03-0842-494f-a80f-63ef53b96368 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:48.035379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bfa5cd03-0842-494f-a80f-63ef53b96368 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:48.041698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfa5cd03-0842-494f-a80f-63ef53b96368 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:48.042170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfa5cd03-0842-494f-a80f-63ef53b96368 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:48.042600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfa5cd03-0842-494f-a80f-63ef53b96368 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:48.043270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfa5cd03-0842-494f-a80f-63ef53b96368 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:48.043714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfa5cd03-0842-494f-a80f-63ef53b96368 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:48.044133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfa5cd03-0842-494f-a80f-63ef53b96368 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:48.200400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-afe850f9-9a10-4d55-967a-94d1d40bebdc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:48.201007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-afe850f9-9a10-4d55-967a-94d1d40bebdc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:48.207910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-afe850f9-9a10-4d55-967a-94d1d40bebdc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:48.208432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-afe850f9-9a10-4d55-967a-94d1d40bebdc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:48.208860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-afe850f9-9a10-4d55-967a-94d1d40bebdc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:48.209541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-afe850f9-9a10-4d55-967a-94d1d40bebdc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:48.209993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-afe850f9-9a10-4d55-967a-94d1d40bebdc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:48.210412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-afe850f9-9a10-4d55-967a-94d1d40bebdc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:48.320120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bfa5cd03-0842-494f-a80f-63ef53b96368 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:48.328576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bfa5cd03-0842-494f-a80f-63ef53b96368 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.297589 Aug 06 12:53:48.329130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1053/2117] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:48.338563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-afe850f9-9a10-4d55-967a-94d1d40bebdc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:48.347199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-afe850f9-9a10-4d55-967a-94d1d40bebdc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150689 Aug 06 12:53:48.347745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1065/2118] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:48 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:48.458606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:48.459199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:48.465061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:48.465537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:48.465962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:48.466637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:48.467081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:48.467497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:48.471272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:48.531224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:48.539450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:48.540996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:48.542123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ab308cd1-4e15-4b3f-9a2e-1124a6e0005b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087375 Aug 06 12:53:48.542671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1054/2119] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:49.349016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2e869e6d-71bf-4325-b783-2e4cbdb6d7b8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:49.349633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2e869e6d-71bf-4325-b783-2e4cbdb6d7b8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:49.355909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e869e6d-71bf-4325-b783-2e4cbdb6d7b8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:49.356411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e869e6d-71bf-4325-b783-2e4cbdb6d7b8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:49.356838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e869e6d-71bf-4325-b783-2e4cbdb6d7b8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:49.357502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e869e6d-71bf-4325-b783-2e4cbdb6d7b8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:49.358513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e869e6d-71bf-4325-b783-2e4cbdb6d7b8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:49.358926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e869e6d-71bf-4325-b783-2e4cbdb6d7b8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:49.368101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90f6e80f-4c2a-4ee6-a493-11600cc4ec80 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:49.368745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90f6e80f-4c2a-4ee6-a493-11600cc4ec80 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:49.375141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90f6e80f-4c2a-4ee6-a493-11600cc4ec80 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:49.375621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90f6e80f-4c2a-4ee6-a493-11600cc4ec80 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:49.376052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90f6e80f-4c2a-4ee6-a493-11600cc4ec80 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:49.376758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90f6e80f-4c2a-4ee6-a493-11600cc4ec80 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:49.377211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90f6e80f-4c2a-4ee6-a493-11600cc4ec80 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:49.377634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90f6e80f-4c2a-4ee6-a493-11600cc4ec80 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:49.493737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e869e6d-71bf-4325-b783-2e4cbdb6d7b8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:49.501624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2e869e6d-71bf-4325-b783-2e4cbdb6d7b8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.156444 Aug 06 12:53:49.502184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1066/2120] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:49.511982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90f6e80f-4c2a-4ee6-a493-11600cc4ec80 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:49.520542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90f6e80f-4c2a-4ee6-a493-11600cc4ec80 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.156220 Aug 06 12:53:49.521099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1055/2121] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:49 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:49.564372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:49.564972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:49.570716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:49.571191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:49.571620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:49.572322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:49.572774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:49.573192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:49.633814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:49.642557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:49.644047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:49.645197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-49641a2e-8b13-41f7-9889-46bddd777a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084667 Aug 06 12:53:49.645748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1067/2122] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:53:50.523108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0bda9c40-58a1-4046-b489-93ffec32aa29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:50.523717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0bda9c40-58a1-4046-b489-93ffec32aa29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:50.530167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bda9c40-58a1-4046-b489-93ffec32aa29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:50.530646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bda9c40-58a1-4046-b489-93ffec32aa29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:50.531080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bda9c40-58a1-4046-b489-93ffec32aa29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:50.531759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bda9c40-58a1-4046-b489-93ffec32aa29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:50.532219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bda9c40-58a1-4046-b489-93ffec32aa29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:50.532674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bda9c40-58a1-4046-b489-93ffec32aa29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:50.541741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-09c6b07b-43ef-424a-9b17-eeb3d79b9def tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:50.542458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-09c6b07b-43ef-424a-9b17-eeb3d79b9def tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:50.549176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09c6b07b-43ef-424a-9b17-eeb3d79b9def tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:50.549681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09c6b07b-43ef-424a-9b17-eeb3d79b9def tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:50.550106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09c6b07b-43ef-424a-9b17-eeb3d79b9def tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:50.550777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09c6b07b-43ef-424a-9b17-eeb3d79b9def tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:50.551219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09c6b07b-43ef-424a-9b17-eeb3d79b9def tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:50.551635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09c6b07b-43ef-424a-9b17-eeb3d79b9def tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:50.663992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0bda9c40-58a1-4046-b489-93ffec32aa29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:50.672554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0bda9c40-58a1-4046-b489-93ffec32aa29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153321 Aug 06 12:53:50.673111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1056/2123] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:50 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:50.677706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:50.678229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:50.683766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-09c6b07b-43ef-424a-9b17-eeb3d79b9def tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:50.688982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:50.689475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:50.689912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:50.690617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:50.691091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:50.691515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:50.691615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-09c6b07b-43ef-424a-9b17-eeb3d79b9def tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153711 Aug 06 12:53:50.692135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1068/2124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:50 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:50.755345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:50.763673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:50.765238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:50.766373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f5134a11-a932-4e11-8bb8-e119433dc711 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.092356 Aug 06 12:53:50.766924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1057/2125] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:51.694011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fc068b35-3a65-413b-ad0d-c808eba0667e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:51.694617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fc068b35-3a65-413b-ad0d-c808eba0667e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:51.700905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc068b35-3a65-413b-ad0d-c808eba0667e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:51.702018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc068b35-3a65-413b-ad0d-c808eba0667e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:51.702448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc068b35-3a65-413b-ad0d-c808eba0667e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:51.703121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc068b35-3a65-413b-ad0d-c808eba0667e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:51.703567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc068b35-3a65-413b-ad0d-c808eba0667e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:51.703982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc068b35-3a65-413b-ad0d-c808eba0667e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:51.712771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8b7dd99e-07ae-4f2e-9c1e-d9126db9ce20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:51.713387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8b7dd99e-07ae-4f2e-9c1e-d9126db9ce20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:51.719778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7dd99e-07ae-4f2e-9c1e-d9126db9ce20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:51.720268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7dd99e-07ae-4f2e-9c1e-d9126db9ce20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:51.720737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7dd99e-07ae-4f2e-9c1e-d9126db9ce20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:51.721428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7dd99e-07ae-4f2e-9c1e-d9126db9ce20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:51.721891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7dd99e-07ae-4f2e-9c1e-d9126db9ce20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:51.722314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7dd99e-07ae-4f2e-9c1e-d9126db9ce20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:51.841571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fc068b35-3a65-413b-ad0d-c808eba0667e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:51.849578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fc068b35-3a65-413b-ad0d-c808eba0667e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.159391 Aug 06 12:53:51.850133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1069/2126] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:51.854607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:51.855332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:51.858945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b7dd99e-07ae-4f2e-9c1e-d9126db9ce20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:51.862060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:51.862801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:51.862996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:51.863642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:51.864090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:51.864540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:51.867330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8b7dd99e-07ae-4f2e-9c1e-d9126db9ce20 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.158658 Aug 06 12:53:51.867878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1058/2127] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:51 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:51.926367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:51.934757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:51.936931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:51.938057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-394e882c-c656-42fe-8910-896430901aa1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087018 Aug 06 12:53:51.938602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1070/2128] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:52.871957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9c92a793-127c-4ddb-9564-33c6d35f9685 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:52.872587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9c92a793-127c-4ddb-9564-33c6d35f9685 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:52.879525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c92a793-127c-4ddb-9564-33c6d35f9685 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:52.879991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c92a793-127c-4ddb-9564-33c6d35f9685 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:52.880456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c92a793-127c-4ddb-9564-33c6d35f9685 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:52.881132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c92a793-127c-4ddb-9564-33c6d35f9685 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:52.881579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c92a793-127c-4ddb-9564-33c6d35f9685 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:52.881994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c92a793-127c-4ddb-9564-33c6d35f9685 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:52.889682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-91cae200-7097-489b-a162-47957e0be8ff tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:52.890282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-91cae200-7097-489b-a162-47957e0be8ff tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:52.896577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cae200-7097-489b-a162-47957e0be8ff tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:52.897055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cae200-7097-489b-a162-47957e0be8ff tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:52.897487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cae200-7097-489b-a162-47957e0be8ff tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:52.898165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cae200-7097-489b-a162-47957e0be8ff tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:52.898611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cae200-7097-489b-a162-47957e0be8ff tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:52.899034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cae200-7097-489b-a162-47957e0be8ff tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:52.913367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:53.021572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9c92a793-127c-4ddb-9564-33c6d35f9685 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:53.030995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9c92a793-127c-4ddb-9564-33c6d35f9685 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.162824 Aug 06 12:53:53.035152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1059/2129] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:52 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:53.036012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:53.036778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:53.042604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:53.043182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:53.043621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:53.044331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:53.044790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:53.045225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:53.045356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-91cae200-7097-489b-a162-47957e0be8ff tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:53.053417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-91cae200-7097-489b-a162-47957e0be8ff tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.168061 Aug 06 12:53:53.053978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1071/2130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:52 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:53.108556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:53.117112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:53.118683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:53.119831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b6efebb6-1288-4433-975e-75de848d74ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087356 Aug 06 12:53:53.120400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1060/2131] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:54.052696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cf9fa702-99c6-4e0a-bad0-765b7971514f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:54.053303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cf9fa702-99c6-4e0a-bad0-765b7971514f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:54.059807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf9fa702-99c6-4e0a-bad0-765b7971514f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:54.060282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf9fa702-99c6-4e0a-bad0-765b7971514f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:54.060800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf9fa702-99c6-4e0a-bad0-765b7971514f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:54.061478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf9fa702-99c6-4e0a-bad0-765b7971514f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:54.061931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf9fa702-99c6-4e0a-bad0-765b7971514f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:54.062351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf9fa702-99c6-4e0a-bad0-765b7971514f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:54.074693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7c5847ff-3163-4fc5-90e7-c1ea80d6117e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:54.075293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7c5847ff-3163-4fc5-90e7-c1ea80d6117e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:54.082062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c5847ff-3163-4fc5-90e7-c1ea80d6117e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:54.082536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c5847ff-3163-4fc5-90e7-c1ea80d6117e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:54.082964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c5847ff-3163-4fc5-90e7-c1ea80d6117e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:54.083640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c5847ff-3163-4fc5-90e7-c1ea80d6117e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:54.084088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c5847ff-3163-4fc5-90e7-c1ea80d6117e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:54.084528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c5847ff-3163-4fc5-90e7-c1ea80d6117e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:54.193621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cf9fa702-99c6-4e0a-bad0-765b7971514f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:54.201986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cf9fa702-99c6-4e0a-bad0-765b7971514f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152644 Aug 06 12:53:54.202541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1072/2132] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:54 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:54.206884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:54.207472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:54.213017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:54.213498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:54.213923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:54.214601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:54.215044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:54.215455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:54.217401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7c5847ff-3163-4fc5-90e7-c1ea80d6117e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:54.225630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7c5847ff-3163-4fc5-90e7-c1ea80d6117e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154695 Aug 06 12:53:54.226193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1061/2133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:54 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:54.276498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:54.285508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:54.286990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:54.288178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a2e3e67b-5ed4-431c-8bfa-4f469767a0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084715 Aug 06 12:53:54.288761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1073/2134] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:55.223505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1de9b7d8-0fba-427b-93fe-04965e39a882 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:55.224105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1de9b7d8-0fba-427b-93fe-04965e39a882 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:55.226393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=80 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:55.231553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1de9b7d8-0fba-427b-93fe-04965e39a882 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:55.232028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1de9b7d8-0fba-427b-93fe-04965e39a882 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:55.233111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1de9b7d8-0fba-427b-93fe-04965e39a882 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:55.233783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1de9b7d8-0fba-427b-93fe-04965e39a882 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:55.234234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1de9b7d8-0fba-427b-93fe-04965e39a882 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:55.234649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1de9b7d8-0fba-427b-93fe-04965e39a882 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:55.246744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2f83a6d8-5299-48fe-8bf9-ae39a765b862 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:55.247348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2f83a6d8-5299-48fe-8bf9-ae39a765b862 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:55.253813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f83a6d8-5299-48fe-8bf9-ae39a765b862 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:55.254290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f83a6d8-5299-48fe-8bf9-ae39a765b862 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:55.254713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f83a6d8-5299-48fe-8bf9-ae39a765b862 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:55.255391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f83a6d8-5299-48fe-8bf9-ae39a765b862 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:55.255841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f83a6d8-5299-48fe-8bf9-ae39a765b862 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:55.256259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f83a6d8-5299-48fe-8bf9-ae39a765b862 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:55.370344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1de9b7d8-0fba-427b-93fe-04965e39a882 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:55.378367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1de9b7d8-0fba-427b-93fe-04965e39a882 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.158679 Aug 06 12:53:55.378930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1062/2135] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:55 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:55.383331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:55.383925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:55.387869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2f83a6d8-5299-48fe-8bf9-ae39a765b862 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:55.389794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:55.390270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:55.390694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:55.391368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:55.392027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:55.392478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:55.396539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2f83a6d8-5299-48fe-8bf9-ae39a765b862 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153566 Aug 06 12:53:55.397173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1074/2136] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:55 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:55.455752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:55.464011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:55.465530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:55.467221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e4a9d640-da2c-4022-9d5b-eeb4872d339e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086836 Aug 06 12:53:55.467773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1063/2137] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:56.399456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-578107e5-a110-42ea-b49d-9e9e2765d594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:56.400058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-578107e5-a110-42ea-b49d-9e9e2765d594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:56.402402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=78 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:53:56.407695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-578107e5-a110-42ea-b49d-9e9e2765d594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:56.408196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-578107e5-a110-42ea-b49d-9e9e2765d594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:56.408663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-578107e5-a110-42ea-b49d-9e9e2765d594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:56.409342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-578107e5-a110-42ea-b49d-9e9e2765d594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:56.409788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-578107e5-a110-42ea-b49d-9e9e2765d594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:56.410206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-578107e5-a110-42ea-b49d-9e9e2765d594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:56.419510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd4723a3-fb52-46fb-aa84-6acf513efcef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:56.420798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd4723a3-fb52-46fb-aa84-6acf513efcef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:56.427086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4723a3-fb52-46fb-aa84-6acf513efcef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:56.427562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4723a3-fb52-46fb-aa84-6acf513efcef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:56.427996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4723a3-fb52-46fb-aa84-6acf513efcef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:56.428712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4723a3-fb52-46fb-aa84-6acf513efcef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:56.429163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4723a3-fb52-46fb-aa84-6acf513efcef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:56.429587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4723a3-fb52-46fb-aa84-6acf513efcef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:56.540917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-578107e5-a110-42ea-b49d-9e9e2765d594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:56.549352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-578107e5-a110-42ea-b49d-9e9e2765d594 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153745 Aug 06 12:53:56.549948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1075/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:56.554273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:56.554865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:56.558284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd4723a3-fb52-46fb-aa84-6acf513efcef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:56.561090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:56.561572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:56.561998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:56.562677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:56.563122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:56.563537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:56.567862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd4723a3-fb52-46fb-aa84-6acf513efcef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152125 Aug 06 12:53:56.568586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1064/2139] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:56 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:56.623749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:56.631937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:56.633477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:56.634634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-73766cdd-4e95-4523-8b81-145931be6b3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083791 Aug 06 12:53:56.635173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1076/2140] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:56 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:57.572210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-25c63b12-7308-4041-9c4f-a2d80e6a66e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:57.572849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-25c63b12-7308-4041-9c4f-a2d80e6a66e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:57.579744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25c63b12-7308-4041-9c4f-a2d80e6a66e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:57.580222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25c63b12-7308-4041-9c4f-a2d80e6a66e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:57.580681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25c63b12-7308-4041-9c4f-a2d80e6a66e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:57.581369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25c63b12-7308-4041-9c4f-a2d80e6a66e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:57.581821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25c63b12-7308-4041-9c4f-a2d80e6a66e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:57.582248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25c63b12-7308-4041-9c4f-a2d80e6a66e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:57.588904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-01c5e6be-501e-48cc-a03a-3e41e13f9128 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:57.589511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-01c5e6be-501e-48cc-a03a-3e41e13f9128 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:57.595827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01c5e6be-501e-48cc-a03a-3e41e13f9128 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:57.596326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01c5e6be-501e-48cc-a03a-3e41e13f9128 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:57.596772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01c5e6be-501e-48cc-a03a-3e41e13f9128 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:57.597458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01c5e6be-501e-48cc-a03a-3e41e13f9128 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:57.597911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01c5e6be-501e-48cc-a03a-3e41e13f9128 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:57.598335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01c5e6be-501e-48cc-a03a-3e41e13f9128 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:57.711006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-25c63b12-7308-4041-9c4f-a2d80e6a66e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:57.719299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-25c63b12-7308-4041-9c4f-a2d80e6a66e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150897 Aug 06 12:53:57.724558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1065/2141] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:57 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:57.724558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:57.725072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:57.730801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:57.731281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:57.731677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-01c5e6be-501e-48cc-a03a-3e41e13f9128 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:57.731806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:57.732940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:57.733389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:57.733808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:57.740587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-01c5e6be-501e-48cc-a03a-3e41e13f9128 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.155465 Aug 06 12:53:57.741138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1077/2142] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:57 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:57.797057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:57.805161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:57.806637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:57.807752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ec7df46b-4310-47ff-89ec-16db16c2ebb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086774 Aug 06 12:53:57.808314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1066/2143] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:58.741540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-52d89974-5a02-4573-8c30-767f430acbdb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:58.742138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-52d89974-5a02-4573-8c30-767f430acbdb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:58.748686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52d89974-5a02-4573-8c30-767f430acbdb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:58.749170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52d89974-5a02-4573-8c30-767f430acbdb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:58.749629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52d89974-5a02-4573-8c30-767f430acbdb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:58.750314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52d89974-5a02-4573-8c30-767f430acbdb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:58.750773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52d89974-5a02-4573-8c30-767f430acbdb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:58.751185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52d89974-5a02-4573-8c30-767f430acbdb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:58.762411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9250f8ba-eae5-47ea-9072-d333547266b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:58.763043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9250f8ba-eae5-47ea-9072-d333547266b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:58.769800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9250f8ba-eae5-47ea-9072-d333547266b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:58.770270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9250f8ba-eae5-47ea-9072-d333547266b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:58.770693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9250f8ba-eae5-47ea-9072-d333547266b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:58.771370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9250f8ba-eae5-47ea-9072-d333547266b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:58.771818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9250f8ba-eae5-47ea-9072-d333547266b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:58.772234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9250f8ba-eae5-47ea-9072-d333547266b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:58.884642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-52d89974-5a02-4573-8c30-767f430acbdb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:58.893126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-52d89974-5a02-4573-8c30-767f430acbdb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.155385 Aug 06 12:53:58.893690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1078/2144] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:53:58.898012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:58.898595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:58.904207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:58.904708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:58.905134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:58.905825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:58.906265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:58.906677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:58.910036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9250f8ba-eae5-47ea-9072-d333547266b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:58.917949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9250f8ba-eae5-47ea-9072-d333547266b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.159337 Aug 06 12:53:58.918512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1067/2145] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:58 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:53:58.966850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:58.975070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:58.976572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:53:58.977689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2aa97b7d-2ea8-41c2-9649-1970f01cd9c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083102 Aug 06 12:53:58.978227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1079/2146] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:53:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:53:59.914057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-69bc9509-2a08-4e3b-88bb-3d7598fe9756 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:59.914668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-69bc9509-2a08-4e3b-88bb-3d7598fe9756 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:59.921716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69bc9509-2a08-4e3b-88bb-3d7598fe9756 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:59.922197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69bc9509-2a08-4e3b-88bb-3d7598fe9756 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:59.922634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69bc9509-2a08-4e3b-88bb-3d7598fe9756 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:59.923320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69bc9509-2a08-4e3b-88bb-3d7598fe9756 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:59.923774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69bc9509-2a08-4e3b-88bb-3d7598fe9756 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:59.924198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69bc9509-2a08-4e3b-88bb-3d7598fe9756 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:59.938960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bacb137d-43a2-4b2d-884e-31463f5d7c82 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:53:59.939614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bacb137d-43a2-4b2d-884e-31463f5d7c82 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:53:59.945846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bacb137d-43a2-4b2d-884e-31463f5d7c82 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:59.946319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bacb137d-43a2-4b2d-884e-31463f5d7c82 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:59.946747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bacb137d-43a2-4b2d-884e-31463f5d7c82 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:53:59.947427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bacb137d-43a2-4b2d-884e-31463f5d7c82 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:53:59.947872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bacb137d-43a2-4b2d-884e-31463f5d7c82 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:53:59.948287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bacb137d-43a2-4b2d-884e-31463f5d7c82 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:00.055196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-69bc9509-2a08-4e3b-88bb-3d7598fe9756 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:00.063255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-69bc9509-2a08-4e3b-88bb-3d7598fe9756 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153018 Aug 06 12:54:00.063824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1068/2147] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:00.068261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:00.068876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:00.074472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:00.075152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:00.075586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:00.076781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:00.077225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:00.077642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:00.082448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bacb137d-43a2-4b2d-884e-31463f5d7c82 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:00.090193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bacb137d-43a2-4b2d-884e-31463f5d7c82 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154988 Aug 06 12:54:00.090791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1080/2148] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:53:59 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:00.141717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:00.149921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:00.151407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:00.152570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7e88147b-af62-496f-88d4-d4113cc6ec7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087776 Aug 06 12:54:00.153129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1069/2149] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:01.085085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0c78613e-2c12-4db3-915c-7e7dac4d50c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:01.085688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0c78613e-2c12-4db3-915c-7e7dac4d50c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:01.092653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c78613e-2c12-4db3-915c-7e7dac4d50c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:01.093130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c78613e-2c12-4db3-915c-7e7dac4d50c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:01.093562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c78613e-2c12-4db3-915c-7e7dac4d50c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:01.094243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c78613e-2c12-4db3-915c-7e7dac4d50c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:01.094691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c78613e-2c12-4db3-915c-7e7dac4d50c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:01.095111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c78613e-2c12-4db3-915c-7e7dac4d50c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:01.112516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-baf1b878-3e36-4540-801d-d16d8574ab1f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:01.113121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-baf1b878-3e36-4540-801d-d16d8574ab1f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:01.119445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baf1b878-3e36-4540-801d-d16d8574ab1f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:01.119924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baf1b878-3e36-4540-801d-d16d8574ab1f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:01.120377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baf1b878-3e36-4540-801d-d16d8574ab1f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:01.121068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baf1b878-3e36-4540-801d-d16d8574ab1f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:01.121515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baf1b878-3e36-4540-801d-d16d8574ab1f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:01.121937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baf1b878-3e36-4540-801d-d16d8574ab1f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:01.223663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0c78613e-2c12-4db3-915c-7e7dac4d50c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:01.232973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0c78613e-2c12-4db3-915c-7e7dac4d50c4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151092 Aug 06 12:54:01.233550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1081/2150] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:01 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:01.238272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:01.238867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:01.244591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:01.245071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:01.245499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:01.246184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:01.246630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:01.247050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:01.249943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-baf1b878-3e36-4540-801d-d16d8574ab1f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:01.252072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:01.259051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-baf1b878-3e36-4540-801d-d16d8574ab1f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150739 Aug 06 12:54:01.259618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1070/2151] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:01 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:01.310076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:01.318398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:01.319892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:01.321201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eb913958-6f14-456f-a672-8d30220dbf6b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086601 Aug 06 12:54:01.322083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1082/2152] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:02.255290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-038aca88-cadd-4bee-838a-3e90036faec8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:02.255825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-038aca88-cadd-4bee-838a-3e90036faec8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:02.262170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038aca88-cadd-4bee-838a-3e90036faec8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:02.262647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038aca88-cadd-4bee-838a-3e90036faec8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:02.263088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038aca88-cadd-4bee-838a-3e90036faec8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:02.263769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038aca88-cadd-4bee-838a-3e90036faec8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:02.264274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038aca88-cadd-4bee-838a-3e90036faec8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:02.264723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038aca88-cadd-4bee-838a-3e90036faec8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:02.279519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8963b7ae-1b07-4e39-a887-8b32ecfe29f7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:02.280117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8963b7ae-1b07-4e39-a887-8b32ecfe29f7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:02.286375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8963b7ae-1b07-4e39-a887-8b32ecfe29f7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:02.286847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8963b7ae-1b07-4e39-a887-8b32ecfe29f7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:02.287286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8963b7ae-1b07-4e39-a887-8b32ecfe29f7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:02.287951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8963b7ae-1b07-4e39-a887-8b32ecfe29f7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:02.288421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8963b7ae-1b07-4e39-a887-8b32ecfe29f7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:02.288836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8963b7ae-1b07-4e39-a887-8b32ecfe29f7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:02.393146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-038aca88-cadd-4bee-838a-3e90036faec8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:02.401070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-038aca88-cadd-4bee-838a-3e90036faec8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149931 Aug 06 12:54:02.401635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1071/2153] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:02 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:02.406464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:02.406709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:02.412258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:02.412766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:02.413193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:02.413869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:02.414314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:02.414730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:02.421697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8963b7ae-1b07-4e39-a887-8b32ecfe29f7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:02.429608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8963b7ae-1b07-4e39-a887-8b32ecfe29f7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153820 Aug 06 12:54:02.430159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1083/2154] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:02 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:02.477612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:02.486613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:02.488075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:02.489227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e25428dd-57af-48df-832e-237032b2f677 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086695 Aug 06 12:54:02.490073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1072/2155] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:02 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:03.422216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-214c9557-724f-4d67-bd9f-e416b211e20c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:03.422821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-214c9557-724f-4d67-bd9f-e416b211e20c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:03.429246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-214c9557-724f-4d67-bd9f-e416b211e20c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:03.429720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-214c9557-724f-4d67-bd9f-e416b211e20c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:03.430149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-214c9557-724f-4d67-bd9f-e416b211e20c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:03.430825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-214c9557-724f-4d67-bd9f-e416b211e20c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:03.431273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-214c9557-724f-4d67-bd9f-e416b211e20c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:03.431689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-214c9557-724f-4d67-bd9f-e416b211e20c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:03.451565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1fd3ea9e-c069-421b-bd2a-5943e2442190 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:03.452169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1fd3ea9e-c069-421b-bd2a-5943e2442190 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:03.458532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fd3ea9e-c069-421b-bd2a-5943e2442190 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:03.459005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fd3ea9e-c069-421b-bd2a-5943e2442190 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:03.459436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fd3ea9e-c069-421b-bd2a-5943e2442190 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:03.460109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fd3ea9e-c069-421b-bd2a-5943e2442190 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:03.460585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fd3ea9e-c069-421b-bd2a-5943e2442190 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:03.460996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fd3ea9e-c069-421b-bd2a-5943e2442190 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:03.559741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-214c9557-724f-4d67-bd9f-e416b211e20c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:03.568154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-214c9557-724f-4d67-bd9f-e416b211e20c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149737 Aug 06 12:54:03.568758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1084/2156] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:03 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:03.573135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:03.573731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:03.579792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:03.580268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:03.580744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:03.581435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:03.581875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:03.582488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:03.591101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1fd3ea9e-c069-421b-bd2a-5943e2442190 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:03.599051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1fd3ea9e-c069-421b-bd2a-5943e2442190 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152021 Aug 06 12:54:03.599810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1073/2157] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:03 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:03.643084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:03.651381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:03.652915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:03.654031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a72b14f-8b3d-4ae4-b3a9-6bc4d332d95a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084368 Aug 06 12:54:03.654578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1085/2158] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:04.590045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38293215-a415-4335-9351-94b42aaec0cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:04.590641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38293215-a415-4335-9351-94b42aaec0cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:04.597662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38293215-a415-4335-9351-94b42aaec0cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:04.598141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38293215-a415-4335-9351-94b42aaec0cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:04.598575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38293215-a415-4335-9351-94b42aaec0cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:04.599257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38293215-a415-4335-9351-94b42aaec0cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:04.599706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38293215-a415-4335-9351-94b42aaec0cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:04.600128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38293215-a415-4335-9351-94b42aaec0cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:04.620184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0944d44e-42c8-4bc9-a640-3f38b4c27846 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:04.620878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0944d44e-42c8-4bc9-a640-3f38b4c27846 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:04.627204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0944d44e-42c8-4bc9-a640-3f38b4c27846 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:04.627675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0944d44e-42c8-4bc9-a640-3f38b4c27846 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:04.628126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0944d44e-42c8-4bc9-a640-3f38b4c27846 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:04.628828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0944d44e-42c8-4bc9-a640-3f38b4c27846 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:04.629269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0944d44e-42c8-4bc9-a640-3f38b4c27846 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:04.629684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0944d44e-42c8-4bc9-a640-3f38b4c27846 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:04.729112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-38293215-a415-4335-9351-94b42aaec0cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:04.737855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38293215-a415-4335-9351-94b42aaec0cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151723 Aug 06 12:54:04.738425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1074/2159] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:04.742823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:04.743421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:04.749001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:04.749475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:04.750006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:04.750696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:04.751376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:04.751596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:04.761297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0944d44e-42c8-4bc9-a640-3f38b4c27846 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:04.770295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0944d44e-42c8-4bc9-a640-3f38b4c27846 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153497 Aug 06 12:54:04.771302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1086/2160] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:04 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:04.823153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:04.832040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:04.833608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:04.834761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16cdf267-7759-4d50-a409-ddbc5a3ddc2d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.095424 Aug 06 12:54:04.835554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1075/2161] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:05.758610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8a69c7b9-c332-4028-afd6-58a602acc42c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:05.759159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8a69c7b9-c332-4028-afd6-58a602acc42c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:05.765596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a69c7b9-c332-4028-afd6-58a602acc42c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:05.766076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a69c7b9-c332-4028-afd6-58a602acc42c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:05.766512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a69c7b9-c332-4028-afd6-58a602acc42c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:05.767195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a69c7b9-c332-4028-afd6-58a602acc42c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:05.767647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a69c7b9-c332-4028-afd6-58a602acc42c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:05.768073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a69c7b9-c332-4028-afd6-58a602acc42c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:05.792179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db2118fe-d8e2-4a58-815a-7776b93f9134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:05.792838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db2118fe-d8e2-4a58-815a-7776b93f9134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:05.799937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db2118fe-d8e2-4a58-815a-7776b93f9134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:05.800450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db2118fe-d8e2-4a58-815a-7776b93f9134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:05.800894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db2118fe-d8e2-4a58-815a-7776b93f9134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:05.801584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db2118fe-d8e2-4a58-815a-7776b93f9134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:05.802041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db2118fe-d8e2-4a58-815a-7776b93f9134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:05.802469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db2118fe-d8e2-4a58-815a-7776b93f9134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:05.897287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8a69c7b9-c332-4028-afd6-58a602acc42c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:05.905709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8a69c7b9-c332-4028-afd6-58a602acc42c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151007 Aug 06 12:54:05.906277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1087/2162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:05 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:05.910639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:05.911228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:05.916753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:05.917233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:05.917662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:05.918344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:05.918792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:05.919213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:05.923698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:05.934958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db2118fe-d8e2-4a58-815a-7776b93f9134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:05.942885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db2118fe-d8e2-4a58-815a-7776b93f9134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154512 Aug 06 12:54:05.943637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1076/2163] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:05 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:05.981001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:05.990572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:05.992073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:05.993242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1313c4d6-b437-43d9-9d61-2214153fd5fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086061 Aug 06 12:54:05.993799 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1088/2164] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:06.926803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4a085c4e-eab4-41f8-925d-59d844f89188 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:06.927443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4a085c4e-eab4-41f8-925d-59d844f89188 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:06.933758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a085c4e-eab4-41f8-925d-59d844f89188 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:06.934234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a085c4e-eab4-41f8-925d-59d844f89188 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:06.934669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a085c4e-eab4-41f8-925d-59d844f89188 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:06.935962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a085c4e-eab4-41f8-925d-59d844f89188 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:06.936444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a085c4e-eab4-41f8-925d-59d844f89188 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:06.936867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a085c4e-eab4-41f8-925d-59d844f89188 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:06.963027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3c8e6923-e350-4c1e-8c95-55c965e7ce91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:06.964663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3c8e6923-e350-4c1e-8c95-55c965e7ce91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:06.971716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c8e6923-e350-4c1e-8c95-55c965e7ce91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:06.972205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c8e6923-e350-4c1e-8c95-55c965e7ce91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:06.973215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c8e6923-e350-4c1e-8c95-55c965e7ce91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:06.973923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c8e6923-e350-4c1e-8c95-55c965e7ce91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:06.974379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c8e6923-e350-4c1e-8c95-55c965e7ce91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:06.974809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c8e6923-e350-4c1e-8c95-55c965e7ce91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:07.073248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4a085c4e-eab4-41f8-925d-59d844f89188 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:07.081941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4a085c4e-eab4-41f8-925d-59d844f89188 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.158999 Aug 06 12:54:07.082513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1077/2165] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:06 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:07.089204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:07.092505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:07.100888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:07.101369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:07.101798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:07.102499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:07.102949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:07.103370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:07.129149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3c8e6923-e350-4c1e-8c95-55c965e7ce91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:07.137293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3c8e6923-e350-4c1e-8c95-55c965e7ce91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.178088 Aug 06 12:54:07.137853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1089/2166] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:06 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:07.173980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:07.182378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:07.183862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:07.185026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fc416526-5c84-4c75-93e6-373d98c3144e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.101606 Aug 06 12:54:07.185574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1078/2167] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:07 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:08.106108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e584ed70-5529-4943-a08b-1f03bb80c176 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:08.106710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e584ed70-5529-4943-a08b-1f03bb80c176 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:08.113278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e584ed70-5529-4943-a08b-1f03bb80c176 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:08.113757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e584ed70-5529-4943-a08b-1f03bb80c176 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:08.114185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e584ed70-5529-4943-a08b-1f03bb80c176 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:08.114863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e584ed70-5529-4943-a08b-1f03bb80c176 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:08.115310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e584ed70-5529-4943-a08b-1f03bb80c176 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:08.115729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e584ed70-5529-4943-a08b-1f03bb80c176 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:08.158497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-45b04204-3280-4432-a0a9-14f6509faf84 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:08.159211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-45b04204-3280-4432-a0a9-14f6509faf84 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:08.165734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b04204-3280-4432-a0a9-14f6509faf84 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:08.166211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b04204-3280-4432-a0a9-14f6509faf84 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:08.166640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b04204-3280-4432-a0a9-14f6509faf84 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:08.167326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b04204-3280-4432-a0a9-14f6509faf84 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:08.167769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b04204-3280-4432-a0a9-14f6509faf84 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:08.168188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45b04204-3280-4432-a0a9-14f6509faf84 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:08.244818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e584ed70-5529-4943-a08b-1f03bb80c176 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:08.253199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e584ed70-5529-4943-a08b-1f03bb80c176 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150793 Aug 06 12:54:08.253701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1090/2168] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:08 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:08.258082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:08.258684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:08.264495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:08.265491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:08.265491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:08.266065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:08.266511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:08.267290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:08.296684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-45b04204-3280-4432-a0a9-14f6509faf84 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:08.304878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-45b04204-3280-4432-a0a9-14f6509faf84 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150143 Aug 06 12:54:08.305449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1079/2169] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:08 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:08.327394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:08.336047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:08.337625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:08.338765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-56e12068-38bb-49e4-8985-9c0452c17f80 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084158 Aug 06 12:54:08.339325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1091/2170] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:08 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:09.274147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d66deee0-a292-4c1e-a201-ab2a5c49c495 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:09.274694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d66deee0-a292-4c1e-a201-ab2a5c49c495 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:09.281763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d66deee0-a292-4c1e-a201-ab2a5c49c495 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:09.282242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d66deee0-a292-4c1e-a201-ab2a5c49c495 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:09.282678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d66deee0-a292-4c1e-a201-ab2a5c49c495 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:09.283366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d66deee0-a292-4c1e-a201-ab2a5c49c495 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:09.283824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d66deee0-a292-4c1e-a201-ab2a5c49c495 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:09.284251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d66deee0-a292-4c1e-a201-ab2a5c49c495 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:09.326683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d7215920-ea13-4579-9a12-a139413607cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:09.327279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d7215920-ea13-4579-9a12-a139413607cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:09.333664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7215920-ea13-4579-9a12-a139413607cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:09.334137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7215920-ea13-4579-9a12-a139413607cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:09.334559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7215920-ea13-4579-9a12-a139413607cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:09.335228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7215920-ea13-4579-9a12-a139413607cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:09.335670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7215920-ea13-4579-9a12-a139413607cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:09.336087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7215920-ea13-4579-9a12-a139413607cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:09.412444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d66deee0-a292-4c1e-a201-ab2a5c49c495 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:09.420504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d66deee0-a292-4c1e-a201-ab2a5c49c495 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150230 Aug 06 12:54:09.421120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1080/2171] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:09 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:09.425581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:09.426173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:09.432137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:09.432717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:09.433144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:09.433828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:09.434275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:09.434692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:09.469981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d7215920-ea13-4579-9a12-a139413607cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:09.477859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d7215920-ea13-4579-9a12-a139413607cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.155444 Aug 06 12:54:09.478426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1092/2172] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:09 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:09.499610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:09.507892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:09.509397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:09.510522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b2d98e2-cc23-43f0-8c4b-7b8b7cbca4ef tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088479 Aug 06 12:54:09.511062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1081/2173] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:10.441803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6e521f4f-fa5b-4049-8631-f10904404736 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:10.442434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6e521f4f-fa5b-4049-8631-f10904404736 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:10.448782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e521f4f-fa5b-4049-8631-f10904404736 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:10.449254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e521f4f-fa5b-4049-8631-f10904404736 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:10.449685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e521f4f-fa5b-4049-8631-f10904404736 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:10.450389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e521f4f-fa5b-4049-8631-f10904404736 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:10.451205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e521f4f-fa5b-4049-8631-f10904404736 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:10.451205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e521f4f-fa5b-4049-8631-f10904404736 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:10.499242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b17c2c81-0288-4276-87ba-c86a762449c3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:10.499884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b17c2c81-0288-4276-87ba-c86a762449c3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:10.506328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b17c2c81-0288-4276-87ba-c86a762449c3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:10.506810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b17c2c81-0288-4276-87ba-c86a762449c3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:10.507241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b17c2c81-0288-4276-87ba-c86a762449c3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:10.508205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b17c2c81-0288-4276-87ba-c86a762449c3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:10.508683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b17c2c81-0288-4276-87ba-c86a762449c3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:10.509110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b17c2c81-0288-4276-87ba-c86a762449c3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:10.579810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6e521f4f-fa5b-4049-8631-f10904404736 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:10.587882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6e521f4f-fa5b-4049-8631-f10904404736 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149900 Aug 06 12:54:10.588475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1093/2174] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:10 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:10.593418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:10.594014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:10.599678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:10.600035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:10.600513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:10.601196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:10.601642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:10.602060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:10.640327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b17c2c81-0288-4276-87ba-c86a762449c3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:10.651201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b17c2c81-0288-4276-87ba-c86a762449c3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.155694 Aug 06 12:54:10.651782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1082/2175] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:10 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:10.673146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:10.681453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:10.682943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:10.684066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b1395e92-1a79-4e40-af91-a57661bff002 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.094686 Aug 06 12:54:10.684685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1094/2176] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:10 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:11.610785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-57420b51-3b52-4749-98bf-83efd092bb5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:11.611371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-57420b51-3b52-4749-98bf-83efd092bb5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:11.617745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57420b51-3b52-4749-98bf-83efd092bb5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:11.618222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57420b51-3b52-4749-98bf-83efd092bb5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:11.618659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57420b51-3b52-4749-98bf-83efd092bb5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:11.619343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57420b51-3b52-4749-98bf-83efd092bb5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:11.619794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57420b51-3b52-4749-98bf-83efd092bb5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:11.620214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57420b51-3b52-4749-98bf-83efd092bb5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:11.673463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a48259d-abc6-47d6-87a3-60bd66289507 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:11.674068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0a48259d-abc6-47d6-87a3-60bd66289507 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:11.680494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a48259d-abc6-47d6-87a3-60bd66289507 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:11.680980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a48259d-abc6-47d6-87a3-60bd66289507 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:11.681411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a48259d-abc6-47d6-87a3-60bd66289507 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:11.682103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a48259d-abc6-47d6-87a3-60bd66289507 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:11.682653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a48259d-abc6-47d6-87a3-60bd66289507 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:11.682968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a48259d-abc6-47d6-87a3-60bd66289507 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:11.747877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57420b51-3b52-4749-98bf-83efd092bb5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:11.755810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-57420b51-3b52-4749-98bf-83efd092bb5a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149734 Aug 06 12:54:11.756392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1083/2177] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:11 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:11.760920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:11.761580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:11.767405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:11.767915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:11.768327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:11.769021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:11.769468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:11.769892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:11.813779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0a48259d-abc6-47d6-87a3-60bd66289507 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:11.821685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0a48259d-abc6-47d6-87a3-60bd66289507 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152621 Aug 06 12:54:11.822255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1095/2178] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:11 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:11.833804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:11.842629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:11.844098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:11.845255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-28c741c8-f53f-4ea6-8c87-675def2c2b18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087958 Aug 06 12:54:11.845801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1084/2179] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:11 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:12.776853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-87333e16-3836-472d-b9e8-9094eab80b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:12.779075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-87333e16-3836-472d-b9e8-9094eab80b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:12.784019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87333e16-3836-472d-b9e8-9094eab80b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:12.784529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87333e16-3836-472d-b9e8-9094eab80b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:12.784959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87333e16-3836-472d-b9e8-9094eab80b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:12.785636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87333e16-3836-472d-b9e8-9094eab80b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:12.786085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87333e16-3836-472d-b9e8-9094eab80b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:12.786504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87333e16-3836-472d-b9e8-9094eab80b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:12.842441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d8b7352b-2d30-4d4b-9c95-d616c9a9ef5a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:12.843026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d8b7352b-2d30-4d4b-9c95-d616c9a9ef5a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:12.849595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8b7352b-2d30-4d4b-9c95-d616c9a9ef5a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:12.850076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8b7352b-2d30-4d4b-9c95-d616c9a9ef5a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:12.850510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8b7352b-2d30-4d4b-9c95-d616c9a9ef5a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:12.851197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8b7352b-2d30-4d4b-9c95-d616c9a9ef5a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:12.851645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8b7352b-2d30-4d4b-9c95-d616c9a9ef5a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:12.852067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8b7352b-2d30-4d4b-9c95-d616c9a9ef5a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:12.917672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-87333e16-3836-472d-b9e8-9094eab80b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:12.926107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-87333e16-3836-472d-b9e8-9094eab80b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153011 Aug 06 12:54:12.926673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1096/2180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:12 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:12.931030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:12.932216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:12.938465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:12.938942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:12.939371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:12.940051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:12.940698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:12.941121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:12.997774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d8b7352b-2d30-4d4b-9c95-d616c9a9ef5a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:13.006033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d8b7352b-2d30-4d4b-9c95-d616c9a9ef5a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.167367 Aug 06 12:54:13.006684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1085/2181] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:12 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:13.009836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:13.018195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:13.019683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:13.020842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b9ca9614-4576-4bd6-b486-7c25e57ab5c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.093267 Aug 06 12:54:13.021380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1097/2182] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:12 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:13.947433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-73308ec3-0ed4-4d6d-b513-5afab27f98cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:13.948064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-73308ec3-0ed4-4d6d-b513-5afab27f98cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:13.955180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73308ec3-0ed4-4d6d-b513-5afab27f98cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:13.955659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73308ec3-0ed4-4d6d-b513-5afab27f98cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:13.956091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73308ec3-0ed4-4d6d-b513-5afab27f98cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:13.956813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73308ec3-0ed4-4d6d-b513-5afab27f98cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:13.957253 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73308ec3-0ed4-4d6d-b513-5afab27f98cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:13.957675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73308ec3-0ed4-4d6d-b513-5afab27f98cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:14.027335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c5050411-1d63-4702-af8a-e8fe1d9ad0fd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:14.028037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c5050411-1d63-4702-af8a-e8fe1d9ad0fd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:14.034361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5050411-1d63-4702-af8a-e8fe1d9ad0fd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:14.034835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5050411-1d63-4702-af8a-e8fe1d9ad0fd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:14.035260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5050411-1d63-4702-af8a-e8fe1d9ad0fd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:14.035935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5050411-1d63-4702-af8a-e8fe1d9ad0fd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:14.036462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5050411-1d63-4702-af8a-e8fe1d9ad0fd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:14.036905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c5050411-1d63-4702-af8a-e8fe1d9ad0fd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:14.084977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-73308ec3-0ed4-4d6d-b513-5afab27f98cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:14.092925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-73308ec3-0ed4-4d6d-b513-5afab27f98cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149312 Aug 06 12:54:14.093491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1086/2183] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:13 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:14.097824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:14.098418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:14.103950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:14.104454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:14.104885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:14.106205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:14.106205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:14.106415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:14.121821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:14.167438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c5050411-1d63-4702-af8a-e8fe1d9ad0fd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:14.172374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:14.175670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c5050411-1d63-4702-af8a-e8fe1d9ad0fd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152123 Aug 06 12:54:14.176237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1098/2184] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:14 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:14.180790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:14.182273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:14.183426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-71a230c9-7f56-4026-84d6-c08bfd569d16 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089042 Aug 06 12:54:14.183958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1087/2185] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:15.114401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-755bdcea-02e3-4eae-b2ee-998bfe57f0da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:15.114960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-755bdcea-02e3-4eae-b2ee-998bfe57f0da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:15.121337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-755bdcea-02e3-4eae-b2ee-998bfe57f0da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:15.121812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-755bdcea-02e3-4eae-b2ee-998bfe57f0da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:15.122239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-755bdcea-02e3-4eae-b2ee-998bfe57f0da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:15.122917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-755bdcea-02e3-4eae-b2ee-998bfe57f0da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:15.123364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-755bdcea-02e3-4eae-b2ee-998bfe57f0da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:15.123786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-755bdcea-02e3-4eae-b2ee-998bfe57f0da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:15.197448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1864440e-c6c9-4454-8ae5-04b2b0c8a0eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:15.198060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1864440e-c6c9-4454-8ae5-04b2b0c8a0eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:15.205153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1864440e-c6c9-4454-8ae5-04b2b0c8a0eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:15.205660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1864440e-c6c9-4454-8ae5-04b2b0c8a0eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:15.206103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1864440e-c6c9-4454-8ae5-04b2b0c8a0eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:15.206775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1864440e-c6c9-4454-8ae5-04b2b0c8a0eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:15.207221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1864440e-c6c9-4454-8ae5-04b2b0c8a0eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:15.207635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1864440e-c6c9-4454-8ae5-04b2b0c8a0eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:15.251670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-755bdcea-02e3-4eae-b2ee-998bfe57f0da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:15.259591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-755bdcea-02e3-4eae-b2ee-998bfe57f0da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149103 Aug 06 12:54:15.260147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1099/2186] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:15 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:15.265014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:15.265600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:15.271171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:15.271640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:15.272063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:15.272761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:15.273207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:15.273620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:15.337124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:15.337989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1864440e-c6c9-4454-8ae5-04b2b0c8a0eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:15.346147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:15.346323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1864440e-c6c9-4454-8ae5-04b2b0c8a0eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152764 Aug 06 12:54:15.346850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1088/2187] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:15 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:15.347716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:15.348888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a4fdeb9c-1942-4c6b-bce2-811d91eb78f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087816 Aug 06 12:54:15.349584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1100/2188] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:15 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:16.281400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-44840e83-3d41-4d22-870f-fe105c1f53d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:16.281933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-44840e83-3d41-4d22-870f-fe105c1f53d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:16.288255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44840e83-3d41-4d22-870f-fe105c1f53d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:16.288767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44840e83-3d41-4d22-870f-fe105c1f53d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:16.289193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44840e83-3d41-4d22-870f-fe105c1f53d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:16.289870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44840e83-3d41-4d22-870f-fe105c1f53d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:16.290317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44840e83-3d41-4d22-870f-fe105c1f53d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:16.290735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44840e83-3d41-4d22-870f-fe105c1f53d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:16.367185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-29e77f86-745f-4de1-8daa-4762492c98f4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:16.367788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-29e77f86-745f-4de1-8daa-4762492c98f4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:16.373990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e77f86-745f-4de1-8daa-4762492c98f4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:16.374471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e77f86-745f-4de1-8daa-4762492c98f4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:16.374897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e77f86-745f-4de1-8daa-4762492c98f4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:16.375582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e77f86-745f-4de1-8daa-4762492c98f4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:16.376030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e77f86-745f-4de1-8daa-4762492c98f4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:16.376485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29e77f86-745f-4de1-8daa-4762492c98f4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:16.424482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-44840e83-3d41-4d22-870f-fe105c1f53d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:16.432388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-44840e83-3d41-4d22-870f-fe105c1f53d7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.155351 Aug 06 12:54:16.432947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1089/2189] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:16 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:16.437296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:16.437885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:16.443461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:16.443950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:16.444861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:16.445096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:16.445540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:16.446169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:16.508333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-29e77f86-745f-4de1-8daa-4762492c98f4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:16.509987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:16.516840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-29e77f86-745f-4de1-8daa-4762492c98f4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153588 Aug 06 12:54:16.517411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1101/2190] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:16 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:16.518753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:16.520231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:16.521378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-54c725fd-e49b-4193-a6c4-eb499d8d9bee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087536 Aug 06 12:54:16.521916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1090/2191] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:17.453276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-93b3855a-140d-4443-940a-f2e0f4c60fd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:17.453885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-93b3855a-140d-4443-940a-f2e0f4c60fd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:17.460227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93b3855a-140d-4443-940a-f2e0f4c60fd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:17.460733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93b3855a-140d-4443-940a-f2e0f4c60fd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:17.461165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93b3855a-140d-4443-940a-f2e0f4c60fd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:17.461840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93b3855a-140d-4443-940a-f2e0f4c60fd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:17.462284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93b3855a-140d-4443-940a-f2e0f4c60fd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:17.462702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93b3855a-140d-4443-940a-f2e0f4c60fd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:17.538513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f765fbaa-c7ab-45a7-84c2-4b09f5d912cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:17.539177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f765fbaa-c7ab-45a7-84c2-4b09f5d912cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:17.546238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f765fbaa-c7ab-45a7-84c2-4b09f5d912cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:17.546715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f765fbaa-c7ab-45a7-84c2-4b09f5d912cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:17.547149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f765fbaa-c7ab-45a7-84c2-4b09f5d912cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:17.547833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f765fbaa-c7ab-45a7-84c2-4b09f5d912cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:17.548289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f765fbaa-c7ab-45a7-84c2-4b09f5d912cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:17.548808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f765fbaa-c7ab-45a7-84c2-4b09f5d912cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:17.589815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-93b3855a-140d-4443-940a-f2e0f4c60fd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:17.598235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-93b3855a-140d-4443-940a-f2e0f4c60fd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148834 Aug 06 12:54:17.598795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1102/2192] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:17 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:17.614114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:17.614706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:17.620622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:17.621108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:17.621543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:17.622256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:17.622701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:17.623120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:17.679843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f765fbaa-c7ab-45a7-84c2-4b09f5d912cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:17.686203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:17.688088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f765fbaa-c7ab-45a7-84c2-4b09f5d912cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153493 Aug 06 12:54:17.688697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1091/2193] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:17 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:17.694503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:17.695998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:17.697144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4a621652-30a3-4a5d-9dfa-6a665ccad69a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087010 Aug 06 12:54:17.697680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1103/2194] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:17 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:18.619856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7f2c85bc-6395-41f5-8a8b-932868ed5924 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:18.620486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7f2c85bc-6395-41f5-8a8b-932868ed5924 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:18.627293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f2c85bc-6395-41f5-8a8b-932868ed5924 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:18.627763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f2c85bc-6395-41f5-8a8b-932868ed5924 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:18.628187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f2c85bc-6395-41f5-8a8b-932868ed5924 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:18.628885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f2c85bc-6395-41f5-8a8b-932868ed5924 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:18.629330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f2c85bc-6395-41f5-8a8b-932868ed5924 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:18.629752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f2c85bc-6395-41f5-8a8b-932868ed5924 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:18.709151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f95a68a1-dad9-42fb-a5e3-b12ae6f0f8eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:18.709761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f95a68a1-dad9-42fb-a5e3-b12ae6f0f8eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:18.716783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f95a68a1-dad9-42fb-a5e3-b12ae6f0f8eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:18.717263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f95a68a1-dad9-42fb-a5e3-b12ae6f0f8eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:18.717697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f95a68a1-dad9-42fb-a5e3-b12ae6f0f8eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:18.718388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f95a68a1-dad9-42fb-a5e3-b12ae6f0f8eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:18.718850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f95a68a1-dad9-42fb-a5e3-b12ae6f0f8eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:18.719276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f95a68a1-dad9-42fb-a5e3-b12ae6f0f8eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:18.758002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7f2c85bc-6395-41f5-8a8b-932868ed5924 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:18.766069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7f2c85bc-6395-41f5-8a8b-932868ed5924 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149973 Aug 06 12:54:18.766645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1092/2195] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:18 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:18.771151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:18.771748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:18.777560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:18.778050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:18.778488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:18.779175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:18.779675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:18.780059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:18.843457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:18.849795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f95a68a1-dad9-42fb-a5e3-b12ae6f0f8eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:18.851940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:18.852079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:18.853742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:18.855009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7a392c1b-92bb-451e-bcfa-d517b357e820 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087446 Aug 06 12:54:18.855571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1093/2196] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:18.860674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f95a68a1-dad9-42fb-a5e3-b12ae6f0f8eb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.155319 Aug 06 12:54:18.861235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1104/2197] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:18 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:19.787196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4c1abd2b-2c63-4cf2-abd0-b9b2c90a6f07 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:19.787793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4c1abd2b-2c63-4cf2-abd0-b9b2c90a6f07 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:19.794496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c1abd2b-2c63-4cf2-abd0-b9b2c90a6f07 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:19.795274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c1abd2b-2c63-4cf2-abd0-b9b2c90a6f07 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:19.795714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c1abd2b-2c63-4cf2-abd0-b9b2c90a6f07 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:19.796441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c1abd2b-2c63-4cf2-abd0-b9b2c90a6f07 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:19.796894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c1abd2b-2c63-4cf2-abd0-b9b2c90a6f07 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:19.797329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c1abd2b-2c63-4cf2-abd0-b9b2c90a6f07 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:19.877954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:19.878552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:19.885040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:19.885522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:19.885951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:19.886632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:19.887084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:19.887563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:19.927889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4c1abd2b-2c63-4cf2-abd0-b9b2c90a6f07 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:19.936433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4c1abd2b-2c63-4cf2-abd0-b9b2c90a6f07 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153056 Aug 06 12:54:19.937001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1094/2198] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:19 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:19.941497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-49d4ec4b-91b5-44a2-95f3-cfad2a8824a7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:19.942105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-49d4ec4b-91b5-44a2-95f3-cfad2a8824a7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:19.947684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-49d4ec4b-91b5-44a2-95f3-cfad2a8824a7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:19.948165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-49d4ec4b-91b5-44a2-95f3-cfad2a8824a7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:19.948632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-49d4ec4b-91b5-44a2-95f3-cfad2a8824a7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:19.949324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-49d4ec4b-91b5-44a2-95f3-cfad2a8824a7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:19.949507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:19.949782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-49d4ec4b-91b5-44a2-95f3-cfad2a8824a7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:19.950774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-49d4ec4b-91b5-44a2-95f3-cfad2a8824a7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:19.958772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:19.960347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:19.961483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-34c5751f-d9b3-4262-865f-600c19738b0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087397 Aug 06 12:54:19.962231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1105/2199] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:54:20.078909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-49d4ec4b-91b5-44a2-95f3-cfad2a8824a7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:20.087109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-49d4ec4b-91b5-44a2-95f3-cfad2a8824a7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149115 Aug 06 12:54:20.088530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1095/2200] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:19 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:20.958558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-40658f43-c93d-415c-9ac7-df265203cc7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:20.959089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-40658f43-c93d-415c-9ac7-df265203cc7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:20.966021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40658f43-c93d-415c-9ac7-df265203cc7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:20.966507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40658f43-c93d-415c-9ac7-df265203cc7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:20.966939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40658f43-c93d-415c-9ac7-df265203cc7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:20.967620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40658f43-c93d-415c-9ac7-df265203cc7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:20.968069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40658f43-c93d-415c-9ac7-df265203cc7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:20.968514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40658f43-c93d-415c-9ac7-df265203cc7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:20.983406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:20.984025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:20.990737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:20.991288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:20.991687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:20.992400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:20.992859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:20.993280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:21.060139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:21.068656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:21.070130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:21.071258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-efa66637-a77d-42dc-930d-7278e05d6c73 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.092306 Aug 06 12:54:21.071821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1096/2201] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:54:21.107509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-40658f43-c93d-415c-9ac7-df265203cc7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:21.108838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d19e2bd-4eff-4c37-a50f-0d98dd986cc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:21.109447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d19e2bd-4eff-4c37-a50f-0d98dd986cc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:21.115511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d19e2bd-4eff-4c37-a50f-0d98dd986cc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:21.115737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-40658f43-c93d-415c-9ac7-df265203cc7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.161061 Aug 06 12:54:21.115981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d19e2bd-4eff-4c37-a50f-0d98dd986cc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:21.116295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1106/2202] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:20 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:21.116455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d19e2bd-4eff-4c37-a50f-0d98dd986cc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:21.117112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d19e2bd-4eff-4c37-a50f-0d98dd986cc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:21.117562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d19e2bd-4eff-4c37-a50f-0d98dd986cc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:21.117978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d19e2bd-4eff-4c37-a50f-0d98dd986cc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:21.248453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d19e2bd-4eff-4c37-a50f-0d98dd986cc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:21.256331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d19e2bd-4eff-4c37-a50f-0d98dd986cc1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151265 Aug 06 12:54:21.256895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1097/2203] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:21 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:22.094141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:22.094740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:22.101884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:22.102357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:22.102784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:22.103457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:22.103898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:22.104328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:22.137097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a7a0947c-9935-43f3-8012-053c59556816 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:22.138383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a7a0947c-9935-43f3-8012-053c59556816 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:22.144925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7a0947c-9935-43f3-8012-053c59556816 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:22.145427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7a0947c-9935-43f3-8012-053c59556816 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:22.145850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7a0947c-9935-43f3-8012-053c59556816 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:22.146554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7a0947c-9935-43f3-8012-053c59556816 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:22.147009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7a0947c-9935-43f3-8012-053c59556816 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:22.147433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7a0947c-9935-43f3-8012-053c59556816 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:22.165187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:22.173486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:22.174971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:22.176088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a5bf553d-297e-4b8c-bd8c-bd2ffa3db1f4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085928 Aug 06 12:54:22.176658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1107/2204] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:22.274848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a7a0947c-9935-43f3-8012-053c59556816 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:22.277368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-43267f34-bb60-46a4-a405-b9f6e735055c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:22.277993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-43267f34-bb60-46a4-a405-b9f6e735055c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:22.282790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a7a0947c-9935-43f3-8012-053c59556816 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149599 Aug 06 12:54:22.283542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1098/2205] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:22 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:22.283730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43267f34-bb60-46a4-a405-b9f6e735055c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:22.284201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43267f34-bb60-46a4-a405-b9f6e735055c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:22.284658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43267f34-bb60-46a4-a405-b9f6e735055c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:22.285334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43267f34-bb60-46a4-a405-b9f6e735055c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:22.285774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43267f34-bb60-46a4-a405-b9f6e735055c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:22.286190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43267f34-bb60-46a4-a405-b9f6e735055c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:22.418153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-43267f34-bb60-46a4-a405-b9f6e735055c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:22.425941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-43267f34-bb60-46a4-a405-b9f6e735055c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152271 Aug 06 12:54:22.426491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1108/2206] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:22 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:23.198945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:23.199556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:23.205997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:23.206493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:23.206926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:23.207612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:23.208066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:23.208517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:23.272641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:23.285968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:23.287472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:23.288651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8172ef0-ed83-45af-8b75-0ccab17f869c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.093562 Aug 06 12:54:23.289212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1099/2207] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:23.302836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-44ae120f-ef21-458e-be04-4844473ec439 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:23.303528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-44ae120f-ef21-458e-be04-4844473ec439 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:23.310001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ae120f-ef21-458e-be04-4844473ec439 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:23.310475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ae120f-ef21-458e-be04-4844473ec439 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:23.310915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ae120f-ef21-458e-be04-4844473ec439 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:23.311599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ae120f-ef21-458e-be04-4844473ec439 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:23.312048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ae120f-ef21-458e-be04-4844473ec439 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:23.312506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44ae120f-ef21-458e-be04-4844473ec439 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:23.445382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-44ae120f-ef21-458e-be04-4844473ec439 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:23.446845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fe1fac26-5112-448d-bbe3-437d4c6d622b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:23.447452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fe1fac26-5112-448d-bbe3-437d4c6d622b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:23.453780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe1fac26-5112-448d-bbe3-437d4c6d622b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:23.453937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-44ae120f-ef21-458e-be04-4844473ec439 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.154773 Aug 06 12:54:23.454252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe1fac26-5112-448d-bbe3-437d4c6d622b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:23.454356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1109/2208] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:23.454682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe1fac26-5112-448d-bbe3-437d4c6d622b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:23.455366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe1fac26-5112-448d-bbe3-437d4c6d622b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:23.455819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe1fac26-5112-448d-bbe3-437d4c6d622b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:23.456241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe1fac26-5112-448d-bbe3-437d4c6d622b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:23.581925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fe1fac26-5112-448d-bbe3-437d4c6d622b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:23.589738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fe1fac26-5112-448d-bbe3-437d4c6d622b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146704 Aug 06 12:54:23.590301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1100/2209] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:23 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:24.311578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:24.312175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:24.318479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:24.318949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:24.319377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:24.320048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:24.320521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:24.320935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:24.381382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:24.389615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:24.391103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:24.392226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-db3da55a-7c7e-4033-a2a9-78f8e90d8b84 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085099 Aug 06 12:54:24.392804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1110/2210] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:24.475990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16f61cfc-b3fa-4a45-9e67-c5ac4ebb7806 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:24.476641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16f61cfc-b3fa-4a45-9e67-c5ac4ebb7806 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:24.483965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16f61cfc-b3fa-4a45-9e67-c5ac4ebb7806 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:24.484474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16f61cfc-b3fa-4a45-9e67-c5ac4ebb7806 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:24.485183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16f61cfc-b3fa-4a45-9e67-c5ac4ebb7806 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:24.485872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16f61cfc-b3fa-4a45-9e67-c5ac4ebb7806 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:24.486329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16f61cfc-b3fa-4a45-9e67-c5ac4ebb7806 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:24.486755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16f61cfc-b3fa-4a45-9e67-c5ac4ebb7806 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:24.621347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16f61cfc-b3fa-4a45-9e67-c5ac4ebb7806 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:24.629382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16f61cfc-b3fa-4a45-9e67-c5ac4ebb7806 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.157178 Aug 06 12:54:24.629951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1101/2211] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:24.815393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-49fdc4a3-5767-4654-b8af-8f0b48f86726 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:24.816898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-49fdc4a3-5767-4654-b8af-8f0b48f86726 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:24.823552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fdc4a3-5767-4654-b8af-8f0b48f86726 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:24.824183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fdc4a3-5767-4654-b8af-8f0b48f86726 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:24.825279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fdc4a3-5767-4654-b8af-8f0b48f86726 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:24.826098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fdc4a3-5767-4654-b8af-8f0b48f86726 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:24.826703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fdc4a3-5767-4654-b8af-8f0b48f86726 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:24.827284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49fdc4a3-5767-4654-b8af-8f0b48f86726 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:24.957136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-49fdc4a3-5767-4654-b8af-8f0b48f86726 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:24.965312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-49fdc4a3-5767-4654-b8af-8f0b48f86726 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.357623 Aug 06 12:54:24.966467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1111/2212] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:24 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:25.413860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:25.414485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:25.416358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=80 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:25.421441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:25.421913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:25.422341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:25.423013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:25.423457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:25.423873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:25.486820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:25.494961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:25.496480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:25.498188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6c6e348b-6bd7-42d5-b5b9-b7dec2b7db7e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088226 Aug 06 12:54:25.498728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1102/2213] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:25.650317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a1796b5e-6714-4559-a2b9-f10c520771ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:25.650913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a1796b5e-6714-4559-a2b9-f10c520771ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:25.657349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1796b5e-6714-4559-a2b9-f10c520771ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:25.657847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1796b5e-6714-4559-a2b9-f10c520771ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:25.658276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1796b5e-6714-4559-a2b9-f10c520771ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:25.658951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1796b5e-6714-4559-a2b9-f10c520771ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:25.659397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1796b5e-6714-4559-a2b9-f10c520771ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:25.659816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1796b5e-6714-4559-a2b9-f10c520771ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:25.787774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a1796b5e-6714-4559-a2b9-f10c520771ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:25.796226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a1796b5e-6714-4559-a2b9-f10c520771ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150154 Aug 06 12:54:25.796813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1112/2214] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:25 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:25.987855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2952c328-15eb-4ff4-917e-a0c4baaf6078 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:25.988597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2952c328-15eb-4ff4-917e-a0c4baaf6078 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:25.994467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2952c328-15eb-4ff4-917e-a0c4baaf6078 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:25.994947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2952c328-15eb-4ff4-917e-a0c4baaf6078 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:25.995377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2952c328-15eb-4ff4-917e-a0c4baaf6078 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:25.996086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2952c328-15eb-4ff4-917e-a0c4baaf6078 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:25.996533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2952c328-15eb-4ff4-917e-a0c4baaf6078 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:25.997010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2952c328-15eb-4ff4-917e-a0c4baaf6078 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:26.121898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2952c328-15eb-4ff4-917e-a0c4baaf6078 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:26.129697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2952c328-15eb-4ff4-917e-a0c4baaf6078 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146005 Aug 06 12:54:26.130254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1103/2215] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:25 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:26.520188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:26.520815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:26.522646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=76 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:26.527677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:26.528159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:26.528616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:26.529292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:26.529740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:26.530160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:26.589731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:26.598520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:26.600005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:26.601157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb767b6c-6978-4bcf-bcb7-ec08e77de2e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084852 Aug 06 12:54:26.601705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1113/2216] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:26.818037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a07a2696-5870-4c37-b565-7a04a4278e1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:26.818637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a07a2696-5870-4c37-b565-7a04a4278e1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:26.825035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a07a2696-5870-4c37-b565-7a04a4278e1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:26.825509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a07a2696-5870-4c37-b565-7a04a4278e1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:26.825937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a07a2696-5870-4c37-b565-7a04a4278e1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:26.826612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a07a2696-5870-4c37-b565-7a04a4278e1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:26.827056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a07a2696-5870-4c37-b565-7a04a4278e1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:26.827470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a07a2696-5870-4c37-b565-7a04a4278e1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:26.831271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:26.953117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a07a2696-5870-4c37-b565-7a04a4278e1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:26.960969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a07a2696-5870-4c37-b565-7a04a4278e1e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146817 Aug 06 12:54:26.961558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1104/2217] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:27.150617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-443e18d8-4adc-4ee5-a518-c715c26578aa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:27.151215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-443e18d8-4adc-4ee5-a518-c715c26578aa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:27.159357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-443e18d8-4adc-4ee5-a518-c715c26578aa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:27.159830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-443e18d8-4adc-4ee5-a518-c715c26578aa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:27.160262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-443e18d8-4adc-4ee5-a518-c715c26578aa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:27.161004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-443e18d8-4adc-4ee5-a518-c715c26578aa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:27.161447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-443e18d8-4adc-4ee5-a518-c715c26578aa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:27.161861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-443e18d8-4adc-4ee5-a518-c715c26578aa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:27.287126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-443e18d8-4adc-4ee5-a518-c715c26578aa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:27.294924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-443e18d8-4adc-4ee5-a518-c715c26578aa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148254 Aug 06 12:54:27.295475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1114/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:27 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:27.625022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:27.625617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:27.631463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:27.631935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:27.632389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:27.633065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:27.633510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:27.633926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:27.697951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:27.706814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:27.708294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:27.709432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5bac2abf-5a80-4f35-ac91-ce33a86ff812 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088869 Aug 06 12:54:27.709981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1105/2219] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:27.982119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8b32d576-3962-452c-9e53-f319df2035cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:27.982644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8b32d576-3962-452c-9e53-f319df2035cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:27.988833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b32d576-3962-452c-9e53-f319df2035cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:27.989313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b32d576-3962-452c-9e53-f319df2035cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:27.989745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b32d576-3962-452c-9e53-f319df2035cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:27.990425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b32d576-3962-452c-9e53-f319df2035cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:27.990870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b32d576-3962-452c-9e53-f319df2035cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:27.991287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b32d576-3962-452c-9e53-f319df2035cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:28.132472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8b32d576-3962-452c-9e53-f319df2035cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:28.140278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8b32d576-3962-452c-9e53-f319df2035cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.162610 Aug 06 12:54:28.140855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1115/2220] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:27 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:28.315667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bc33a057-6efc-416b-9442-31425fc25411 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:28.316275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bc33a057-6efc-416b-9442-31425fc25411 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:28.322877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc33a057-6efc-416b-9442-31425fc25411 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:28.323357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc33a057-6efc-416b-9442-31425fc25411 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:28.323791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc33a057-6efc-416b-9442-31425fc25411 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:28.324526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc33a057-6efc-416b-9442-31425fc25411 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:28.324978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc33a057-6efc-416b-9442-31425fc25411 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:28.325397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc33a057-6efc-416b-9442-31425fc25411 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:28.450709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bc33a057-6efc-416b-9442-31425fc25411 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:28.458562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bc33a057-6efc-416b-9442-31425fc25411 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146749 Aug 06 12:54:28.459127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1106/2221] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:28 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:28.730628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:28.731250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:28.737759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:28.738235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:28.738663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:28.739333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:28.739777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:28.740193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:28.800030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:28.808195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:28.809698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:28.810805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-12a9e754-9668-4c39-85e9-ff58f3f64cf5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084061 Aug 06 12:54:28.811352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1116/2222] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:29.163243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6745e423-be95-4649-a410-e0927c08ab78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:29.164018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6745e423-be95-4649-a410-e0927c08ab78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:29.170327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6745e423-be95-4649-a410-e0927c08ab78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:29.170810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6745e423-be95-4649-a410-e0927c08ab78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:29.171243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6745e423-be95-4649-a410-e0927c08ab78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:29.172063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6745e423-be95-4649-a410-e0927c08ab78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:29.172636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6745e423-be95-4649-a410-e0927c08ab78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:29.173148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6745e423-be95-4649-a410-e0927c08ab78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:29.298327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6745e423-be95-4649-a410-e0927c08ab78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:29.306219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6745e423-be95-4649-a410-e0927c08ab78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147047 Aug 06 12:54:29.306779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1107/2223] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:29 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:29.478837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-61cea3e2-1f59-417d-8d86-5aad6fd200b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:29.479437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-61cea3e2-1f59-417d-8d86-5aad6fd200b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:29.486000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61cea3e2-1f59-417d-8d86-5aad6fd200b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:29.486479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61cea3e2-1f59-417d-8d86-5aad6fd200b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:29.486900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61cea3e2-1f59-417d-8d86-5aad6fd200b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:29.487566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61cea3e2-1f59-417d-8d86-5aad6fd200b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:29.488009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61cea3e2-1f59-417d-8d86-5aad6fd200b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:29.488476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61cea3e2-1f59-417d-8d86-5aad6fd200b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:29.615411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-61cea3e2-1f59-417d-8d86-5aad6fd200b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:29.623136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-61cea3e2-1f59-417d-8d86-5aad6fd200b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148097 Aug 06 12:54:29.623691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1117/2224] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:29 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:29.833284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:29.833866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:29.840664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:29.841150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:29.841582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:29.842265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:29.842715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:29.843142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:29.912970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:29.921873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:29.923360 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:29.924535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5457c18-bf9f-41ca-9506-01843d4c00b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.095180 Aug 06 12:54:29.925096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1108/2225] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:30.327596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f0c6056a-ce99-4014-b47e-a00d617d5298 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:30.328245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f0c6056a-ce99-4014-b47e-a00d617d5298 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:30.334538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0c6056a-ce99-4014-b47e-a00d617d5298 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:30.335012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0c6056a-ce99-4014-b47e-a00d617d5298 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:30.335438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0c6056a-ce99-4014-b47e-a00d617d5298 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:30.336118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0c6056a-ce99-4014-b47e-a00d617d5298 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:30.336583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0c6056a-ce99-4014-b47e-a00d617d5298 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:30.336999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0c6056a-ce99-4014-b47e-a00d617d5298 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:30.464657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0c6056a-ce99-4014-b47e-a00d617d5298 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:30.472550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f0c6056a-ce99-4014-b47e-a00d617d5298 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149266 Aug 06 12:54:30.473113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1118/2226] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:30 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:30.643740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50f7359b-d71c-458e-b92d-c9194d8157bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:30.644334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50f7359b-d71c-458e-b92d-c9194d8157bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:30.650292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f7359b-d71c-458e-b92d-c9194d8157bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:30.650774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f7359b-d71c-458e-b92d-c9194d8157bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:30.651211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f7359b-d71c-458e-b92d-c9194d8157bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:30.651898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f7359b-d71c-458e-b92d-c9194d8157bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:30.652377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f7359b-d71c-458e-b92d-c9194d8157bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:30.652854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50f7359b-d71c-458e-b92d-c9194d8157bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:30.777479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-50f7359b-d71c-458e-b92d-c9194d8157bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:30.785323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-50f7359b-d71c-458e-b92d-c9194d8157bf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145701 Aug 06 12:54:30.785885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1109/2227] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:30 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:30.946713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:30.947236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:30.953171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:30.953648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:30.954080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:30.954758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:30.955206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:30.955624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:31.016221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:31.024614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:31.026098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:31.027220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1fbf3394-084a-4ea3-9adc-c3276efa52fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084485 Aug 06 12:54:31.027985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1119/2228] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:31.494776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-72040dd3-6e01-46cd-8f11-698be772152b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:31.495410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-72040dd3-6e01-46cd-8f11-698be772152b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:31.502862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72040dd3-6e01-46cd-8f11-698be772152b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:31.503405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72040dd3-6e01-46cd-8f11-698be772152b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:31.503842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72040dd3-6e01-46cd-8f11-698be772152b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:31.504563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72040dd3-6e01-46cd-8f11-698be772152b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:31.505028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72040dd3-6e01-46cd-8f11-698be772152b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:31.505454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72040dd3-6e01-46cd-8f11-698be772152b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:31.638376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-72040dd3-6e01-46cd-8f11-698be772152b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:31.646178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-72040dd3-6e01-46cd-8f11-698be772152b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.155275 Aug 06 12:54:31.646736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1110/2229] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:31 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:31.807649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8054ccbc-f4f1-477c-aaef-ef03b31070cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:31.808250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8054ccbc-f4f1-477c-aaef-ef03b31070cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:31.815175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8054ccbc-f4f1-477c-aaef-ef03b31070cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:31.815649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8054ccbc-f4f1-477c-aaef-ef03b31070cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:31.816074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8054ccbc-f4f1-477c-aaef-ef03b31070cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:31.816944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8054ccbc-f4f1-477c-aaef-ef03b31070cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:31.817467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8054ccbc-f4f1-477c-aaef-ef03b31070cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:31.817884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8054ccbc-f4f1-477c-aaef-ef03b31070cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:31.946195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8054ccbc-f4f1-477c-aaef-ef03b31070cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:31.954181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8054ccbc-f4f1-477c-aaef-ef03b31070cb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150324 Aug 06 12:54:31.954745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1120/2230] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:31 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:32.050093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:32.050707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:32.056616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:32.057099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:32.057535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:32.058286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:32.058674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:32.059099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:32.119338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:32.127734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:32.129268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:32.130406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c8001823-469e-4f07-96b5-164b635568cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084299 Aug 06 12:54:32.130964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1111/2231] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:32.667619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5359f071-e200-47d1-8fba-b55e301dd668 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:32.668252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5359f071-e200-47d1-8fba-b55e301dd668 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:32.674181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5359f071-e200-47d1-8fba-b55e301dd668 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:32.674655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5359f071-e200-47d1-8fba-b55e301dd668 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:32.675081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5359f071-e200-47d1-8fba-b55e301dd668 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:32.675750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5359f071-e200-47d1-8fba-b55e301dd668 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:32.676219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5359f071-e200-47d1-8fba-b55e301dd668 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:32.676670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5359f071-e200-47d1-8fba-b55e301dd668 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:32.692093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:32.807087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5359f071-e200-47d1-8fba-b55e301dd668 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:32.815972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5359f071-e200-47d1-8fba-b55e301dd668 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152071 Aug 06 12:54:32.816579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1121/2232] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:32.975270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4a8e984c-7f33-4db3-ade9-3f48e7addbe2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:32.975899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4a8e984c-7f33-4db3-ade9-3f48e7addbe2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:32.982692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8e984c-7f33-4db3-ade9-3f48e7addbe2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:32.983170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8e984c-7f33-4db3-ade9-3f48e7addbe2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:32.983711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8e984c-7f33-4db3-ade9-3f48e7addbe2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:32.984511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8e984c-7f33-4db3-ade9-3f48e7addbe2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:32.985230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8e984c-7f33-4db3-ade9-3f48e7addbe2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:32.985737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a8e984c-7f33-4db3-ade9-3f48e7addbe2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:33.114975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4a8e984c-7f33-4db3-ade9-3f48e7addbe2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:33.123496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4a8e984c-7f33-4db3-ade9-3f48e7addbe2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152263 Aug 06 12:54:33.124062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1112/2233] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:32 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:33.152636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:33.153237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:33.159092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:33.159564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:33.159995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:33.160698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:33.161148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:33.161569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:33.222409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:33.231189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:33.232654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:33.233776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-008503f1-d779-4eee-9540-9242984845be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085114 Aug 06 12:54:33.234341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1122/2234] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:33.836984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3596c2e4-d04e-4a56-b12c-28b08a0cb46d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:33.837518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3596c2e4-d04e-4a56-b12c-28b08a0cb46d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:33.843438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3596c2e4-d04e-4a56-b12c-28b08a0cb46d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:33.843919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3596c2e4-d04e-4a56-b12c-28b08a0cb46d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:33.844376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3596c2e4-d04e-4a56-b12c-28b08a0cb46d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:33.845059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3596c2e4-d04e-4a56-b12c-28b08a0cb46d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:33.845507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3596c2e4-d04e-4a56-b12c-28b08a0cb46d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:33.845929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3596c2e4-d04e-4a56-b12c-28b08a0cb46d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:33.974046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3596c2e4-d04e-4a56-b12c-28b08a0cb46d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:33.982840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3596c2e4-d04e-4a56-b12c-28b08a0cb46d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149799 Aug 06 12:54:33.983426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1113/2235] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:34.144711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cb076bbd-5bbe-48b1-aa71-96d14ef789e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:34.145254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cb076bbd-5bbe-48b1-aa71-96d14ef789e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:34.151633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb076bbd-5bbe-48b1-aa71-96d14ef789e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:34.152108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb076bbd-5bbe-48b1-aa71-96d14ef789e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:34.153063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb076bbd-5bbe-48b1-aa71-96d14ef789e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:34.153735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb076bbd-5bbe-48b1-aa71-96d14ef789e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:34.154182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb076bbd-5bbe-48b1-aa71-96d14ef789e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:34.154599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb076bbd-5bbe-48b1-aa71-96d14ef789e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:34.256515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:34.257127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:34.263208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:34.263688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:34.264122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:34.264844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:34.265297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:34.265716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:34.329104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:34.338026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:34.339528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:34.341278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e63cdeab-2d7b-4589-8e8d-4efbb930a48d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088740 Aug 06 12:54:34.342068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1114/2236] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:54:34.478688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cb076bbd-5bbe-48b1-aa71-96d14ef789e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:34.487354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cb076bbd-5bbe-48b1-aa71-96d14ef789e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.346578 Aug 06 12:54:34.487913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1123/2237] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:34 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:35.004747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9ec2c93c-72b7-4bb5-9249-088aeaa19864 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:35.005359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9ec2c93c-72b7-4bb5-9249-088aeaa19864 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:35.012487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ec2c93c-72b7-4bb5-9249-088aeaa19864 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:35.012985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ec2c93c-72b7-4bb5-9249-088aeaa19864 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:35.013419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ec2c93c-72b7-4bb5-9249-088aeaa19864 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:35.014103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ec2c93c-72b7-4bb5-9249-088aeaa19864 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:35.014554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ec2c93c-72b7-4bb5-9249-088aeaa19864 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:35.014978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ec2c93c-72b7-4bb5-9249-088aeaa19864 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:35.144990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9ec2c93c-72b7-4bb5-9249-088aeaa19864 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:35.153303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9ec2c93c-72b7-4bb5-9249-088aeaa19864 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152358 Aug 06 12:54:35.153857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1115/2238] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:34 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:35.364364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:35.364902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:35.371175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:35.372202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:35.372655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:35.373327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:35.373773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:35.374188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:35.441903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:35.450247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:35.451743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:35.452891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a35d42c1-06b1-409e-bc23-5f047b0dab0a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.092497 Aug 06 12:54:35.453443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1124/2239] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:35.509309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1dae7dc4-5acc-4f3a-8757-579d5159d7f0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:35.509922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1dae7dc4-5acc-4f3a-8757-579d5159d7f0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:35.515862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dae7dc4-5acc-4f3a-8757-579d5159d7f0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:35.516368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dae7dc4-5acc-4f3a-8757-579d5159d7f0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:35.516803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dae7dc4-5acc-4f3a-8757-579d5159d7f0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:35.517485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dae7dc4-5acc-4f3a-8757-579d5159d7f0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:35.517936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dae7dc4-5acc-4f3a-8757-579d5159d7f0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:35.518357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1dae7dc4-5acc-4f3a-8757-579d5159d7f0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:35.645742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1dae7dc4-5acc-4f3a-8757-579d5159d7f0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:35.654162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1dae7dc4-5acc-4f3a-8757-579d5159d7f0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148683 Aug 06 12:54:35.654718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1116/2240] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:35 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:36.175023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c53911fe-f18e-4c23-bc9a-29db6d487433 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:36.175624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c53911fe-f18e-4c23-bc9a-29db6d487433 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:36.181842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53911fe-f18e-4c23-bc9a-29db6d487433 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:36.182311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53911fe-f18e-4c23-bc9a-29db6d487433 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:36.182734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53911fe-f18e-4c23-bc9a-29db6d487433 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:36.183432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53911fe-f18e-4c23-bc9a-29db6d487433 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:36.183875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53911fe-f18e-4c23-bc9a-29db6d487433 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:36.184288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c53911fe-f18e-4c23-bc9a-29db6d487433 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:36.307100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c53911fe-f18e-4c23-bc9a-29db6d487433 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:36.314808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c53911fe-f18e-4c23-bc9a-29db6d487433 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.143733 Aug 06 12:54:36.315361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1125/2241] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:36 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:36.474586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:36.475185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:36.481557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:36.482031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:36.482456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:36.483128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:36.483578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:36.483992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:36.544083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:36.552217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:36.553730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:36.554856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7eb85b9f-8451-468e-9188-6391d3a3d33a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084234 Aug 06 12:54:36.555407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1117/2242] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:36.674742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d2e61e65-da3e-46ca-9732-ef785c42f01e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:36.675348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d2e61e65-da3e-46ca-9732-ef785c42f01e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:36.681679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2e61e65-da3e-46ca-9732-ef785c42f01e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:36.682158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2e61e65-da3e-46ca-9732-ef785c42f01e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:36.682593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2e61e65-da3e-46ca-9732-ef785c42f01e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:36.683277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2e61e65-da3e-46ca-9732-ef785c42f01e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:36.684234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2e61e65-da3e-46ca-9732-ef785c42f01e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:36.684762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d2e61e65-da3e-46ca-9732-ef785c42f01e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:36.814678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d2e61e65-da3e-46ca-9732-ef785c42f01e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:36.822530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d2e61e65-da3e-46ca-9732-ef785c42f01e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151541 Aug 06 12:54:36.823093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1126/2243] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:36 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:37.336080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0cd750bb-282f-4563-b940-a19e597c464e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:37.336720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0cd750bb-282f-4563-b940-a19e597c464e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:37.345469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cd750bb-282f-4563-b940-a19e597c464e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:37.346281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cd750bb-282f-4563-b940-a19e597c464e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:37.346735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cd750bb-282f-4563-b940-a19e597c464e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:37.348559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cd750bb-282f-4563-b940-a19e597c464e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:37.349462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cd750bb-282f-4563-b940-a19e597c464e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:37.349933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cd750bb-282f-4563-b940-a19e597c464e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:37.489365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0cd750bb-282f-4563-b940-a19e597c464e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:37.497405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0cd750bb-282f-4563-b940-a19e597c464e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.165156 Aug 06 12:54:37.497968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1118/2244] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:37.577537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:37.578128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:37.583960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:37.584479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:37.584913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:37.585580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:37.586021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:37.586435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:37.646000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:37.654824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:37.656327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:37.657446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bd5f8044-c6b6-481e-8d00-2b576cd79a86 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084214 Aug 06 12:54:37.657996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1127/2245] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:54:37.844027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-386a9c1e-1ee1-4a43-91d3-1c178b64b7fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:37.844666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-386a9c1e-1ee1-4a43-91d3-1c178b64b7fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:37.850572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-386a9c1e-1ee1-4a43-91d3-1c178b64b7fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:37.851053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-386a9c1e-1ee1-4a43-91d3-1c178b64b7fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:37.851498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-386a9c1e-1ee1-4a43-91d3-1c178b64b7fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:37.852172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-386a9c1e-1ee1-4a43-91d3-1c178b64b7fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:37.852648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-386a9c1e-1ee1-4a43-91d3-1c178b64b7fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:37.853072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-386a9c1e-1ee1-4a43-91d3-1c178b64b7fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:37.977268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-386a9c1e-1ee1-4a43-91d3-1c178b64b7fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:37.985388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-386a9c1e-1ee1-4a43-91d3-1c178b64b7fe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145790 Aug 06 12:54:37.985954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1119/2246] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:37 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:38.518123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0d8fe124-bf27-4eea-a9a0-b9079e492445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:38.518738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0d8fe124-bf27-4eea-a9a0-b9079e492445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:38.525011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d8fe124-bf27-4eea-a9a0-b9079e492445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:38.525481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d8fe124-bf27-4eea-a9a0-b9079e492445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:38.525906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d8fe124-bf27-4eea-a9a0-b9079e492445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:38.526569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d8fe124-bf27-4eea-a9a0-b9079e492445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:38.527012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d8fe124-bf27-4eea-a9a0-b9079e492445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:38.528034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d8fe124-bf27-4eea-a9a0-b9079e492445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:38.656796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0d8fe124-bf27-4eea-a9a0-b9079e492445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:38.665537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0d8fe124-bf27-4eea-a9a0-b9079e492445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151171 Aug 06 12:54:38.666103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1128/2247] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:38.678984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:38.679595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:38.686520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:38.687000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:38.687452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:38.688132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:38.688612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:38.689038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:38.751273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:38.753450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:38.760917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:38.763160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:38.764317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d7f49632-0486-4357-b621-1bfb7368b5d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089196 Aug 06 12:54:38.764876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1120/2248] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:39.006709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c0a56cd-f44a-4c2d-b7e5-769fe25e5b5c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:39.007308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c0a56cd-f44a-4c2d-b7e5-769fe25e5b5c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:39.013252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0a56cd-f44a-4c2d-b7e5-769fe25e5b5c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:39.013723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0a56cd-f44a-4c2d-b7e5-769fe25e5b5c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:39.014147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0a56cd-f44a-4c2d-b7e5-769fe25e5b5c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:39.014810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0a56cd-f44a-4c2d-b7e5-769fe25e5b5c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:39.015252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0a56cd-f44a-4c2d-b7e5-769fe25e5b5c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:39.015665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c0a56cd-f44a-4c2d-b7e5-769fe25e5b5c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:39.142451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4c0a56cd-f44a-4c2d-b7e5-769fe25e5b5c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:39.150339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c0a56cd-f44a-4c2d-b7e5-769fe25e5b5c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147423 Aug 06 12:54:39.150900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1129/2249] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:39 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:39.694888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b7eb319f-721e-473a-a9ec-5584a426d23b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:39.695493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b7eb319f-721e-473a-a9ec-5584a426d23b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:39.702571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7eb319f-721e-473a-a9ec-5584a426d23b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:39.703045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7eb319f-721e-473a-a9ec-5584a426d23b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:39.703476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7eb319f-721e-473a-a9ec-5584a426d23b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:39.704162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7eb319f-721e-473a-a9ec-5584a426d23b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:39.704634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7eb319f-721e-473a-a9ec-5584a426d23b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:39.705058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7eb319f-721e-473a-a9ec-5584a426d23b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:39.786900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:39.787533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:39.794461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:39.794965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:39.795398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:39.796079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:39.796556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:39.796976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:39.836422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b7eb319f-721e-473a-a9ec-5584a426d23b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:39.849845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b7eb319f-721e-473a-a9ec-5584a426d23b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.158525 Aug 06 12:54:39.850439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1121/2250] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:39 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:39.860375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:39.868776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:39.870256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:39.871940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8d707b9d-e8c9-4f55-9b52-1bd83108ba8e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088672 Aug 06 12:54:39.872513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1130/2251] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:54:40.171895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d2ff4079-6fd2-4410-bfeb-893911810245 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:40.172531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d2ff4079-6fd2-4410-bfeb-893911810245 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:40.178450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2ff4079-6fd2-4410-bfeb-893911810245 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:40.178928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2ff4079-6fd2-4410-bfeb-893911810245 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:40.179359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2ff4079-6fd2-4410-bfeb-893911810245 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:40.180031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2ff4079-6fd2-4410-bfeb-893911810245 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:40.180514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2ff4079-6fd2-4410-bfeb-893911810245 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:40.180937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2ff4079-6fd2-4410-bfeb-893911810245 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:40.306788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d2ff4079-6fd2-4410-bfeb-893911810245 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:40.314635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d2ff4079-6fd2-4410-bfeb-893911810245 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147244 Aug 06 12:54:40.315191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1122/2252] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:40 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:40.872209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dbc8bbaf-33d8-4273-b10f-1ad5df8725e1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:40.872872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dbc8bbaf-33d8-4273-b10f-1ad5df8725e1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:40.879186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbc8bbaf-33d8-4273-b10f-1ad5df8725e1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:40.879661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbc8bbaf-33d8-4273-b10f-1ad5df8725e1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:40.880092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbc8bbaf-33d8-4273-b10f-1ad5df8725e1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:40.880797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbc8bbaf-33d8-4273-b10f-1ad5df8725e1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:40.881243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbc8bbaf-33d8-4273-b10f-1ad5df8725e1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:40.881663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbc8bbaf-33d8-4273-b10f-1ad5df8725e1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:40.894014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:40.894621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:40.901055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:40.901533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:40.901966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:40.902653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:40.903105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:40.903524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:40.965891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:40.974518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:40.976017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:40.977172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3be9b02a-9bc0-48d5-8e4f-accdb255d1a4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087077 Aug 06 12:54:40.977733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1123/2253] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:54:41.014142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dbc8bbaf-33d8-4273-b10f-1ad5df8725e1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:41.022115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dbc8bbaf-33d8-4273-b10f-1ad5df8725e1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.154296 Aug 06 12:54:41.022681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1131/2254] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:40 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:41.335613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-217e554d-55b8-4311-a558-066da7177231 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:41.336226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-217e554d-55b8-4311-a558-066da7177231 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:41.342175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-217e554d-55b8-4311-a558-066da7177231 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:41.342658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-217e554d-55b8-4311-a558-066da7177231 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:41.343097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-217e554d-55b8-4311-a558-066da7177231 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:41.343780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-217e554d-55b8-4311-a558-066da7177231 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:41.344233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-217e554d-55b8-4311-a558-066da7177231 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:41.344686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-217e554d-55b8-4311-a558-066da7177231 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:41.471371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-217e554d-55b8-4311-a558-066da7177231 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:41.479207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-217e554d-55b8-4311-a558-066da7177231 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147446 Aug 06 12:54:41.479775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1124/2255] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:41 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:41.999198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:41.999654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:42.005993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:42.006467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:42.006896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:42.007570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:42.008018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:42.008462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:42.042916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eb5b05cf-05b7-4c5a-bb33-35a66750d8fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:42.043680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eb5b05cf-05b7-4c5a-bb33-35a66750d8fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:42.050328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5b05cf-05b7-4c5a-bb33-35a66750d8fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:42.050809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5b05cf-05b7-4c5a-bb33-35a66750d8fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:42.051242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5b05cf-05b7-4c5a-bb33-35a66750d8fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:42.051930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5b05cf-05b7-4c5a-bb33-35a66750d8fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:42.052400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5b05cf-05b7-4c5a-bb33-35a66750d8fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:42.052823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb5b05cf-05b7-4c5a-bb33-35a66750d8fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:42.070162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:42.078862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:42.080367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:42.081488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5766e6e5-dfad-4a97-9929-9b835eccfd39 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086396 Aug 06 12:54:42.082693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1132/2256] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:42.183557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eb5b05cf-05b7-4c5a-bb33-35a66750d8fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:42.191434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eb5b05cf-05b7-4c5a-bb33-35a66750d8fb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152395 Aug 06 12:54:42.191993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1125/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:42 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:42.500459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cde33770-25fa-4ad1-91ff-902c82fb6e97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:42.501061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cde33770-25fa-4ad1-91ff-902c82fb6e97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:42.506790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cde33770-25fa-4ad1-91ff-902c82fb6e97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:42.507310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cde33770-25fa-4ad1-91ff-902c82fb6e97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:42.507734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cde33770-25fa-4ad1-91ff-902c82fb6e97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:42.508424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cde33770-25fa-4ad1-91ff-902c82fb6e97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:42.508869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cde33770-25fa-4ad1-91ff-902c82fb6e97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:42.509283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cde33770-25fa-4ad1-91ff-902c82fb6e97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:42.634148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cde33770-25fa-4ad1-91ff-902c82fb6e97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:42.642530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cde33770-25fa-4ad1-91ff-902c82fb6e97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146330 Aug 06 12:54:42.643084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1133/2258] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:42 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:43.105054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:43.105686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:43.112904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:43.113376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:43.113801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:43.114474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:43.114918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:43.115342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:43.174771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:43.182973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:43.184479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:43.185602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1704209a-2782-49ed-8e85-ea23c7c6e305 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084596 Aug 06 12:54:43.186153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1126/2259] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:43.212684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-76a8a83e-575a-4781-99f4-666a9adbb1b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:43.213293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-76a8a83e-575a-4781-99f4-666a9adbb1b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:43.220129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76a8a83e-575a-4781-99f4-666a9adbb1b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:43.220642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76a8a83e-575a-4781-99f4-666a9adbb1b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:43.221067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76a8a83e-575a-4781-99f4-666a9adbb1b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:43.221753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76a8a83e-575a-4781-99f4-666a9adbb1b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:43.222200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76a8a83e-575a-4781-99f4-666a9adbb1b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:43.222616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76a8a83e-575a-4781-99f4-666a9adbb1b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:43.352473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-76a8a83e-575a-4781-99f4-666a9adbb1b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:43.361213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-76a8a83e-575a-4781-99f4-666a9adbb1b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152351 Aug 06 12:54:43.361772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1134/2260] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:43.663415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eafaf1f7-5196-4475-84de-96fc19fc1f97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:43.663939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eafaf1f7-5196-4475-84de-96fc19fc1f97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:43.669747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eafaf1f7-5196-4475-84de-96fc19fc1f97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:43.670221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eafaf1f7-5196-4475-84de-96fc19fc1f97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:43.670648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eafaf1f7-5196-4475-84de-96fc19fc1f97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:43.671318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eafaf1f7-5196-4475-84de-96fc19fc1f97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:43.671761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eafaf1f7-5196-4475-84de-96fc19fc1f97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:43.672178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eafaf1f7-5196-4475-84de-96fc19fc1f97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:43.798803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eafaf1f7-5196-4475-84de-96fc19fc1f97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:43.806610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eafaf1f7-5196-4475-84de-96fc19fc1f97 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147119 Aug 06 12:54:43.807165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1127/2261] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:43 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:44.207047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:44.207639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:44.213509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:44.214094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:44.214414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:44.215078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:44.215572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:44.215990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:44.277939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:44.286328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:44.287809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:44.288954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bec7a41e-7092-400f-b770-520c06cc13b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085756 Aug 06 12:54:44.289496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1135/2262] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:44.382021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16b0ceed-1b58-4089-9875-1bbabbb0cb85 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:44.382620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16b0ceed-1b58-4089-9875-1bbabbb0cb85 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:44.388963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16b0ceed-1b58-4089-9875-1bbabbb0cb85 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:44.389436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16b0ceed-1b58-4089-9875-1bbabbb0cb85 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:44.389862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16b0ceed-1b58-4089-9875-1bbabbb0cb85 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:44.390534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16b0ceed-1b58-4089-9875-1bbabbb0cb85 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:44.390978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16b0ceed-1b58-4089-9875-1bbabbb0cb85 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:44.391390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16b0ceed-1b58-4089-9875-1bbabbb0cb85 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:44.516723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16b0ceed-1b58-4089-9875-1bbabbb0cb85 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:44.524669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16b0ceed-1b58-4089-9875-1bbabbb0cb85 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146367 Aug 06 12:54:44.525233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1128/2263] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:44.827136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-feee83a6-f21c-4a37-810c-5ab384e5f8c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:44.827738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-feee83a6-f21c-4a37-810c-5ab384e5f8c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:44.833626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-feee83a6-f21c-4a37-810c-5ab384e5f8c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:44.834108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-feee83a6-f21c-4a37-810c-5ab384e5f8c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:44.834544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-feee83a6-f21c-4a37-810c-5ab384e5f8c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:44.835233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-feee83a6-f21c-4a37-810c-5ab384e5f8c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:44.835689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-feee83a6-f21c-4a37-810c-5ab384e5f8c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:44.836113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-feee83a6-f21c-4a37-810c-5ab384e5f8c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:44.963974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-feee83a6-f21c-4a37-810c-5ab384e5f8c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:44.972612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-feee83a6-f21c-4a37-810c-5ab384e5f8c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149143 Aug 06 12:54:44.973178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1136/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:44 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:45.311960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:45.312584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:45.318557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:45.319036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:45.319468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:45.320148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:45.320623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:45.321043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:45.380643 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:45.390216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:45.391736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:45.392893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e181e8c5-2521-4517-85ba-bff8d4f89041 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085378 Aug 06 12:54:45.393451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1129/2265] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:45.545896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d765d346-abd7-47c9-84eb-07826bac374f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:45.546495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d765d346-abd7-47c9-84eb-07826bac374f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:45.552410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d765d346-abd7-47c9-84eb-07826bac374f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:45.552883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d765d346-abd7-47c9-84eb-07826bac374f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:45.553308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d765d346-abd7-47c9-84eb-07826bac374f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:45.553977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d765d346-abd7-47c9-84eb-07826bac374f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:45.554420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d765d346-abd7-47c9-84eb-07826bac374f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:45.554834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d765d346-abd7-47c9-84eb-07826bac374f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:45.682158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d765d346-abd7-47c9-84eb-07826bac374f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:45.690420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d765d346-abd7-47c9-84eb-07826bac374f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148479 Aug 06 12:54:45.690971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1137/2266] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:45.994123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e115205-945b-4725-b61d-140393cdd622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:45.994653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1e115205-945b-4725-b61d-140393cdd622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:46.001469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e115205-945b-4725-b61d-140393cdd622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:46.001952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e115205-945b-4725-b61d-140393cdd622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:46.002383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e115205-945b-4725-b61d-140393cdd622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:46.003065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e115205-945b-4725-b61d-140393cdd622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:46.003516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e115205-945b-4725-b61d-140393cdd622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:46.004057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e115205-945b-4725-b61d-140393cdd622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:46.131280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1e115205-945b-4725-b61d-140393cdd622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:46.139252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1e115205-945b-4725-b61d-140393cdd622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149173 Aug 06 12:54:46.139821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1130/2267] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:45 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:46.414963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:46.415549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:46.422109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:46.422579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:46.423003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:46.423667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:46.424109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:46.424549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:46.427007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:46.485944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:46.494267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:46.495749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:46.496939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b5553e2f-1c6a-4439-ba6b-f08bab2bf326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085769 Aug 06 12:54:46.497488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1138/2268] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:46.711884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-63e2783c-213b-4a27-a4a4-d600b5c0e41a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:46.712440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-63e2783c-213b-4a27-a4a4-d600b5c0e41a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:46.719448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63e2783c-213b-4a27-a4a4-d600b5c0e41a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:46.719919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63e2783c-213b-4a27-a4a4-d600b5c0e41a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:46.720371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63e2783c-213b-4a27-a4a4-d600b5c0e41a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:46.721049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63e2783c-213b-4a27-a4a4-d600b5c0e41a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:46.721498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63e2783c-213b-4a27-a4a4-d600b5c0e41a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:46.721928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63e2783c-213b-4a27-a4a4-d600b5c0e41a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:46.846010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-63e2783c-213b-4a27-a4a4-d600b5c0e41a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:46.853738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-63e2783c-213b-4a27-a4a4-d600b5c0e41a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145773 Aug 06 12:54:46.854292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1131/2269] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:47.160451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3788a290-5556-4e89-861a-dfb1c6c8ef86 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:47.161049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3788a290-5556-4e89-861a-dfb1c6c8ef86 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:47.167284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3788a290-5556-4e89-861a-dfb1c6c8ef86 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:47.168029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3788a290-5556-4e89-861a-dfb1c6c8ef86 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:47.168693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3788a290-5556-4e89-861a-dfb1c6c8ef86 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:47.169364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3788a290-5556-4e89-861a-dfb1c6c8ef86 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:47.169808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3788a290-5556-4e89-861a-dfb1c6c8ef86 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:47.170223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3788a290-5556-4e89-861a-dfb1c6c8ef86 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:47.298416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3788a290-5556-4e89-861a-dfb1c6c8ef86 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:47.306206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3788a290-5556-4e89-861a-dfb1c6c8ef86 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149615 Aug 06 12:54:47.306767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1139/2270] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:47 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:47.518862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:47.519719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:47.525986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:47.526455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:47.526880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:47.527557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:47.528004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:47.528448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:47.591290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:47.599589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:47.601101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:47.602245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3dd1a0ca-1636-4903-974f-39f199815e77 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087220 Aug 06 12:54:47.602792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1132/2271] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:47.874816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b0293feb-f6b7-4b0a-9691-063a1b1865a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:47.875326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b0293feb-f6b7-4b0a-9691-063a1b1865a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:47.881225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b0293feb-f6b7-4b0a-9691-063a1b1865a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:47.881692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b0293feb-f6b7-4b0a-9691-063a1b1865a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:47.882118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b0293feb-f6b7-4b0a-9691-063a1b1865a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:47.882779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b0293feb-f6b7-4b0a-9691-063a1b1865a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:47.883224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b0293feb-f6b7-4b0a-9691-063a1b1865a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:47.883637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b0293feb-f6b7-4b0a-9691-063a1b1865a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:48.013186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b0293feb-f6b7-4b0a-9691-063a1b1865a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:48.021100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b0293feb-f6b7-4b0a-9691-063a1b1865a7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150163 Aug 06 12:54:48.021647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1140/2272] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:48.327592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5aa4eeb5-e1e2-4ac5-bcd1-22c2063190cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:48.328199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5aa4eeb5-e1e2-4ac5-bcd1-22c2063190cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:48.334685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa4eeb5-e1e2-4ac5-bcd1-22c2063190cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:48.335166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa4eeb5-e1e2-4ac5-bcd1-22c2063190cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:48.335599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa4eeb5-e1e2-4ac5-bcd1-22c2063190cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:48.336282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa4eeb5-e1e2-4ac5-bcd1-22c2063190cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:48.336762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa4eeb5-e1e2-4ac5-bcd1-22c2063190cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:48.337187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa4eeb5-e1e2-4ac5-bcd1-22c2063190cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:48.462133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5aa4eeb5-e1e2-4ac5-bcd1-22c2063190cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:48.469988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5aa4eeb5-e1e2-4ac5-bcd1-22c2063190cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146893 Aug 06 12:54:48.470545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1133/2273] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:48 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:48.625571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:48.626083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:48.632287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:48.632786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:48.633212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:48.633881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:48.634322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:48.634741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:48.694276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:48.703981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:48.705928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:48.707042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9dfcef44-51fc-4930-b12f-e30561f949ac tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085897 Aug 06 12:54:48.707604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1141/2274] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:49.042579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2b17b822-aa18-4886-85dd-3add903870cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:49.043191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2b17b822-aa18-4886-85dd-3add903870cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:49.049758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b17b822-aa18-4886-85dd-3add903870cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:49.050237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b17b822-aa18-4886-85dd-3add903870cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:49.050671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b17b822-aa18-4886-85dd-3add903870cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:49.051352 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b17b822-aa18-4886-85dd-3add903870cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:49.051804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b17b822-aa18-4886-85dd-3add903870cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:49.052225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b17b822-aa18-4886-85dd-3add903870cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:49.177734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2b17b822-aa18-4886-85dd-3add903870cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:49.186518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2b17b822-aa18-4886-85dd-3add903870cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147786 Aug 06 12:54:49.187076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1134/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:49.491332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3bc861a4-5c9f-4f7f-96b5-cbfb708411c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:49.491860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3bc861a4-5c9f-4f7f-96b5-cbfb708411c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:49.497753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bc861a4-5c9f-4f7f-96b5-cbfb708411c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:49.498256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bc861a4-5c9f-4f7f-96b5-cbfb708411c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:49.498684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bc861a4-5c9f-4f7f-96b5-cbfb708411c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:49.499356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bc861a4-5c9f-4f7f-96b5-cbfb708411c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:49.499799 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bc861a4-5c9f-4f7f-96b5-cbfb708411c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:49.500216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bc861a4-5c9f-4f7f-96b5-cbfb708411c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:49.624207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3bc861a4-5c9f-4f7f-96b5-cbfb708411c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:49.632525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3bc861a4-5c9f-4f7f-96b5-cbfb708411c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145034 Aug 06 12:54:49.633141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1142/2276] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:49 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:49.729311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:49.729917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:49.736512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:49.736990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:49.737421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:49.738105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:49.738557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:49.738976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:49.801556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:49.810021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:49.812058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:49.813217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-05e0126b-412d-4fc6-879c-b81c88d2ae33 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087888 Aug 06 12:54:49.813765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1135/2277] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:50.207627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d83c849-cc54-4d0d-9707-fe44474d2dd0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:50.208140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9d83c849-cc54-4d0d-9707-fe44474d2dd0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:50.213997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d83c849-cc54-4d0d-9707-fe44474d2dd0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:50.214462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d83c849-cc54-4d0d-9707-fe44474d2dd0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:50.214884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d83c849-cc54-4d0d-9707-fe44474d2dd0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:50.215556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d83c849-cc54-4d0d-9707-fe44474d2dd0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:50.215996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d83c849-cc54-4d0d-9707-fe44474d2dd0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:50.216436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d83c849-cc54-4d0d-9707-fe44474d2dd0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:50.345928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9d83c849-cc54-4d0d-9707-fe44474d2dd0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:50.353706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d83c849-cc54-4d0d-9707-fe44474d2dd0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149939 Aug 06 12:54:50.354262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1143/2278] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:50 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:50.654002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d65b9d0b-8d05-4321-8000-1973831e464d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:50.655105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d65b9d0b-8d05-4321-8000-1973831e464d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:50.660994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d65b9d0b-8d05-4321-8000-1973831e464d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:50.661482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d65b9d0b-8d05-4321-8000-1973831e464d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:50.661922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d65b9d0b-8d05-4321-8000-1973831e464d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:50.662607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d65b9d0b-8d05-4321-8000-1973831e464d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:50.663446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d65b9d0b-8d05-4321-8000-1973831e464d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:50.663591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d65b9d0b-8d05-4321-8000-1973831e464d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:50.794295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d65b9d0b-8d05-4321-8000-1973831e464d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:50.802573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d65b9d0b-8d05-4321-8000-1973831e464d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152481 Aug 06 12:54:50.803125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1136/2279] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:50 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:50.834885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:50.835520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:50.842284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:50.842763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:50.843191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:50.843866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:50.844332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:50.844763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:50.906584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:50.914831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:50.916336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:50.917465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-21d22e16-692a-4530-be21-c212f83718d2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086510 Aug 06 12:54:50.918014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1144/2280] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:51.376513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8848a3a9-6a60-4f47-a2ae-531dd0492d50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:51.377116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8848a3a9-6a60-4f47-a2ae-531dd0492d50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:51.383255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8848a3a9-6a60-4f47-a2ae-531dd0492d50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:51.383727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8848a3a9-6a60-4f47-a2ae-531dd0492d50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:51.384157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8848a3a9-6a60-4f47-a2ae-531dd0492d50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:51.385062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8848a3a9-6a60-4f47-a2ae-531dd0492d50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:51.385527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8848a3a9-6a60-4f47-a2ae-531dd0492d50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:51.386100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8848a3a9-6a60-4f47-a2ae-531dd0492d50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:51.403387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:51.515989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8848a3a9-6a60-4f47-a2ae-531dd0492d50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:51.523926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8848a3a9-6a60-4f47-a2ae-531dd0492d50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152751 Aug 06 12:54:51.524515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1137/2281] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:51.823256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e38a9638-a949-438c-af5d-6dc7453f95b5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:51.823892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e38a9638-a949-438c-af5d-6dc7453f95b5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:51.829822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e38a9638-a949-438c-af5d-6dc7453f95b5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:51.830305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e38a9638-a949-438c-af5d-6dc7453f95b5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:51.830739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e38a9638-a949-438c-af5d-6dc7453f95b5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:51.831420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e38a9638-a949-438c-af5d-6dc7453f95b5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:51.831869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e38a9638-a949-438c-af5d-6dc7453f95b5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:51.832292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e38a9638-a949-438c-af5d-6dc7453f95b5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:51.941342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:51.941945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:51.948706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:51.949183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:51.949636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:51.950336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:51.950783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:51.951202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:52.018095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:52.026779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:52.028425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:52.030227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-23a164fb-483c-4556-83c7-2bbc3642c935 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.092850 Aug 06 12:54:52.030819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1138/2282] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:54:52.110594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e38a9638-a949-438c-af5d-6dc7453f95b5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:52.118450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e38a9638-a949-438c-af5d-6dc7453f95b5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.299069 Aug 06 12:54:52.119004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1145/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:51 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:52.544679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5ad8b674-5a83-4371-9744-2175e661c2fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:52.545494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5ad8b674-5a83-4371-9744-2175e661c2fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:52.551305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad8b674-5a83-4371-9744-2175e661c2fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:52.551778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad8b674-5a83-4371-9744-2175e661c2fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:52.552204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad8b674-5a83-4371-9744-2175e661c2fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:52.552900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad8b674-5a83-4371-9744-2175e661c2fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:52.553346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad8b674-5a83-4371-9744-2175e661c2fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:52.553761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad8b674-5a83-4371-9744-2175e661c2fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:52.683316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5ad8b674-5a83-4371-9744-2175e661c2fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:52.691826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5ad8b674-5a83-4371-9744-2175e661c2fe tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150908 Aug 06 12:54:52.692405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1139/2284] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:52 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:53.055027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:53.055984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:53.065694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:53.066413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:53.067109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:53.068146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:53.068947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:53.069590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:53.131812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:53.139531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-57b73dbf-4378-4960-9a3c-6a83281298c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:53.140224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-57b73dbf-4378-4960-9a3c-6a83281298c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:53.142946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:53.144521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:53.145654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d814360b-2ee9-4981-9258-b955185efcb5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.096238 Aug 06 12:54:53.146198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1146/2285] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:54:53.146723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b73dbf-4378-4960-9a3c-6a83281298c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:53.147201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b73dbf-4378-4960-9a3c-6a83281298c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:53.147629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b73dbf-4378-4960-9a3c-6a83281298c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:53.148326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b73dbf-4378-4960-9a3c-6a83281298c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:53.148776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b73dbf-4378-4960-9a3c-6a83281298c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:53.149195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b73dbf-4378-4960-9a3c-6a83281298c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:53.275247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57b73dbf-4378-4960-9a3c-6a83281298c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:53.283146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-57b73dbf-4378-4960-9a3c-6a83281298c7 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148068 Aug 06 12:54:53.283733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1140/2286] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:53 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:54:53.713270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-315fa45a-4844-487a-ab63-c2eac47d812a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:53.713864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-315fa45a-4844-487a-ab63-c2eac47d812a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:53.720186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-315fa45a-4844-487a-ab63-c2eac47d812a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:53.720692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-315fa45a-4844-487a-ab63-c2eac47d812a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:53.721118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-315fa45a-4844-487a-ab63-c2eac47d812a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:53.721787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-315fa45a-4844-487a-ab63-c2eac47d812a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:53.722227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-315fa45a-4844-487a-ab63-c2eac47d812a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:53.722640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-315fa45a-4844-487a-ab63-c2eac47d812a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:53.847537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-315fa45a-4844-487a-ab63-c2eac47d812a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:53.855400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-315fa45a-4844-487a-ab63-c2eac47d812a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145959 Aug 06 12:54:53.855955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1147/2287] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:53 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:54.167895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:54.168530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:54.174891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:54.175371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:54.175804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:54.176519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:54.176969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:54.177390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:54.240196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:54.248560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:54.250049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:54.251178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f110725f-daec-419a-998a-4d6ebe308f61 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087177 Aug 06 12:54:54.251728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1141/2288] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:54.305846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a3a1b173-7614-48ca-827b-e79b55c3c3b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:54.306493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a3a1b173-7614-48ca-827b-e79b55c3c3b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:54.313261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3a1b173-7614-48ca-827b-e79b55c3c3b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:54.313734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3a1b173-7614-48ca-827b-e79b55c3c3b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:54.314159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3a1b173-7614-48ca-827b-e79b55c3c3b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:54.314833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3a1b173-7614-48ca-827b-e79b55c3c3b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:54.315274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3a1b173-7614-48ca-827b-e79b55c3c3b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:54.315689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3a1b173-7614-48ca-827b-e79b55c3c3b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:54.443337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a3a1b173-7614-48ca-827b-e79b55c3c3b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:54.451891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a3a1b173-7614-48ca-827b-e79b55c3c3b8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149537 Aug 06 12:54:54.452468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1148/2289] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:54 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:54.878878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f5d84966-f2e2-4eb2-8cd4-2a7d2cd9a396 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:54.879484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f5d84966-f2e2-4eb2-8cd4-2a7d2cd9a396 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:54.885395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d84966-f2e2-4eb2-8cd4-2a7d2cd9a396 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:54.885876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d84966-f2e2-4eb2-8cd4-2a7d2cd9a396 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:54.886310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d84966-f2e2-4eb2-8cd4-2a7d2cd9a396 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:54.886988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d84966-f2e2-4eb2-8cd4-2a7d2cd9a396 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:54.887441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d84966-f2e2-4eb2-8cd4-2a7d2cd9a396 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:54.887864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d84966-f2e2-4eb2-8cd4-2a7d2cd9a396 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:55.012449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f5d84966-f2e2-4eb2-8cd4-2a7d2cd9a396 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:55.020337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f5d84966-f2e2-4eb2-8cd4-2a7d2cd9a396 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145308 Aug 06 12:54:55.020907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1142/2290] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:54 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:55.273622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:55.274221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:55.280592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:55.281066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:55.281492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:55.282166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:55.282616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:55.283035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:55.343954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:55.352239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:55.353756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:55.354881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-496a527e-92e3-4e9f-945f-aa20fd6b45bb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085175 Aug 06 12:54:55.355425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1149/2291] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:55.473453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b93fcb31-2585-46da-bec4-52e231edb4dd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:55.473995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b93fcb31-2585-46da-bec4-52e231edb4dd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:55.476459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=82 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:55.481661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b93fcb31-2585-46da-bec4-52e231edb4dd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:55.482140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b93fcb31-2585-46da-bec4-52e231edb4dd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:55.482568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b93fcb31-2585-46da-bec4-52e231edb4dd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:55.483248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b93fcb31-2585-46da-bec4-52e231edb4dd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:55.483694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b93fcb31-2585-46da-bec4-52e231edb4dd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:55.484114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b93fcb31-2585-46da-bec4-52e231edb4dd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:55.608091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b93fcb31-2585-46da-bec4-52e231edb4dd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:55.616197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b93fcb31-2585-46da-bec4-52e231edb4dd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146650 Aug 06 12:54:55.616786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1143/2292] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:55 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:56.041743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-72660d77-9255-463f-9a5d-08d36e8e3b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:56.042384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-72660d77-9255-463f-9a5d-08d36e8e3b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:56.048636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72660d77-9255-463f-9a5d-08d36e8e3b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:56.049123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72660d77-9255-463f-9a5d-08d36e8e3b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:56.049558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72660d77-9255-463f-9a5d-08d36e8e3b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:56.050242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72660d77-9255-463f-9a5d-08d36e8e3b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:56.050693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72660d77-9255-463f-9a5d-08d36e8e3b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:56.051117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72660d77-9255-463f-9a5d-08d36e8e3b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:56.182634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-72660d77-9255-463f-9a5d-08d36e8e3b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:56.191037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-72660d77-9255-463f-9a5d-08d36e8e3b4b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153168 Aug 06 12:54:56.191582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1150/2293] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:56.378770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:56.379373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:56.385302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:56.385781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:56.386214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:56.386901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:56.387350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:56.387772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:56.449885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:56.458129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:56.459609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:56.460761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bfc046c4-bbea-4d2a-a529-e4283f6c6de8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085920 Aug 06 12:54:56.461310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1144/2294] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:56 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:56.637205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b638d008-a4dd-472d-8cef-01bfd5d23df3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:56.637744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b638d008-a4dd-472d-8cef-01bfd5d23df3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:56.640096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=76 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:56.645310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b638d008-a4dd-472d-8cef-01bfd5d23df3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:56.645784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b638d008-a4dd-472d-8cef-01bfd5d23df3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:56.646215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b638d008-a4dd-472d-8cef-01bfd5d23df3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:56.646998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b638d008-a4dd-472d-8cef-01bfd5d23df3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:56.647448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b638d008-a4dd-472d-8cef-01bfd5d23df3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:56.647863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b638d008-a4dd-472d-8cef-01bfd5d23df3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:56.774720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b638d008-a4dd-472d-8cef-01bfd5d23df3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:56.783145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b638d008-a4dd-472d-8cef-01bfd5d23df3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149811 Aug 06 12:54:56.783702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1151/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:56 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:57.211007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff1b390a-be05-4abf-a77f-f262b91ede8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:57.211616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ff1b390a-be05-4abf-a77f-f262b91ede8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:57.218681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff1b390a-be05-4abf-a77f-f262b91ede8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:57.219162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff1b390a-be05-4abf-a77f-f262b91ede8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:57.219594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff1b390a-be05-4abf-a77f-f262b91ede8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:57.220274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff1b390a-be05-4abf-a77f-f262b91ede8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:57.220750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff1b390a-be05-4abf-a77f-f262b91ede8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:57.221173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff1b390a-be05-4abf-a77f-f262b91ede8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:57.351208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ff1b390a-be05-4abf-a77f-f262b91ede8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:57.359181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff1b390a-be05-4abf-a77f-f262b91ede8f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152024 Aug 06 12:54:57.360013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1145/2296] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:57 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:57.482773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:57.483373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:57.489630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:57.490105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:57.490538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:57.491216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:57.491670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:57.492087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:57.552153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:57.560964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:57.562462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:57.563593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d0d40632-f28a-4b12-b1e4-798d8d0c391f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084733 Aug 06 12:54:57.564145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1152/2297] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:57.805349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d16152e5-9cf6-4c4b-9094-11b002082bef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:57.805888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d16152e5-9cf6-4c4b-9094-11b002082bef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:57.812457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d16152e5-9cf6-4c4b-9094-11b002082bef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:57.812939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d16152e5-9cf6-4c4b-9094-11b002082bef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:57.813370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d16152e5-9cf6-4c4b-9094-11b002082bef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:57.814053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d16152e5-9cf6-4c4b-9094-11b002082bef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:57.814517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d16152e5-9cf6-4c4b-9094-11b002082bef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:57.814932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d16152e5-9cf6-4c4b-9094-11b002082bef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:57.940423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d16152e5-9cf6-4c4b-9094-11b002082bef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:57.948357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d16152e5-9cf6-4c4b-9094-11b002082bef tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146887 Aug 06 12:54:57.948920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1146/2298] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:57 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:58.380494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cf2f6e57-c0dd-4569-9bc7-7bd899ba215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:58.381079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cf2f6e57-c0dd-4569-9bc7-7bd899ba215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:58.387616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf2f6e57-c0dd-4569-9bc7-7bd899ba215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:58.388094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf2f6e57-c0dd-4569-9bc7-7bd899ba215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:58.388550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf2f6e57-c0dd-4569-9bc7-7bd899ba215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:58.389259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf2f6e57-c0dd-4569-9bc7-7bd899ba215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:58.389706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf2f6e57-c0dd-4569-9bc7-7bd899ba215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:58.390123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cf2f6e57-c0dd-4569-9bc7-7bd899ba215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:58.515335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cf2f6e57-c0dd-4569-9bc7-7bd899ba215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:58.523230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cf2f6e57-c0dd-4569-9bc7-7bd899ba215d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146599 Aug 06 12:54:58.523783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1153/2299] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:58.586195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:58.586790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:58.593719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:58.594192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:58.594617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:58.595285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:58.595729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:58.596145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:58.667866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:58.676540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:58.678016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:58.679143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-02132120-f099-4b38-bb8a-963ba49795be tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.096817 Aug 06 12:54:58.679694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1147/2300] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:54:58.969237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1f1dec2e-2ec4-4f9c-af1d-c51340aec134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:58.969752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f1dec2e-2ec4-4f9c-af1d-c51340aec134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:58.975598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f1dec2e-2ec4-4f9c-af1d-c51340aec134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:58.976066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f1dec2e-2ec4-4f9c-af1d-c51340aec134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:58.976533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f1dec2e-2ec4-4f9c-af1d-c51340aec134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:58.977205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f1dec2e-2ec4-4f9c-af1d-c51340aec134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:58.977644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f1dec2e-2ec4-4f9c-af1d-c51340aec134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:58.978056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f1dec2e-2ec4-4f9c-af1d-c51340aec134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:59.106033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1f1dec2e-2ec4-4f9c-af1d-c51340aec134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:59.108221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:54:59.115279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1f1dec2e-2ec4-4f9c-af1d-c51340aec134 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149952 Aug 06 12:54:59.115837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1154/2301] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:58 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:59.545425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-926fa4b9-2fa5-4dcf-9fb4-6161cbf3866a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:59.546029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-926fa4b9-2fa5-4dcf-9fb4-6161cbf3866a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:59.551945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926fa4b9-2fa5-4dcf-9fb4-6161cbf3866a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:59.552452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926fa4b9-2fa5-4dcf-9fb4-6161cbf3866a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:59.552888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926fa4b9-2fa5-4dcf-9fb4-6161cbf3866a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:59.553569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926fa4b9-2fa5-4dcf-9fb4-6161cbf3866a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:59.554017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926fa4b9-2fa5-4dcf-9fb4-6161cbf3866a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:59.554438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-926fa4b9-2fa5-4dcf-9fb4-6161cbf3866a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:59.678509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-926fa4b9-2fa5-4dcf-9fb4-6161cbf3866a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:59.686326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-926fa4b9-2fa5-4dcf-9fb4-6161cbf3866a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145292 Aug 06 12:54:59.686886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1148/2302] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:54:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:54:59.700642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:54:59.701311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:54:59.707476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:59.707950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:59.708409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:59.709079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:54:59.709523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:54:59.709933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:54:59.770151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:59.778297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:59.780262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:54:59.781398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0d3703b8-7bf4-47e4-91b9-d17d82b2c8e9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084812 Aug 06 12:54:59.781940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1155/2303] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:54:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:00.136537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c6cd9f7a-82c0-4141-8ac8-ce72a204636f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:00.137146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c6cd9f7a-82c0-4141-8ac8-ce72a204636f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:00.143534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6cd9f7a-82c0-4141-8ac8-ce72a204636f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:00.144014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6cd9f7a-82c0-4141-8ac8-ce72a204636f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:00.144480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6cd9f7a-82c0-4141-8ac8-ce72a204636f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:00.145161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6cd9f7a-82c0-4141-8ac8-ce72a204636f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:00.145614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6cd9f7a-82c0-4141-8ac8-ce72a204636f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:00.146038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6cd9f7a-82c0-4141-8ac8-ce72a204636f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:00.271138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c6cd9f7a-82c0-4141-8ac8-ce72a204636f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:00.279647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c6cd9f7a-82c0-4141-8ac8-ce72a204636f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146354 Aug 06 12:55:00.280203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1149/2304] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:00 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:00.706788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9b19e65f-1c4c-4773-8be4-813fe26dbb77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:00.707388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9b19e65f-1c4c-4773-8be4-813fe26dbb77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:00.713665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b19e65f-1c4c-4773-8be4-813fe26dbb77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:00.714137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b19e65f-1c4c-4773-8be4-813fe26dbb77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:00.714563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b19e65f-1c4c-4773-8be4-813fe26dbb77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:00.715233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b19e65f-1c4c-4773-8be4-813fe26dbb77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:00.715679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b19e65f-1c4c-4773-8be4-813fe26dbb77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:00.716092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b19e65f-1c4c-4773-8be4-813fe26dbb77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:00.804218 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:00.804846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:00.811664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:00.812562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:00.812813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:00.813279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:00.813728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:00.814141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:00.841096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9b19e65f-1c4c-4773-8be4-813fe26dbb77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:00.849366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9b19e65f-1c4c-4773-8be4-813fe26dbb77 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146380 Aug 06 12:55:00.850156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1156/2305] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:00 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:00.877597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:00.885787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:00.887262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:00.888466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-20b352e3-25fe-4b30-8bac-baec679c8eae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087999 Aug 06 12:55:00.888956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1150/2306] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:01.302687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-374061d6-fb40-4ac3-9258-308d7688aa4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:01.303285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-374061d6-fb40-4ac3-9258-308d7688aa4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:01.309262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-374061d6-fb40-4ac3-9258-308d7688aa4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:01.309734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-374061d6-fb40-4ac3-9258-308d7688aa4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:01.310158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-374061d6-fb40-4ac3-9258-308d7688aa4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:01.310826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-374061d6-fb40-4ac3-9258-308d7688aa4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:01.311271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-374061d6-fb40-4ac3-9258-308d7688aa4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:01.311685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-374061d6-fb40-4ac3-9258-308d7688aa4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:01.439285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-374061d6-fb40-4ac3-9258-308d7688aa4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:01.447003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-374061d6-fb40-4ac3-9258-308d7688aa4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149658 Aug 06 12:55:01.447579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1157/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:01 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:01.870986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c0e42652-4c4a-41ad-9094-37f46660fdab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:01.871590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c0e42652-4c4a-41ad-9094-37f46660fdab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:01.878441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0e42652-4c4a-41ad-9094-37f46660fdab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:01.878915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0e42652-4c4a-41ad-9094-37f46660fdab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:01.879344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0e42652-4c4a-41ad-9094-37f46660fdab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:01.880036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0e42652-4c4a-41ad-9094-37f46660fdab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:01.880509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0e42652-4c4a-41ad-9094-37f46660fdab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:01.880933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0e42652-4c4a-41ad-9094-37f46660fdab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:01.910531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:01.911138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:01.917839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:01.918310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:01.918735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:01.919413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:01.919855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:01.920269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:01.986183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:02.007377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:02.009871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:02.011679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b6cf337f-b6cc-4b92-a17c-6748c0ac5e68 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.104792 Aug 06 12:55:02.012569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1158/2308] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:02.257886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c0e42652-4c4a-41ad-9094-37f46660fdab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:02.265707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c0e42652-4c4a-41ad-9094-37f46660fdab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.398504 Aug 06 12:55:02.266269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1151/2309] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:01 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:02.468335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-03f9af75-e283-47cd-bb60-beac0db5ef9e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:02.468882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-03f9af75-e283-47cd-bb60-beac0db5ef9e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:02.474740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03f9af75-e283-47cd-bb60-beac0db5ef9e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:02.475215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03f9af75-e283-47cd-bb60-beac0db5ef9e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:02.475640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03f9af75-e283-47cd-bb60-beac0db5ef9e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:02.476358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03f9af75-e283-47cd-bb60-beac0db5ef9e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:02.476808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03f9af75-e283-47cd-bb60-beac0db5ef9e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:02.477223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03f9af75-e283-47cd-bb60-beac0db5ef9e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:02.609043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-03f9af75-e283-47cd-bb60-beac0db5ef9e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:02.617103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-03f9af75-e283-47cd-bb60-beac0db5ef9e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152699 Aug 06 12:55:02.617659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1159/2310] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:02 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:03.034990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:03.035621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:03.041681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:03.042155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:03.042584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:03.043254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:03.043704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:03.044123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:03.103527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:03.111999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:03.113512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:03.114632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2328e6ec-e396-45df-af85-36e0e9ec5679 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083603 Aug 06 12:55:03.115184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1152/2311] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:03.286755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-14e452c7-8737-4c1b-bb9a-a95b089d25b4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:03.287357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-14e452c7-8737-4c1b-bb9a-a95b089d25b4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:03.294315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-14e452c7-8737-4c1b-bb9a-a95b089d25b4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:03.294788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-14e452c7-8737-4c1b-bb9a-a95b089d25b4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:03.295215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-14e452c7-8737-4c1b-bb9a-a95b089d25b4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:03.295995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-14e452c7-8737-4c1b-bb9a-a95b089d25b4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:03.296528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-14e452c7-8737-4c1b-bb9a-a95b089d25b4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:03.297246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-14e452c7-8737-4c1b-bb9a-a95b089d25b4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:03.424004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-14e452c7-8737-4c1b-bb9a-a95b089d25b4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:03.431776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-14e452c7-8737-4c1b-bb9a-a95b089d25b4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149154 Aug 06 12:55:03.432346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1160/2312] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:03 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:03.637879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e84420f9-e7ea-4ef7-91f4-2d43c034e43a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:03.638978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e84420f9-e7ea-4ef7-91f4-2d43c034e43a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:03.644983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e84420f9-e7ea-4ef7-91f4-2d43c034e43a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:03.645464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e84420f9-e7ea-4ef7-91f4-2d43c034e43a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:03.645899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e84420f9-e7ea-4ef7-91f4-2d43c034e43a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:03.646589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e84420f9-e7ea-4ef7-91f4-2d43c034e43a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:03.647044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e84420f9-e7ea-4ef7-91f4-2d43c034e43a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:03.647468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e84420f9-e7ea-4ef7-91f4-2d43c034e43a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:03.774242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e84420f9-e7ea-4ef7-91f4-2d43c034e43a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:03.782159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e84420f9-e7ea-4ef7-91f4-2d43c034e43a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148151 Aug 06 12:55:03.782727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1153/2313] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:03 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:04.136678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:04.137277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:04.143444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:04.143945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:04.144386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:04.145103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:04.145557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:04.145982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:04.206037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:04.214318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:04.215803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:04.217546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c14cb7d6-7178-4bea-8c39-19630c1065cb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084736 Aug 06 12:55:04.218103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1161/2314] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:04.454239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7291f0f6-b950-40fc-abb3-db1d59a7da3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:04.454836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7291f0f6-b950-40fc-abb3-db1d59a7da3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:04.461180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7291f0f6-b950-40fc-abb3-db1d59a7da3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:04.461658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7291f0f6-b950-40fc-abb3-db1d59a7da3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:04.462093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7291f0f6-b950-40fc-abb3-db1d59a7da3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:04.462777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7291f0f6-b950-40fc-abb3-db1d59a7da3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:04.463230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7291f0f6-b950-40fc-abb3-db1d59a7da3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:04.463662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7291f0f6-b950-40fc-abb3-db1d59a7da3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:04.466825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:04.589490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7291f0f6-b950-40fc-abb3-db1d59a7da3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:04.597976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7291f0f6-b950-40fc-abb3-db1d59a7da3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148139 Aug 06 12:55:04.598546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1154/2315] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:04.806769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d2a3a3b-3267-42ff-a2f9-974acb3ec265 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:04.807371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9d2a3a3b-3267-42ff-a2f9-974acb3ec265 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:04.814305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d2a3a3b-3267-42ff-a2f9-974acb3ec265 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:04.814783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d2a3a3b-3267-42ff-a2f9-974acb3ec265 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:04.815216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d2a3a3b-3267-42ff-a2f9-974acb3ec265 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:04.815891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d2a3a3b-3267-42ff-a2f9-974acb3ec265 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:04.816363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d2a3a3b-3267-42ff-a2f9-974acb3ec265 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:04.816792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d2a3a3b-3267-42ff-a2f9-974acb3ec265 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:04.947795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9d2a3a3b-3267-42ff-a2f9-974acb3ec265 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:04.956380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d2a3a3b-3267-42ff-a2f9-974acb3ec265 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153358 Aug 06 12:55:04.956944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1162/2316] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:04 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:05.240615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:05.241223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:05.247119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:05.248248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:05.248709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:05.249392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:05.249846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:05.250272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:05.309042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:05.319942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:05.321499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:05.322787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ed24a40d-d23b-4922-8e48-64863d1c34b9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086143 Aug 06 12:55:05.323343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1155/2317] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:05.619049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-06bad0f9-3a72-44e3-9a21-1ce084cc7953 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:05.619652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-06bad0f9-3a72-44e3-9a21-1ce084cc7953 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:05.625560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06bad0f9-3a72-44e3-9a21-1ce084cc7953 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:05.626034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06bad0f9-3a72-44e3-9a21-1ce084cc7953 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:05.626464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06bad0f9-3a72-44e3-9a21-1ce084cc7953 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:05.627144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06bad0f9-3a72-44e3-9a21-1ce084cc7953 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:05.627593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06bad0f9-3a72-44e3-9a21-1ce084cc7953 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:05.628013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06bad0f9-3a72-44e3-9a21-1ce084cc7953 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:05.770002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-06bad0f9-3a72-44e3-9a21-1ce084cc7953 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:05.781957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-06bad0f9-3a72-44e3-9a21-1ce084cc7953 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.166455 Aug 06 12:55:05.782835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1163/2318] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:05 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:05.977387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d64c0bc7-9d2f-44b6-a862-eb1be7799f2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:05.977906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d64c0bc7-9d2f-44b6-a862-eb1be7799f2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:05.984856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d64c0bc7-9d2f-44b6-a862-eb1be7799f2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:05.985380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d64c0bc7-9d2f-44b6-a862-eb1be7799f2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:05.985808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d64c0bc7-9d2f-44b6-a862-eb1be7799f2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:05.986500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d64c0bc7-9d2f-44b6-a862-eb1be7799f2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:05.986959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d64c0bc7-9d2f-44b6-a862-eb1be7799f2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:05.987384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d64c0bc7-9d2f-44b6-a862-eb1be7799f2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:06.125473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d64c0bc7-9d2f-44b6-a862-eb1be7799f2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:06.133480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d64c0bc7-9d2f-44b6-a862-eb1be7799f2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.160014 Aug 06 12:55:06.134047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1156/2319] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:05 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:06.345180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:06.345789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:06.352419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:06.353300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:06.354097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:06.355077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:06.355539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:06.355966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:06.419557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:06.427901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:06.429439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:06.430575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bcdc98e0-e98d-45ba-8a2a-59712f558b82 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089400 Aug 06 12:55:06.431138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1164/2320] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:06 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:06.804822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0c773a7b-f70b-4963-acf1-d6787a33873a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:06.805423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0c773a7b-f70b-4963-acf1-d6787a33873a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:06.811969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c773a7b-f70b-4963-acf1-d6787a33873a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:06.812473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c773a7b-f70b-4963-acf1-d6787a33873a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:06.812904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c773a7b-f70b-4963-acf1-d6787a33873a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:06.813572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c773a7b-f70b-4963-acf1-d6787a33873a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:06.814043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c773a7b-f70b-4963-acf1-d6787a33873a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:06.814462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c773a7b-f70b-4963-acf1-d6787a33873a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:06.939730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0c773a7b-f70b-4963-acf1-d6787a33873a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:06.947577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0c773a7b-f70b-4963-acf1-d6787a33873a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146573 Aug 06 12:55:06.948132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1157/2321] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:06 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:07.155683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4132db60-a34a-4d39-a1b1-83e1cdf38973 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:07.156243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4132db60-a34a-4d39-a1b1-83e1cdf38973 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:07.162239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4132db60-a34a-4d39-a1b1-83e1cdf38973 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:07.162717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4132db60-a34a-4d39-a1b1-83e1cdf38973 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:07.163150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4132db60-a34a-4d39-a1b1-83e1cdf38973 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:07.163855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4132db60-a34a-4d39-a1b1-83e1cdf38973 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:07.164325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4132db60-a34a-4d39-a1b1-83e1cdf38973 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:07.164759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4132db60-a34a-4d39-a1b1-83e1cdf38973 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:07.294053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4132db60-a34a-4d39-a1b1-83e1cdf38973 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:07.302491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4132db60-a34a-4d39-a1b1-83e1cdf38973 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151285 Aug 06 12:55:07.303043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1165/2322] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:07 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:07.453641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:07.454184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:07.460508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:07.460979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:07.461402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:07.462071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:07.462515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:07.462928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:07.522961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:07.531814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:07.533391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:07.534512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-654a918d-1d89-4464-a6b8-9cfbb79505dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085384 Aug 06 12:55:07.535249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1158/2323] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:07 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:07.968372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dfc8b9bf-0ab7-4a3a-bc56-8ef17c0d1379 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:07.968973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dfc8b9bf-0ab7-4a3a-bc56-8ef17c0d1379 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:07.975656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfc8b9bf-0ab7-4a3a-bc56-8ef17c0d1379 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:07.976136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfc8b9bf-0ab7-4a3a-bc56-8ef17c0d1379 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:07.976594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfc8b9bf-0ab7-4a3a-bc56-8ef17c0d1379 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:07.977304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfc8b9bf-0ab7-4a3a-bc56-8ef17c0d1379 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:07.977755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfc8b9bf-0ab7-4a3a-bc56-8ef17c0d1379 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:07.978180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfc8b9bf-0ab7-4a3a-bc56-8ef17c0d1379 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:08.110213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dfc8b9bf-0ab7-4a3a-bc56-8ef17c0d1379 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:08.118082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dfc8b9bf-0ab7-4a3a-bc56-8ef17c0d1379 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153553 Aug 06 12:55:08.118637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1166/2324] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:07 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:08.325384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-89690e7a-a762-434e-bbb3-b44b49e9d193 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:08.325993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-89690e7a-a762-434e-bbb3-b44b49e9d193 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:08.331866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89690e7a-a762-434e-bbb3-b44b49e9d193 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:08.332372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89690e7a-a762-434e-bbb3-b44b49e9d193 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:08.332818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89690e7a-a762-434e-bbb3-b44b49e9d193 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:08.333491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89690e7a-a762-434e-bbb3-b44b49e9d193 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:08.333940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89690e7a-a762-434e-bbb3-b44b49e9d193 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:08.334366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89690e7a-a762-434e-bbb3-b44b49e9d193 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:08.465944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-89690e7a-a762-434e-bbb3-b44b49e9d193 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:08.473718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-89690e7a-a762-434e-bbb3-b44b49e9d193 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152163 Aug 06 12:55:08.474278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1159/2325] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:08 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:08.556289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:08.556913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:08.562728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:08.563203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:08.563635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:08.564323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:08.564790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:08.565210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:08.624870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:08.633068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:08.634607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:08.635739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2e2c2a82-9927-48e6-95bd-999c03d6bbdc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083272 Aug 06 12:55:08.636287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1167/2326] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:08 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:09.139625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e25a2ed0-b6fd-4099-bde3-cc8eb9768403 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:09.140224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e25a2ed0-b6fd-4099-bde3-cc8eb9768403 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:09.146119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25a2ed0-b6fd-4099-bde3-cc8eb9768403 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:09.146611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25a2ed0-b6fd-4099-bde3-cc8eb9768403 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:09.147026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25a2ed0-b6fd-4099-bde3-cc8eb9768403 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:09.147696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25a2ed0-b6fd-4099-bde3-cc8eb9768403 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:09.148145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25a2ed0-b6fd-4099-bde3-cc8eb9768403 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:09.148588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e25a2ed0-b6fd-4099-bde3-cc8eb9768403 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:09.273500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e25a2ed0-b6fd-4099-bde3-cc8eb9768403 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:09.282046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e25a2ed0-b6fd-4099-bde3-cc8eb9768403 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146755 Aug 06 12:55:09.282610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1160/2327] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:09 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:09.495553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5bebb73c-2e4d-4de1-8099-fcb108fb4334 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:09.496186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5bebb73c-2e4d-4de1-8099-fcb108fb4334 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:09.503084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bebb73c-2e4d-4de1-8099-fcb108fb4334 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:09.503560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bebb73c-2e4d-4de1-8099-fcb108fb4334 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:09.503988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bebb73c-2e4d-4de1-8099-fcb108fb4334 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:09.504697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bebb73c-2e4d-4de1-8099-fcb108fb4334 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:09.505146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bebb73c-2e4d-4de1-8099-fcb108fb4334 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:09.505563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bebb73c-2e4d-4de1-8099-fcb108fb4334 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:09.637129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5bebb73c-2e4d-4de1-8099-fcb108fb4334 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:09.645595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5bebb73c-2e4d-4de1-8099-fcb108fb4334 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153889 Aug 06 12:55:09.646151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1168/2328] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:09 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:09.657044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:09.657644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:09.663909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:09.664417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:09.664845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:09.665520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:09.665965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:09.666387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:09.729594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:09.738537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:09.740007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:09.741154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-059265e1-a077-427c-b08c-d48e3e661a90 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087962 Aug 06 12:55:09.741709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1161/2329] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:10.303076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb1780bf-a437-4c68-9c39-6eab30da60ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:10.303678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb1780bf-a437-4c68-9c39-6eab30da60ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:10.309597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1780bf-a437-4c68-9c39-6eab30da60ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:10.310091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1780bf-a437-4c68-9c39-6eab30da60ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:10.310554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1780bf-a437-4c68-9c39-6eab30da60ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:10.311224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1780bf-a437-4c68-9c39-6eab30da60ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:10.311675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1780bf-a437-4c68-9c39-6eab30da60ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:10.312092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb1780bf-a437-4c68-9c39-6eab30da60ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:10.437467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bb1780bf-a437-4c68-9c39-6eab30da60ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:10.445322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb1780bf-a437-4c68-9c39-6eab30da60ad tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146170 Aug 06 12:55:10.445889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1169/2330] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:10 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:10.666638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0410ce03-ca23-4feb-8e2e-713456d10610 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:10.667172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0410ce03-ca23-4feb-8e2e-713456d10610 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:10.673582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0410ce03-ca23-4feb-8e2e-713456d10610 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:10.674081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0410ce03-ca23-4feb-8e2e-713456d10610 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:10.674496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0410ce03-ca23-4feb-8e2e-713456d10610 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:10.675176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0410ce03-ca23-4feb-8e2e-713456d10610 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:10.675626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0410ce03-ca23-4feb-8e2e-713456d10610 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:10.676044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0410ce03-ca23-4feb-8e2e-713456d10610 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:10.763396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:10.763999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:10.770462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:10.770945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:10.771378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:10.772063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:10.772540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:10.772995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:10.803292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0410ce03-ca23-4feb-8e2e-713456d10610 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:10.811917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0410ce03-ca23-4feb-8e2e-713456d10610 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149203 Aug 06 12:55:10.812615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1162/2331] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:10 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:10.834914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:10.843325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:10.844856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:10.845982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dc1b259f-af78-4e22-89e2-f1e40218d9e4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086951 Aug 06 12:55:10.846531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1170/2332] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:10 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:11.466395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-375b8dd3-a47b-4870-a714-fd1eabc0c537 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:11.467006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-375b8dd3-a47b-4870-a714-fd1eabc0c537 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:11.472936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-375b8dd3-a47b-4870-a714-fd1eabc0c537 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:11.473412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-375b8dd3-a47b-4870-a714-fd1eabc0c537 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:11.473854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-375b8dd3-a47b-4870-a714-fd1eabc0c537 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:11.474536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-375b8dd3-a47b-4870-a714-fd1eabc0c537 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:11.474986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-375b8dd3-a47b-4870-a714-fd1eabc0c537 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:11.475410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-375b8dd3-a47b-4870-a714-fd1eabc0c537 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:11.599172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-375b8dd3-a47b-4870-a714-fd1eabc0c537 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:11.607615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-375b8dd3-a47b-4870-a714-fd1eabc0c537 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145073 Aug 06 12:55:11.608179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1163/2333] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:11 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:11.834007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-655ff823-5eee-4a32-b752-77f0c17d37c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:11.834605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-655ff823-5eee-4a32-b752-77f0c17d37c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:11.841424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-655ff823-5eee-4a32-b752-77f0c17d37c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:11.841891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-655ff823-5eee-4a32-b752-77f0c17d37c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:11.842316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-655ff823-5eee-4a32-b752-77f0c17d37c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:11.842988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-655ff823-5eee-4a32-b752-77f0c17d37c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:11.843426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-655ff823-5eee-4a32-b752-77f0c17d37c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:11.843837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-655ff823-5eee-4a32-b752-77f0c17d37c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:11.858856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:11.868463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:11.869096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:11.875487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:11.875957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:11.876406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:11.877087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:11.877532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:11.877948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:11.942886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:11.953693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:11.955198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:11.956362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bf28ed99-0dc5-46fd-b3da-f3b425cd0867 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.091732 Aug 06 12:55:11.956922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1164/2334] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:11 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:11.977058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-655ff823-5eee-4a32-b752-77f0c17d37c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:11.985179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-655ff823-5eee-4a32-b752-77f0c17d37c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.155312 Aug 06 12:55:11.985734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1171/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:11 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:12.629048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-72c0539f-9886-4f05-86e4-f506d5e1dd1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:12.629661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-72c0539f-9886-4f05-86e4-f506d5e1dd1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:12.635533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c0539f-9886-4f05-86e4-f506d5e1dd1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:12.636010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c0539f-9886-4f05-86e4-f506d5e1dd1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:12.636477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c0539f-9886-4f05-86e4-f506d5e1dd1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:12.637160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c0539f-9886-4f05-86e4-f506d5e1dd1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:12.638205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c0539f-9886-4f05-86e4-f506d5e1dd1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:12.638642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c0539f-9886-4f05-86e4-f506d5e1dd1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:12.762093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-72c0539f-9886-4f05-86e4-f506d5e1dd1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:12.770001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-72c0539f-9886-4f05-86e4-f506d5e1dd1d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.144771 Aug 06 12:55:12.770562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1165/2336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:12 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:12.978996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:12.979512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:12.986731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:12.987210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:12.987642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:12.988340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:12.988795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:12.989222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:13.006427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b39e4bda-b69e-4361-b350-2a45acc99b5f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:13.007116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b39e4bda-b69e-4361-b350-2a45acc99b5f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:13.013742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39e4bda-b69e-4361-b350-2a45acc99b5f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:13.014510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39e4bda-b69e-4361-b350-2a45acc99b5f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:13.015019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39e4bda-b69e-4361-b350-2a45acc99b5f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:13.015830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39e4bda-b69e-4361-b350-2a45acc99b5f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:13.016328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39e4bda-b69e-4361-b350-2a45acc99b5f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:13.017051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39e4bda-b69e-4361-b350-2a45acc99b5f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:13.052144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:13.060749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:13.062246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:13.063382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a2bf2403-f208-4a2d-8997-08e844ffb93a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088356 Aug 06 12:55:13.063942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1172/2337] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:12 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:13.144875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b39e4bda-b69e-4361-b350-2a45acc99b5f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:13.152806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b39e4bda-b69e-4361-b350-2a45acc99b5f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150334 Aug 06 12:55:13.153862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1166/2338] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:13 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:13.791406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-928d2a36-ff48-455e-9c02-dfe1d45ab8e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:13.792013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-928d2a36-ff48-455e-9c02-dfe1d45ab8e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:13.797859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-928d2a36-ff48-455e-9c02-dfe1d45ab8e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:13.798338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-928d2a36-ff48-455e-9c02-dfe1d45ab8e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:13.798766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-928d2a36-ff48-455e-9c02-dfe1d45ab8e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:13.799436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-928d2a36-ff48-455e-9c02-dfe1d45ab8e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:13.799879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-928d2a36-ff48-455e-9c02-dfe1d45ab8e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:13.800318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-928d2a36-ff48-455e-9c02-dfe1d45ab8e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:13.930441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-928d2a36-ff48-455e-9c02-dfe1d45ab8e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:13.938763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-928d2a36-ff48-455e-9c02-dfe1d45ab8e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151184 Aug 06 12:55:13.939319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1173/2339] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:13 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:14.085572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:14.086137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:14.092557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:14.093032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:14.093461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:14.094135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:14.094582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:14.095001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:14.158094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:14.166358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:14.167829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:14.169500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-39511160-2b86-4add-83f2-18514c509d29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087388 Aug 06 12:55:14.170054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1167/2340] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:14.174928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-78b4bf60-efe7-4b8f-bf59-22635c3e8c2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:14.175552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-78b4bf60-efe7-4b8f-bf59-22635c3e8c2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:14.181888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78b4bf60-efe7-4b8f-bf59-22635c3e8c2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:14.182365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78b4bf60-efe7-4b8f-bf59-22635c3e8c2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:14.182797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78b4bf60-efe7-4b8f-bf59-22635c3e8c2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:14.183481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78b4bf60-efe7-4b8f-bf59-22635c3e8c2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:14.183929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78b4bf60-efe7-4b8f-bf59-22635c3e8c2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:14.184375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78b4bf60-efe7-4b8f-bf59-22635c3e8c2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:14.312580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-78b4bf60-efe7-4b8f-bf59-22635c3e8c2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:14.320451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-78b4bf60-efe7-4b8f-bf59-22635c3e8c2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149642 Aug 06 12:55:14.321009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1174/2341] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:14 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:14.960254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-942d32da-3c2d-461a-8ea8-82794f5e5bd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:14.960956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-942d32da-3c2d-461a-8ea8-82794f5e5bd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:14.967497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942d32da-3c2d-461a-8ea8-82794f5e5bd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:14.967978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942d32da-3c2d-461a-8ea8-82794f5e5bd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:14.968440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942d32da-3c2d-461a-8ea8-82794f5e5bd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:14.969130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942d32da-3c2d-461a-8ea8-82794f5e5bd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:14.969586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942d32da-3c2d-461a-8ea8-82794f5e5bd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:14.970014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-942d32da-3c2d-461a-8ea8-82794f5e5bd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:15.095534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-942d32da-3c2d-461a-8ea8-82794f5e5bd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:15.103333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-942d32da-3c2d-461a-8ea8-82794f5e5bd2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146997 Aug 06 12:55:15.103891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1168/2342] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:14 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:15.190959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:15.191556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:15.197802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:15.198360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:15.198708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:15.199372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:15.199815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:15.200741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:15.261031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:15.269659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:15.271134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:15.272249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bd921ef7-9b55-44f1-8dd3-6e181b273325 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085240 Aug 06 12:55:15.272819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1175/2343] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:15 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:15.340567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-52467696-8475-471b-afda-9dc3072b212c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:15.341340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-52467696-8475-471b-afda-9dc3072b212c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:15.348713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52467696-8475-471b-afda-9dc3072b212c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:15.349190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52467696-8475-471b-afda-9dc3072b212c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:15.349620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52467696-8475-471b-afda-9dc3072b212c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:15.350294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52467696-8475-471b-afda-9dc3072b212c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:15.350739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52467696-8475-471b-afda-9dc3072b212c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:15.351157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52467696-8475-471b-afda-9dc3072b212c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:15.476748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-52467696-8475-471b-afda-9dc3072b212c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:15.484875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-52467696-8475-471b-afda-9dc3072b212c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147812 Aug 06 12:55:15.485434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1169/2344] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:15 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:16.124689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e3e56a1d-9e30-4185-adc3-c62a50e9b392 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:16.125288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e3e56a1d-9e30-4185-adc3-c62a50e9b392 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:16.131203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3e56a1d-9e30-4185-adc3-c62a50e9b392 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:16.131675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3e56a1d-9e30-4185-adc3-c62a50e9b392 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:16.132101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3e56a1d-9e30-4185-adc3-c62a50e9b392 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:16.132802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3e56a1d-9e30-4185-adc3-c62a50e9b392 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:16.133245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3e56a1d-9e30-4185-adc3-c62a50e9b392 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:16.133659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e3e56a1d-9e30-4185-adc3-c62a50e9b392 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:16.261886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e3e56a1d-9e30-4185-adc3-c62a50e9b392 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:16.269622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e3e56a1d-9e30-4185-adc3-c62a50e9b392 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148939 Aug 06 12:55:16.270170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1176/2345] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:16 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:16.295633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:16.296335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:16.303837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:16.304379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:16.304817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:16.305504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:16.305962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:16.306387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:16.371957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:16.374149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:16.381561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:16.383067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:16.384204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bcb7e1f3-c00c-4da9-a4da-cf25cc15018f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.093027 Aug 06 12:55:16.385093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1170/2346] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:16.506438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a82135e0-585d-45c7-8b82-108e6d9d649d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:16.507037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a82135e0-585d-45c7-8b82-108e6d9d649d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:16.513449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a82135e0-585d-45c7-8b82-108e6d9d649d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:16.513857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a82135e0-585d-45c7-8b82-108e6d9d649d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:16.514282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a82135e0-585d-45c7-8b82-108e6d9d649d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:16.514950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a82135e0-585d-45c7-8b82-108e6d9d649d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:16.515392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a82135e0-585d-45c7-8b82-108e6d9d649d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:16.515805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a82135e0-585d-45c7-8b82-108e6d9d649d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:16.639745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a82135e0-585d-45c7-8b82-108e6d9d649d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:16.647451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a82135e0-585d-45c7-8b82-108e6d9d649d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.144809 Aug 06 12:55:16.648003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1177/2347] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:16 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:16.760993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:55:16.761166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:55:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:55:17.291379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-17cc7d6e-cd50-4663-b374-d9d3c00b6ca9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:17.291974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-17cc7d6e-cd50-4663-b374-d9d3c00b6ca9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:17.298678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc7d6e-cd50-4663-b374-d9d3c00b6ca9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:17.299223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc7d6e-cd50-4663-b374-d9d3c00b6ca9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:17.299651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc7d6e-cd50-4663-b374-d9d3c00b6ca9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:17.300331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc7d6e-cd50-4663-b374-d9d3c00b6ca9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:17.300781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc7d6e-cd50-4663-b374-d9d3c00b6ca9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:17.301198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17cc7d6e-cd50-4663-b374-d9d3c00b6ca9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:17.406951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:17.407577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:17.414116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:17.414620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:17.415047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:17.415734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:17.416175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:17.416683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:17.442085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-17cc7d6e-cd50-4663-b374-d9d3c00b6ca9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:17.450064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-17cc7d6e-cd50-4663-b374-d9d3c00b6ca9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.162783 Aug 06 12:55:17.450842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1171/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:17 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:17.478991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:17.488137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:17.489680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:17.490821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a8db810-a003-44c6-bce4-9cadc06ef246 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087815 Aug 06 12:55:17.491367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1178/2349] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:17 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:17.669780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61224e60-8754-49f3-880f-b14334cfdaae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:17.670288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61224e60-8754-49f3-880f-b14334cfdaae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:17.676320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61224e60-8754-49f3-880f-b14334cfdaae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:17.676807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61224e60-8754-49f3-880f-b14334cfdaae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:17.677237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61224e60-8754-49f3-880f-b14334cfdaae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:17.677924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61224e60-8754-49f3-880f-b14334cfdaae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:17.678368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61224e60-8754-49f3-880f-b14334cfdaae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:17.678788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61224e60-8754-49f3-880f-b14334cfdaae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:17.725507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:55:17.725717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:55:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 (ip 10.222.0.20) !!! Aug 06 12:55:17.803211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61224e60-8754-49f3-880f-b14334cfdaae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:17.811043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61224e60-8754-49f3-880f-b14334cfdaae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145911 Aug 06 12:55:17.811594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1172/2350] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:17 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:18.470978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-87d17ffb-aaf6-4720-8db7-ca1a9b36b4d2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:18.471592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-87d17ffb-aaf6-4720-8db7-ca1a9b36b4d2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:18.477957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87d17ffb-aaf6-4720-8db7-ca1a9b36b4d2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:18.478430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87d17ffb-aaf6-4720-8db7-ca1a9b36b4d2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:18.478913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87d17ffb-aaf6-4720-8db7-ca1a9b36b4d2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:18.479595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87d17ffb-aaf6-4720-8db7-ca1a9b36b4d2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:18.480043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87d17ffb-aaf6-4720-8db7-ca1a9b36b4d2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:18.480491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87d17ffb-aaf6-4720-8db7-ca1a9b36b4d2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:18.513617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:18.514243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:18.520639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:18.521112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:18.521543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:18.522233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:18.522686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:18.523110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:18.586956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:18.595301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:18.596800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:18.597949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-52ddd402-e09e-4b75-a6ec-a204f54bba58 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088911 Aug 06 12:55:18.598497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1173/2351] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:18.610537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-87d17ffb-aaf6-4720-8db7-ca1a9b36b4d2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:18.618326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-87d17ffb-aaf6-4720-8db7-ca1a9b36b4d2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151211 Aug 06 12:55:18.618877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1179/2352] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:18 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:18.832394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f273b364-7928-4578-92ce-f8144c7afe13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:18.833005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f273b364-7928-4578-92ce-f8144c7afe13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:18.839318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f273b364-7928-4578-92ce-f8144c7afe13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:18.839792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f273b364-7928-4578-92ce-f8144c7afe13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:18.840220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f273b364-7928-4578-92ce-f8144c7afe13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:18.840921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f273b364-7928-4578-92ce-f8144c7afe13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:18.841370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f273b364-7928-4578-92ce-f8144c7afe13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:18.841786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f273b364-7928-4578-92ce-f8144c7afe13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:18.973010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f273b364-7928-4578-92ce-f8144c7afe13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:18.980911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f273b364-7928-4578-92ce-f8144c7afe13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152358 Aug 06 12:55:18.982001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1174/2353] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:18 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:19.620395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:19.620991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:19.627393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:19.627864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:19.628287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:19.628978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:19.629420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:19.629837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:19.639187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b21a37d6-05de-47f5-bd48-cefdfd395445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:19.639797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b21a37d6-05de-47f5-bd48-cefdfd395445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:19.646184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b21a37d6-05de-47f5-bd48-cefdfd395445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:19.646655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b21a37d6-05de-47f5-bd48-cefdfd395445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:19.647089 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b21a37d6-05de-47f5-bd48-cefdfd395445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:19.647780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b21a37d6-05de-47f5-bd48-cefdfd395445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:19.648234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b21a37d6-05de-47f5-bd48-cefdfd395445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:19.648683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b21a37d6-05de-47f5-bd48-cefdfd395445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:19.691256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:19.699756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:19.701846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:19.703048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1d9e3f43-3070-43d2-b0ec-22f3ee3cbef0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086571 Aug 06 12:55:19.703619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1180/2354] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:19.774376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b21a37d6-05de-47f5-bd48-cefdfd395445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:19.782695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b21a37d6-05de-47f5-bd48-cefdfd395445 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147764 Aug 06 12:55:19.783246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1175/2355] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:19 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:20.002607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-11c68770-be2e-4c0a-9130-9f27be3c3736 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:20.003208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-11c68770-be2e-4c0a-9130-9f27be3c3736 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:20.009052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11c68770-be2e-4c0a-9130-9f27be3c3736 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:20.009523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11c68770-be2e-4c0a-9130-9f27be3c3736 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:20.009943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11c68770-be2e-4c0a-9130-9f27be3c3736 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:20.010609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11c68770-be2e-4c0a-9130-9f27be3c3736 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:20.011052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11c68770-be2e-4c0a-9130-9f27be3c3736 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:20.011462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11c68770-be2e-4c0a-9130-9f27be3c3736 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:20.137924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-11c68770-be2e-4c0a-9130-9f27be3c3736 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:20.145741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-11c68770-be2e-4c0a-9130-9f27be3c3736 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146959 Aug 06 12:55:20.146288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1181/2356] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:19 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:20.725866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:20.726469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:20.733028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:20.733507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:20.733965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:20.734907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:20.735357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:20.735776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:20.799722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:20.803027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-93f31a72-6590-4279-b829-b0b3c00af846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:20.803705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-93f31a72-6590-4279-b829-b0b3c00af846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:20.808134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:20.810207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:20.810700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93f31a72-6590-4279-b829-b0b3c00af846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:20.811254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93f31a72-6590-4279-b829-b0b3c00af846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:20.811370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7ea4d51a-b961-4675-8d06-472a4b15ec3f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089473 Aug 06 12:55:20.811809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93f31a72-6590-4279-b829-b0b3c00af846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:20.811926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1176/2357] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:20.812730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93f31a72-6590-4279-b829-b0b3c00af846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:20.813199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93f31a72-6590-4279-b829-b0b3c00af846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:20.813624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93f31a72-6590-4279-b829-b0b3c00af846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:20.942998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-93f31a72-6590-4279-b829-b0b3c00af846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:20.950821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-93f31a72-6590-4279-b829-b0b3c00af846 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151732 Aug 06 12:55:20.951380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1182/2358] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:20 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:21.166920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a5c1372b-d039-43c7-8fbf-148300966c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:21.167525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a5c1372b-d039-43c7-8fbf-148300966c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:21.173963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5c1372b-d039-43c7-8fbf-148300966c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:21.174435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5c1372b-d039-43c7-8fbf-148300966c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:21.174866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5c1372b-d039-43c7-8fbf-148300966c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:21.175548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5c1372b-d039-43c7-8fbf-148300966c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:21.175996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5c1372b-d039-43c7-8fbf-148300966c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:21.176444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5c1372b-d039-43c7-8fbf-148300966c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:21.303075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a5c1372b-d039-43c7-8fbf-148300966c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:21.310996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a5c1372b-d039-43c7-8fbf-148300966c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147931 Aug 06 12:55:21.311551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1177/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:21 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:21.834028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:21.834643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:21.840938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:21.841418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:21.841844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:21.842512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:21.842954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:21.843371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:21.903682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:21.911870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:21.913381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:21.914503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-60636a49-995a-4b25-a70a-04889a447a3e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084396 Aug 06 12:55:21.915045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1183/2360] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:21 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:21.972713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5f8c22fe-d4c0-4c74-84d6-c92d3ff25257 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:21.973308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5f8c22fe-d4c0-4c74-84d6-c92d3ff25257 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:21.979929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f8c22fe-d4c0-4c74-84d6-c92d3ff25257 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:21.980432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f8c22fe-d4c0-4c74-84d6-c92d3ff25257 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:21.980862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f8c22fe-d4c0-4c74-84d6-c92d3ff25257 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:21.982035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f8c22fe-d4c0-4c74-84d6-c92d3ff25257 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:21.982483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f8c22fe-d4c0-4c74-84d6-c92d3ff25257 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:21.982899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f8c22fe-d4c0-4c74-84d6-c92d3ff25257 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:22.123342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f8c22fe-d4c0-4c74-84d6-c92d3ff25257 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:22.131182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5f8c22fe-d4c0-4c74-84d6-c92d3ff25257 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.162450 Aug 06 12:55:22.131738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1178/2361] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:21 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:22.330935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-13a48924-91b0-4c53-bee8-9c746acbdea1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:22.331545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-13a48924-91b0-4c53-bee8-9c746acbdea1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:22.337428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13a48924-91b0-4c53-bee8-9c746acbdea1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:22.337907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13a48924-91b0-4c53-bee8-9c746acbdea1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:22.338336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13a48924-91b0-4c53-bee8-9c746acbdea1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:22.339012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13a48924-91b0-4c53-bee8-9c746acbdea1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:22.339460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13a48924-91b0-4c53-bee8-9c746acbdea1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:22.339879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13a48924-91b0-4c53-bee8-9c746acbdea1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:22.464748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-13a48924-91b0-4c53-bee8-9c746acbdea1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:22.473132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-13a48924-91b0-4c53-bee8-9c746acbdea1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146008 Aug 06 12:55:22.473886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1184/2362] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:22 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:22.938553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:22.939156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:22.945350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:22.946038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:22.946477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:22.947199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:22.947653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:22.948074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:23.017466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:23.026235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:23.028409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:23.029555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3925595e-5927-42db-a617-ad91240a72f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.094957 Aug 06 12:55:23.030118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1179/2363] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:23.153571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-288e3f6c-518b-4b30-ae7f-b6da7a5e2aa9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:23.154812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-288e3f6c-518b-4b30-ae7f-b6da7a5e2aa9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:23.161425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-288e3f6c-518b-4b30-ae7f-b6da7a5e2aa9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:23.161932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-288e3f6c-518b-4b30-ae7f-b6da7a5e2aa9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:23.162360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-288e3f6c-518b-4b30-ae7f-b6da7a5e2aa9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:23.163049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-288e3f6c-518b-4b30-ae7f-b6da7a5e2aa9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:23.163505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-288e3f6c-518b-4b30-ae7f-b6da7a5e2aa9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:23.163926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-288e3f6c-518b-4b30-ae7f-b6da7a5e2aa9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:23.293763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-288e3f6c-518b-4b30-ae7f-b6da7a5e2aa9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:23.301706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-288e3f6c-518b-4b30-ae7f-b6da7a5e2aa9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152769 Aug 06 12:55:23.302224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1185/2364] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:23.494534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d6112975-b206-4e61-9af3-d50b955b1693 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:23.495095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d6112975-b206-4e61-9af3-d50b955b1693 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:23.501033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6112975-b206-4e61-9af3-d50b955b1693 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:23.501505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6112975-b206-4e61-9af3-d50b955b1693 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:23.501933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6112975-b206-4e61-9af3-d50b955b1693 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:23.502633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6112975-b206-4e61-9af3-d50b955b1693 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:23.503082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6112975-b206-4e61-9af3-d50b955b1693 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:23.503498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6112975-b206-4e61-9af3-d50b955b1693 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:23.535464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:55:23.535673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:55:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 (ip 10.222.0.20) !!! Aug 06 12:55:23.630185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d6112975-b206-4e61-9af3-d50b955b1693 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:23.638638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d6112975-b206-4e61-9af3-d50b955b1693 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148011 Aug 06 12:55:23.639219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1180/2365] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:23 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:24.052563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:24.053162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:24.059013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:24.059490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:24.059914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:24.060608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:24.061053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:24.061465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:24.122498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:24.131171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:24.132681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:24.133792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5eaf3f88-0b74-4c45-b77a-abcfb9f02af3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085160 Aug 06 12:55:24.134336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1186/2366] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:24.322719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f7abc91f-0c8a-415f-925c-058b66a05b1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:24.323479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f7abc91f-0c8a-415f-925c-058b66a05b1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:24.330622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7abc91f-0c8a-415f-925c-058b66a05b1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:24.331101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7abc91f-0c8a-415f-925c-058b66a05b1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:24.331539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7abc91f-0c8a-415f-925c-058b66a05b1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:24.332227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7abc91f-0c8a-415f-925c-058b66a05b1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:24.332710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7abc91f-0c8a-415f-925c-058b66a05b1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:24.333136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7abc91f-0c8a-415f-925c-058b66a05b1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:24.457953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f7abc91f-0c8a-415f-925c-058b66a05b1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:24.465775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f7abc91f-0c8a-415f-925c-058b66a05b1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146991 Aug 06 12:55:24.466346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1181/2367] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:24.659640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fab9806b-0209-4ace-ac21-4f498310ec55 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:24.660168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fab9806b-0209-4ace-ac21-4f498310ec55 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:24.666510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fab9806b-0209-4ace-ac21-4f498310ec55 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:24.666980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fab9806b-0209-4ace-ac21-4f498310ec55 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:24.667402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fab9806b-0209-4ace-ac21-4f498310ec55 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:24.668070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fab9806b-0209-4ace-ac21-4f498310ec55 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:24.669057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fab9806b-0209-4ace-ac21-4f498310ec55 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:24.669472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fab9806b-0209-4ace-ac21-4f498310ec55 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:24.797120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fab9806b-0209-4ace-ac21-4f498310ec55 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:24.804877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fab9806b-0209-4ace-ac21-4f498310ec55 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149125 Aug 06 12:55:24.805424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1187/2368] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:24 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:25.156312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:25.156935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:25.162875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:25.163354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:25.163785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:25.164487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:25.164940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:25.165361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:25.229247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:25.238487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:25.239981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:25.241134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-df4bc7c6-4a81-4494-b8a2-fb3294468483 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089228 Aug 06 12:55:25.241691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1182/2369] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:25.487138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-340236cf-ad78-4b09-a7ca-53e98431d8b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:25.487736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-340236cf-ad78-4b09-a7ca-53e98431d8b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:25.493823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-340236cf-ad78-4b09-a7ca-53e98431d8b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:25.494332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-340236cf-ad78-4b09-a7ca-53e98431d8b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:25.494758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-340236cf-ad78-4b09-a7ca-53e98431d8b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:25.495437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-340236cf-ad78-4b09-a7ca-53e98431d8b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:25.495883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-340236cf-ad78-4b09-a7ca-53e98431d8b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:25.496323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-340236cf-ad78-4b09-a7ca-53e98431d8b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:25.500171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:25.624468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-340236cf-ad78-4b09-a7ca-53e98431d8b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:25.632221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-340236cf-ad78-4b09-a7ca-53e98431d8b2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149240 Aug 06 12:55:25.632797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1188/2370] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:25 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:25.827659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c943e70-ba69-4bcb-b548-118260323071 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:25.828265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c943e70-ba69-4bcb-b548-118260323071 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:25.830564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=80 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:25.835767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c943e70-ba69-4bcb-b548-118260323071 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:25.836246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c943e70-ba69-4bcb-b548-118260323071 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:25.836706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c943e70-ba69-4bcb-b548-118260323071 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:25.837385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c943e70-ba69-4bcb-b548-118260323071 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:25.837836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c943e70-ba69-4bcb-b548-118260323071 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:25.838256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c943e70-ba69-4bcb-b548-118260323071 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:25.963927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8c943e70-ba69-4bcb-b548-118260323071 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:25.971726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c943e70-ba69-4bcb-b548-118260323071 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148512 Aug 06 12:55:25.972330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1183/2371] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:25 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:26.263053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:26.263598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:26.269908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:26.270382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:26.270807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:26.271472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:26.271921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:26.272355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:26.331999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:26.340331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:26.341836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:26.342957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eb76f68a-1894-474a-975f-45a6355328f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083850 Aug 06 12:55:26.343499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1189/2372] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:26.654064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-85cac938-4970-406d-be10-21f292459282 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:26.654665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-85cac938-4970-406d-be10-21f292459282 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:26.660644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85cac938-4970-406d-be10-21f292459282 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:26.661117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85cac938-4970-406d-be10-21f292459282 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:26.661548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85cac938-4970-406d-be10-21f292459282 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:26.662219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85cac938-4970-406d-be10-21f292459282 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:26.662666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85cac938-4970-406d-be10-21f292459282 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:26.663081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85cac938-4970-406d-be10-21f292459282 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:26.789162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-85cac938-4970-406d-be10-21f292459282 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:26.798083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-85cac938-4970-406d-be10-21f292459282 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148319 Aug 06 12:55:26.798652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1184/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:26.993300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-963f9ec1-f07f-4e49-9d8b-9fd8ef4b6a2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:26.993832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-963f9ec1-f07f-4e49-9d8b-9fd8ef4b6a2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:26.995725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=78 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:27.001260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-963f9ec1-f07f-4e49-9d8b-9fd8ef4b6a2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:27.001739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-963f9ec1-f07f-4e49-9d8b-9fd8ef4b6a2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:27.002167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-963f9ec1-f07f-4e49-9d8b-9fd8ef4b6a2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:27.002858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-963f9ec1-f07f-4e49-9d8b-9fd8ef4b6a2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:27.003309 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-963f9ec1-f07f-4e49-9d8b-9fd8ef4b6a2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:27.003726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-963f9ec1-f07f-4e49-9d8b-9fd8ef4b6a2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:27.133857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-963f9ec1-f07f-4e49-9d8b-9fd8ef4b6a2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:27.142230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-963f9ec1-f07f-4e49-9d8b-9fd8ef4b6a2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152891 Aug 06 12:55:27.142785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1190/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:26 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:27.366008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:27.366622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:27.374906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:27.375731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:27.376190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:27.376903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:27.377380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:27.378057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:27.442379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:27.451259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:27.452780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:27.453900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-74045ec8-18ba-499b-8d85-6d1f2c670b5b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.091871 Aug 06 12:55:27.454451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1185/2375] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:27.819034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d53f40fe-a4bf-4f7e-b16d-0f93ce133bbf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:27.819709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d53f40fe-a4bf-4f7e-b16d-0f93ce133bbf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:27.826373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d53f40fe-a4bf-4f7e-b16d-0f93ce133bbf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:27.826849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d53f40fe-a4bf-4f7e-b16d-0f93ce133bbf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:27.827276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d53f40fe-a4bf-4f7e-b16d-0f93ce133bbf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:27.827951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d53f40fe-a4bf-4f7e-b16d-0f93ce133bbf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:27.828434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d53f40fe-a4bf-4f7e-b16d-0f93ce133bbf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:27.828851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d53f40fe-a4bf-4f7e-b16d-0f93ce133bbf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:27.952925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d53f40fe-a4bf-4f7e-b16d-0f93ce133bbf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:27.960857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d53f40fe-a4bf-4f7e-b16d-0f93ce133bbf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145718 Aug 06 12:55:27.961428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1191/2376] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:27 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:28.162965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0cebac68-2330-4ba4-babc-2102ebbb65d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:28.163498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0cebac68-2330-4ba4-babc-2102ebbb65d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:28.170002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cebac68-2330-4ba4-babc-2102ebbb65d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:28.170474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cebac68-2330-4ba4-babc-2102ebbb65d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:28.170901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cebac68-2330-4ba4-babc-2102ebbb65d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:28.171572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cebac68-2330-4ba4-babc-2102ebbb65d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:28.172015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cebac68-2330-4ba4-babc-2102ebbb65d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:28.172465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cebac68-2330-4ba4-babc-2102ebbb65d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:28.298306 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0cebac68-2330-4ba4-babc-2102ebbb65d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:28.306051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0cebac68-2330-4ba4-babc-2102ebbb65d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146962 Aug 06 12:55:28.306608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1186/2377] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:28 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:28.475950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:28.476510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:28.482298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:28.482793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:28.483219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:28.483886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:28.484603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:28.485012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:28.544840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:28.553106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:28.554594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:28.555715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c1af8be7-0e26-44b5-918b-5b365d3f3d06 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083669 Aug 06 12:55:28.556264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1192/2378] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:28.981261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6ad137ae-3989-45ba-bd89-5ae3aec99bf5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:28.981875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6ad137ae-3989-45ba-bd89-5ae3aec99bf5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:28.988233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ad137ae-3989-45ba-bd89-5ae3aec99bf5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:28.988744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ad137ae-3989-45ba-bd89-5ae3aec99bf5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:28.989186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ad137ae-3989-45ba-bd89-5ae3aec99bf5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:28.989876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ad137ae-3989-45ba-bd89-5ae3aec99bf5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:28.990348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ad137ae-3989-45ba-bd89-5ae3aec99bf5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:28.990762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ad137ae-3989-45ba-bd89-5ae3aec99bf5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:29.007896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:29.118887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6ad137ae-3989-45ba-bd89-5ae3aec99bf5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:29.127336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6ad137ae-3989-45ba-bd89-5ae3aec99bf5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149896 Aug 06 12:55:29.127932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1187/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:28 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:29.327091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e6a1d740-674d-4bfd-bc46-6723333e09ae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:29.327713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e6a1d740-674d-4bfd-bc46-6723333e09ae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:29.334014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6a1d740-674d-4bfd-bc46-6723333e09ae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:29.334480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6a1d740-674d-4bfd-bc46-6723333e09ae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:29.334901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6a1d740-674d-4bfd-bc46-6723333e09ae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:29.335572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6a1d740-674d-4bfd-bc46-6723333e09ae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:29.336014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6a1d740-674d-4bfd-bc46-6723333e09ae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:29.336456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6a1d740-674d-4bfd-bc46-6723333e09ae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:29.467721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e6a1d740-674d-4bfd-bc46-6723333e09ae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:29.475632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e6a1d740-674d-4bfd-bc46-6723333e09ae tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152423 Aug 06 12:55:29.476132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1193/2380] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:29 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:29.578134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:29.578732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:29.584730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:29.585203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:29.585632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:29.586307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:29.586752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:29.587178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:29.650386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:29.659244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:29.660782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:29.661917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5a220a3e-0eb0-407b-a3f8-f6bb564061e3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087695 Aug 06 12:55:29.662475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1188/2381] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:30.148961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-978184e0-b67f-4a39-9b80-4d3903945cc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:30.149610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-978184e0-b67f-4a39-9b80-4d3903945cc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:30.156124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-978184e0-b67f-4a39-9b80-4d3903945cc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:30.156626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-978184e0-b67f-4a39-9b80-4d3903945cc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:30.157054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-978184e0-b67f-4a39-9b80-4d3903945cc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:30.158324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-978184e0-b67f-4a39-9b80-4d3903945cc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:30.158324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-978184e0-b67f-4a39-9b80-4d3903945cc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:30.158586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-978184e0-b67f-4a39-9b80-4d3903945cc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:30.284424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-978184e0-b67f-4a39-9b80-4d3903945cc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:30.292204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-978184e0-b67f-4a39-9b80-4d3903945cc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147105 Aug 06 12:55:30.292785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1194/2382] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:30 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:30.496844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d02c1d4-010b-45a3-9883-1b757667650c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:30.497963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0d02c1d4-010b-45a3-9883-1b757667650c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:30.504227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d02c1d4-010b-45a3-9883-1b757667650c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:30.504735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d02c1d4-010b-45a3-9883-1b757667650c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:30.505163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d02c1d4-010b-45a3-9883-1b757667650c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:30.505835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d02c1d4-010b-45a3-9883-1b757667650c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:30.506282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d02c1d4-010b-45a3-9883-1b757667650c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:30.506705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d02c1d4-010b-45a3-9883-1b757667650c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:30.633005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0d02c1d4-010b-45a3-9883-1b757667650c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:30.641444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0d02c1d4-010b-45a3-9883-1b757667650c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148388 Aug 06 12:55:30.642019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1189/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:30 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:30.684762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:30.686010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:30.692334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:30.692842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:30.693268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:30.693945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:30.694391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:30.694827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:30.755904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:30.764224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:30.765759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:30.766878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5400b55c-9973-49d9-96b0-fc2697e0019a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085983 Aug 06 12:55:30.767444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1195/2384] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:31.312569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2d7c042a-b9f2-4dcd-8ff7-b3dd0f175043 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:31.313198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2d7c042a-b9f2-4dcd-8ff7-b3dd0f175043 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:31.319358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d7c042a-b9f2-4dcd-8ff7-b3dd0f175043 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:31.319832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d7c042a-b9f2-4dcd-8ff7-b3dd0f175043 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:31.320256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d7c042a-b9f2-4dcd-8ff7-b3dd0f175043 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:31.320951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d7c042a-b9f2-4dcd-8ff7-b3dd0f175043 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:31.321401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d7c042a-b9f2-4dcd-8ff7-b3dd0f175043 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:31.321815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d7c042a-b9f2-4dcd-8ff7-b3dd0f175043 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:31.447374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2d7c042a-b9f2-4dcd-8ff7-b3dd0f175043 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:31.455696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2d7c042a-b9f2-4dcd-8ff7-b3dd0f175043 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146982 Aug 06 12:55:31.456264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1190/2385] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:31 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:31.663131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fd287cc9-2b04-4ec1-a9cf-982c4c4c9db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:31.663762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fd287cc9-2b04-4ec1-a9cf-982c4c4c9db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:31.669657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd287cc9-2b04-4ec1-a9cf-982c4c4c9db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:31.670124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd287cc9-2b04-4ec1-a9cf-982c4c4c9db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:31.670547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd287cc9-2b04-4ec1-a9cf-982c4c4c9db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:31.671213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd287cc9-2b04-4ec1-a9cf-982c4c4c9db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:31.671657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd287cc9-2b04-4ec1-a9cf-982c4c4c9db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:31.672072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd287cc9-2b04-4ec1-a9cf-982c4c4c9db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:31.789216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:31.789908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:31.796148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:31.796657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:31.797087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:31.797774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:31.798219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:31.798637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:31.806051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fd287cc9-2b04-4ec1-a9cf-982c4c4c9db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:31.816603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fd287cc9-2b04-4ec1-a9cf-982c4c4c9db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.157167 Aug 06 12:55:31.817415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1196/2386] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:31 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:31.870130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:31.878875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:31.880394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:31.881515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5f81f1d0-1039-4cee-b8dc-0a9bf4ce81f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.096242 Aug 06 12:55:31.882069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1191/2387] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:32.477628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-20eb63f0-d201-479c-80a4-d3c8f78791de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:32.478228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-20eb63f0-d201-479c-80a4-d3c8f78791de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:32.484057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20eb63f0-d201-479c-80a4-d3c8f78791de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:32.484815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20eb63f0-d201-479c-80a4-d3c8f78791de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:32.485242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20eb63f0-d201-479c-80a4-d3c8f78791de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:32.485960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20eb63f0-d201-479c-80a4-d3c8f78791de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:32.486404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20eb63f0-d201-479c-80a4-d3c8f78791de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:32.486822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20eb63f0-d201-479c-80a4-d3c8f78791de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:32.613951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-20eb63f0-d201-479c-80a4-d3c8f78791de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:32.624596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-20eb63f0-d201-479c-80a4-d3c8f78791de tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150708 Aug 06 12:55:32.625167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1197/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:32.838292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b3eb5d1e-2aea-4744-b5d1-8a1013b5cffb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:32.838895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b3eb5d1e-2aea-4744-b5d1-8a1013b5cffb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:32.845228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3eb5d1e-2aea-4744-b5d1-8a1013b5cffb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:32.845704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3eb5d1e-2aea-4744-b5d1-8a1013b5cffb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:32.846159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3eb5d1e-2aea-4744-b5d1-8a1013b5cffb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:32.846833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3eb5d1e-2aea-4744-b5d1-8a1013b5cffb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:32.847305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3eb5d1e-2aea-4744-b5d1-8a1013b5cffb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:32.847719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3eb5d1e-2aea-4744-b5d1-8a1013b5cffb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:32.905201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:32.905810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:32.912021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:32.912533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:32.912958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:32.913628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:32.914073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:32.914486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:32.977334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:32.977495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b3eb5d1e-2aea-4744-b5d1-8a1013b5cffb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:32.986437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b3eb5d1e-2aea-4744-b5d1-8a1013b5cffb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151904 Aug 06 12:55:32.986596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:32.987008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1192/2389] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:32 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:32.988093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:32.989242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f97e18be-daa2-4a20-ba5f-87b0d7a7de71 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088003 Aug 06 12:55:32.990494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1198/2390] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:33.645795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9c70c73e-6e6e-42b4-bb11-6a9ab33fd259 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:33.646395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9c70c73e-6e6e-42b4-bb11-6a9ab33fd259 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:33.652324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c70c73e-6e6e-42b4-bb11-6a9ab33fd259 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:33.652798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c70c73e-6e6e-42b4-bb11-6a9ab33fd259 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:33.653239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c70c73e-6e6e-42b4-bb11-6a9ab33fd259 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:33.653937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c70c73e-6e6e-42b4-bb11-6a9ab33fd259 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:33.654385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c70c73e-6e6e-42b4-bb11-6a9ab33fd259 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:33.654802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c70c73e-6e6e-42b4-bb11-6a9ab33fd259 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:33.787677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9c70c73e-6e6e-42b4-bb11-6a9ab33fd259 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:33.796021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9c70c73e-6e6e-42b4-bb11-6a9ab33fd259 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.154266 Aug 06 12:55:33.796606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1193/2391] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:34.007947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4cc7413-af7d-432a-8cfa-df6fadccfdc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:34.008578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d4cc7413-af7d-432a-8cfa-df6fadccfdc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:34.012210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:34.012884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:34.015304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4cc7413-af7d-432a-8cfa-df6fadccfdc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:34.015784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4cc7413-af7d-432a-8cfa-df6fadccfdc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:34.016215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4cc7413-af7d-432a-8cfa-df6fadccfdc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:34.016920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4cc7413-af7d-432a-8cfa-df6fadccfdc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:34.017398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4cc7413-af7d-432a-8cfa-df6fadccfdc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:34.017813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4cc7413-af7d-432a-8cfa-df6fadccfdc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:34.019187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:34.019670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:34.020244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:34.020821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:34.021269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:34.021699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:34.084258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:34.094349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:34.095858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:34.097021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-630d2baa-d2ef-4bfd-8b16-40489da82f67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088718 Aug 06 12:55:34.097881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1194/2392] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:34.150774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d4cc7413-af7d-432a-8cfa-df6fadccfdc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:34.159091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d4cc7413-af7d-432a-8cfa-df6fadccfdc3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.155098 Aug 06 12:55:34.159645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1199/2393] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:34 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:34.816967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c0021b67-f14c-438e-bb54-6d41d06bee78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:34.817577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c0021b67-f14c-438e-bb54-6d41d06bee78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:34.823551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0021b67-f14c-438e-bb54-6d41d06bee78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:34.824033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0021b67-f14c-438e-bb54-6d41d06bee78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:34.824531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0021b67-f14c-438e-bb54-6d41d06bee78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:34.825213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0021b67-f14c-438e-bb54-6d41d06bee78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:34.826257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0021b67-f14c-438e-bb54-6d41d06bee78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:34.826682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0021b67-f14c-438e-bb54-6d41d06bee78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:34.957530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c0021b67-f14c-438e-bb54-6d41d06bee78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:34.965478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c0021b67-f14c-438e-bb54-6d41d06bee78 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152325 Aug 06 12:55:34.966042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1195/2394] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:34 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:35.121008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:35.121539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:35.128711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:35.129184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:35.129609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:35.130277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:35.130725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:35.131141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:35.181704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-32cc0963-0d1d-4e93-8764-c2a003fc51a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:35.182317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-32cc0963-0d1d-4e93-8764-c2a003fc51a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:35.189376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32cc0963-0d1d-4e93-8764-c2a003fc51a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:35.190618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32cc0963-0d1d-4e93-8764-c2a003fc51a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:35.191049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32cc0963-0d1d-4e93-8764-c2a003fc51a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:35.191750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32cc0963-0d1d-4e93-8764-c2a003fc51a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:35.192044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:35.192206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32cc0963-0d1d-4e93-8764-c2a003fc51a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:35.192687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32cc0963-0d1d-4e93-8764-c2a003fc51a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:35.200603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:35.202079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:35.203198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eaa87bc9-69ad-4fd0-9cc6-2905b488571e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086502 Aug 06 12:55:35.203753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1200/2395] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:35.321414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-32cc0963-0d1d-4e93-8764-c2a003fc51a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:35.329179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-32cc0963-0d1d-4e93-8764-c2a003fc51a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151400 Aug 06 12:55:35.329734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1196/2396] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:35 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:35.987417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-204e7140-f873-409d-8671-669c2775618c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:35.988012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-204e7140-f873-409d-8671-669c2775618c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:35.994029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e7140-f873-409d-8671-669c2775618c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:35.994510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e7140-f873-409d-8671-669c2775618c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:35.994937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e7140-f873-409d-8671-669c2775618c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:35.995645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e7140-f873-409d-8671-669c2775618c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:35.996090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e7140-f873-409d-8671-669c2775618c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:35.996526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-204e7140-f873-409d-8671-669c2775618c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:36.131766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-204e7140-f873-409d-8671-669c2775618c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:36.139640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-204e7140-f873-409d-8671-669c2775618c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.156658 Aug 06 12:55:36.140194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1201/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:35 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:36.226044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:36.226654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:36.233512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:36.233996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:36.234692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:36.235372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:36.235829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:36.236255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:36.296995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:36.305274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:36.306753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:36.307876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2c727451-654e-4873-b0c3-c94f47e25fbd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085720 Aug 06 12:55:36.308451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1197/2398] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:36.349933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-007cb637-5334-4e11-ac80-0b3b2d2fb062 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:36.350543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-007cb637-5334-4e11-ac80-0b3b2d2fb062 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:36.356418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-007cb637-5334-4e11-ac80-0b3b2d2fb062 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:36.357456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-007cb637-5334-4e11-ac80-0b3b2d2fb062 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:36.357885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-007cb637-5334-4e11-ac80-0b3b2d2fb062 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:36.358560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-007cb637-5334-4e11-ac80-0b3b2d2fb062 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:36.359008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-007cb637-5334-4e11-ac80-0b3b2d2fb062 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:36.359697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-007cb637-5334-4e11-ac80-0b3b2d2fb062 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:36.490932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-007cb637-5334-4e11-ac80-0b3b2d2fb062 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:36.498864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-007cb637-5334-4e11-ac80-0b3b2d2fb062 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152773 Aug 06 12:55:36.499416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1202/2399] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:36 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:37.160769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6d8ee718-4bde-41ea-9fae-4c090ce70ee7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:37.161283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6d8ee718-4bde-41ea-9fae-4c090ce70ee7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:37.167688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d8ee718-4bde-41ea-9fae-4c090ce70ee7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:37.168176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d8ee718-4bde-41ea-9fae-4c090ce70ee7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:37.168652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d8ee718-4bde-41ea-9fae-4c090ce70ee7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:37.169340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d8ee718-4bde-41ea-9fae-4c090ce70ee7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:37.169798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d8ee718-4bde-41ea-9fae-4c090ce70ee7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:37.170224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d8ee718-4bde-41ea-9fae-4c090ce70ee7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:37.299344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6d8ee718-4bde-41ea-9fae-4c090ce70ee7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:37.307338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6d8ee718-4bde-41ea-9fae-4c090ce70ee7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150535 Aug 06 12:55:37.307893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1198/2400] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:37.331371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:37.331967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:37.338283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:37.338751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:37.339176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:37.339839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:37.340279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:37.340716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:37.404227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:37.422396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:37.423811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:37.425031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fef6cea4-e53b-4f6b-ac96-18b260cc050a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.097495 Aug 06 12:55:37.425586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1203/2401] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:37.518960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1fe7fc1a-1237-4a6c-a897-f4064f6cfe85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:37.519595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1fe7fc1a-1237-4a6c-a897-f4064f6cfe85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:37.525600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fe7fc1a-1237-4a6c-a897-f4064f6cfe85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:37.526084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fe7fc1a-1237-4a6c-a897-f4064f6cfe85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:37.526523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fe7fc1a-1237-4a6c-a897-f4064f6cfe85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:37.527211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fe7fc1a-1237-4a6c-a897-f4064f6cfe85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:37.527666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fe7fc1a-1237-4a6c-a897-f4064f6cfe85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:37.528095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fe7fc1a-1237-4a6c-a897-f4064f6cfe85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:37.652926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1fe7fc1a-1237-4a6c-a897-f4064f6cfe85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:37.660756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1fe7fc1a-1237-4a6c-a897-f4064f6cfe85 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145644 Aug 06 12:55:37.661323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1199/2402] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:37 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:38.329266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-093eadec-c542-4c87-994a-c0e229bdfcbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:38.329870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-093eadec-c542-4c87-994a-c0e229bdfcbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:38.336264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-093eadec-c542-4c87-994a-c0e229bdfcbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:38.336822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-093eadec-c542-4c87-994a-c0e229bdfcbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:38.337196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-093eadec-c542-4c87-994a-c0e229bdfcbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:38.337872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-093eadec-c542-4c87-994a-c0e229bdfcbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:38.338320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-093eadec-c542-4c87-994a-c0e229bdfcbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:38.338737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-093eadec-c542-4c87-994a-c0e229bdfcbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:38.451776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:38.452404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:38.458645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:38.459121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:38.459550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:38.460228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:38.461307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:38.461737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:38.468149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-093eadec-c542-4c87-994a-c0e229bdfcbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:38.470403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:38.477313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-093eadec-c542-4c87-994a-c0e229bdfcbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152363 Aug 06 12:55:38.477886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1204/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:38.524483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:38.532705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:38.534214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:38.535345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-24ef213f-e78a-4b2a-a447-409fb22f1656 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087929 Aug 06 12:55:38.535904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1200/2404] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:38.682242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1e6a5ad1-c608-43ea-9bd6-98d4b1dab4e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:38.682778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1e6a5ad1-c608-43ea-9bd6-98d4b1dab4e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:38.689339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e6a5ad1-c608-43ea-9bd6-98d4b1dab4e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:38.689815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e6a5ad1-c608-43ea-9bd6-98d4b1dab4e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:38.690249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e6a5ad1-c608-43ea-9bd6-98d4b1dab4e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:38.690929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e6a5ad1-c608-43ea-9bd6-98d4b1dab4e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:38.691379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e6a5ad1-c608-43ea-9bd6-98d4b1dab4e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:38.691803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e6a5ad1-c608-43ea-9bd6-98d4b1dab4e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:38.822207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e6a5ad1-c608-43ea-9bd6-98d4b1dab4e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:38.830970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1e6a5ad1-c608-43ea-9bd6-98d4b1dab4e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152573 Aug 06 12:55:38.831564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1205/2405] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:38 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:39.497794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7e8a8292-d823-4ff2-b823-7edf073c7cea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:39.498407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7e8a8292-d823-4ff2-b823-7edf073c7cea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:39.504871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e8a8292-d823-4ff2-b823-7edf073c7cea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:39.505346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e8a8292-d823-4ff2-b823-7edf073c7cea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:39.505779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e8a8292-d823-4ff2-b823-7edf073c7cea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:39.506492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e8a8292-d823-4ff2-b823-7edf073c7cea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:39.506943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e8a8292-d823-4ff2-b823-7edf073c7cea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:39.507396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e8a8292-d823-4ff2-b823-7edf073c7cea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:39.558891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:39.559588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:39.566154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:39.566721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:39.567221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:39.567976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:39.568466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:39.568889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:39.629934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:39.638714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7e8a8292-d823-4ff2-b823-7edf073c7cea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:39.638922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:39.640455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:39.641631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8ae86c65-b383-418d-80f3-3c9ce8195249 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086658 Aug 06 12:55:39.642187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1206/2406] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:39.646492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7e8a8292-d823-4ff2-b823-7edf073c7cea tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152531 Aug 06 12:55:39.647041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1201/2407] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:39 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:39.852506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fa773e01-838f-4e2c-a030-7cc9153ab931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:39.853116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fa773e01-838f-4e2c-a030-7cc9153ab931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:39.859038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa773e01-838f-4e2c-a030-7cc9153ab931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:39.859764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa773e01-838f-4e2c-a030-7cc9153ab931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:39.860194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa773e01-838f-4e2c-a030-7cc9153ab931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:39.860894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa773e01-838f-4e2c-a030-7cc9153ab931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:39.861342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa773e01-838f-4e2c-a030-7cc9153ab931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:39.861761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa773e01-838f-4e2c-a030-7cc9153ab931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:39.988841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fa773e01-838f-4e2c-a030-7cc9153ab931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:39.996795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fa773e01-838f-4e2c-a030-7cc9153ab931 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148131 Aug 06 12:55:39.997865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1207/2408] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:39 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:40.666292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:40.666893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:40.667881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-63cfd95c-6fe9-4996-807a-c693e4717d95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:40.668518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-63cfd95c-6fe9-4996-807a-c693e4717d95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:40.673446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:40.673921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:40.674350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:40.675033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:40.675477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:40.675653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63cfd95c-6fe9-4996-807a-c693e4717d95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:40.675893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:40.676108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63cfd95c-6fe9-4996-807a-c693e4717d95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:40.676560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63cfd95c-6fe9-4996-807a-c693e4717d95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:40.677258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63cfd95c-6fe9-4996-807a-c693e4717d95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:40.677700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63cfd95c-6fe9-4996-807a-c693e4717d95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:40.678115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63cfd95c-6fe9-4996-807a-c693e4717d95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:40.739506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:40.748739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:40.750471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:40.751622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e6addd8e-cde2-4cde-b446-dac47986de42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089621 Aug 06 12:55:40.752198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1202/2409] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:40.807346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-63cfd95c-6fe9-4996-807a-c693e4717d95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:40.815226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-63cfd95c-6fe9-4996-807a-c693e4717d95 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151122 Aug 06 12:55:40.815779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1208/2410] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:40 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:41.018205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7593c959-5b85-4980-8926-05c6cbfe35cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:41.018819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7593c959-5b85-4980-8926-05c6cbfe35cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:41.024736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7593c959-5b85-4980-8926-05c6cbfe35cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:41.025220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7593c959-5b85-4980-8926-05c6cbfe35cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:41.025660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7593c959-5b85-4980-8926-05c6cbfe35cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:41.026342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7593c959-5b85-4980-8926-05c6cbfe35cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:41.026798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7593c959-5b85-4980-8926-05c6cbfe35cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:41.027224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7593c959-5b85-4980-8926-05c6cbfe35cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:41.155730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7593c959-5b85-4980-8926-05c6cbfe35cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:41.163758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7593c959-5b85-4980-8926-05c6cbfe35cc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149374 Aug 06 12:55:41.164417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1203/2411] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:41 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:41.774136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:41.774719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:41.781206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:41.781680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:41.782107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:41.782778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:41.783222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:41.783632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:41.836805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-916b86c0-2358-4811-b619-b51a2128de8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:41.837433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-916b86c0-2358-4811-b619-b51a2128de8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:41.843773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-916b86c0-2358-4811-b619-b51a2128de8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:41.844248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-916b86c0-2358-4811-b619-b51a2128de8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:41.844703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-916b86c0-2358-4811-b619-b51a2128de8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:41.845384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-916b86c0-2358-4811-b619-b51a2128de8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:41.845492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:41.845831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-916b86c0-2358-4811-b619-b51a2128de8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:41.846248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-916b86c0-2358-4811-b619-b51a2128de8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:41.850192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:41.854434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:41.855931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:41.857086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7d07addc-d523-4f50-99b8-4f7649ea36d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086836 Aug 06 12:55:41.857639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1209/2412] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:41.976561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-916b86c0-2358-4811-b619-b51a2128de8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:41.985103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-916b86c0-2358-4811-b619-b51a2128de8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152208 Aug 06 12:55:41.985669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1204/2413] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:41 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:42.185485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0ff28fc2-788c-4b2e-b481-5fbe83493cd0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:42.186086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0ff28fc2-788c-4b2e-b481-5fbe83493cd0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:42.191957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ff28fc2-788c-4b2e-b481-5fbe83493cd0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:42.192479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ff28fc2-788c-4b2e-b481-5fbe83493cd0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:42.192909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ff28fc2-788c-4b2e-b481-5fbe83493cd0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:42.193583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ff28fc2-788c-4b2e-b481-5fbe83493cd0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:42.194028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ff28fc2-788c-4b2e-b481-5fbe83493cd0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:42.194447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ff28fc2-788c-4b2e-b481-5fbe83493cd0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:42.324179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0ff28fc2-788c-4b2e-b481-5fbe83493cd0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:42.332014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0ff28fc2-788c-4b2e-b481-5fbe83493cd0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150951 Aug 06 12:55:42.332618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1210/2414] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:42 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:42.349091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:55:42.349281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:55:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:55:42.823342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:55:42.823910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:55:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:55:42.878874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:42.879474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:42.885803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:42.886301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:42.886727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:42.887402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:42.888356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:42.888770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:42.947783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:42.956415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:42.957899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:42.959015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a9c09898-360a-4974-a42e-655129a104b6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084041 Aug 06 12:55:42.959562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1205/2415] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:43.006695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fafeef69-53ed-4245-8fba-4e27b862c1cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:43.007293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fafeef69-53ed-4245-8fba-4e27b862c1cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:43.014334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fafeef69-53ed-4245-8fba-4e27b862c1cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:43.014807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fafeef69-53ed-4245-8fba-4e27b862c1cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:43.015233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fafeef69-53ed-4245-8fba-4e27b862c1cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:43.015910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fafeef69-53ed-4245-8fba-4e27b862c1cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:43.016381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fafeef69-53ed-4245-8fba-4e27b862c1cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:43.016798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fafeef69-53ed-4245-8fba-4e27b862c1cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:43.146104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fafeef69-53ed-4245-8fba-4e27b862c1cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:43.154091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fafeef69-53ed-4245-8fba-4e27b862c1cc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151334 Aug 06 12:55:43.154637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1211/2416] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:43.353563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d1eff785-e473-4f39-b71d-cdb5d9dddedb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:43.354092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d1eff785-e473-4f39-b71d-cdb5d9dddedb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:43.360292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1eff785-e473-4f39-b71d-cdb5d9dddedb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:43.360797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1eff785-e473-4f39-b71d-cdb5d9dddedb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:43.361220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1eff785-e473-4f39-b71d-cdb5d9dddedb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:43.361897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1eff785-e473-4f39-b71d-cdb5d9dddedb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:43.362341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1eff785-e473-4f39-b71d-cdb5d9dddedb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:43.362755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1eff785-e473-4f39-b71d-cdb5d9dddedb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:43.491095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d1eff785-e473-4f39-b71d-cdb5d9dddedb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:43.499762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d1eff785-e473-4f39-b71d-cdb5d9dddedb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150242 Aug 06 12:55:43.500408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1206/2417] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:43 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:43.982334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:43.982922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:43.989105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:43.989585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:43.990025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:43.990709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:43.991160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:43.991585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:44.052186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:44.060476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:44.061955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:44.063062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f0cdaa2d-22c7-43bc-9f93-6e4900f1e803 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085301 Aug 06 12:55:44.063608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1212/2418] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:44.174023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c8344aea-c81a-4dee-b80d-1f1ec53ca3c0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:44.174639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c8344aea-c81a-4dee-b80d-1f1ec53ca3c0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:44.180980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8344aea-c81a-4dee-b80d-1f1ec53ca3c0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:44.181457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8344aea-c81a-4dee-b80d-1f1ec53ca3c0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:44.181888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8344aea-c81a-4dee-b80d-1f1ec53ca3c0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:44.182570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8344aea-c81a-4dee-b80d-1f1ec53ca3c0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:44.183020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8344aea-c81a-4dee-b80d-1f1ec53ca3c0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:44.183440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8344aea-c81a-4dee-b80d-1f1ec53ca3c0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:44.311903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c8344aea-c81a-4dee-b80d-1f1ec53ca3c0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:44.319702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c8344aea-c81a-4dee-b80d-1f1ec53ca3c0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149495 Aug 06 12:55:44.320265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1207/2419] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:44.521168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-75410ae8-e0a9-4f33-8ca1-66bfe8628725 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:44.521696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-75410ae8-e0a9-4f33-8ca1-66bfe8628725 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:44.527510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75410ae8-e0a9-4f33-8ca1-66bfe8628725 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:44.527977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75410ae8-e0a9-4f33-8ca1-66bfe8628725 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:44.528432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75410ae8-e0a9-4f33-8ca1-66bfe8628725 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:44.529105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75410ae8-e0a9-4f33-8ca1-66bfe8628725 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:44.529547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75410ae8-e0a9-4f33-8ca1-66bfe8628725 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:44.529992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75410ae8-e0a9-4f33-8ca1-66bfe8628725 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:44.656447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75410ae8-e0a9-4f33-8ca1-66bfe8628725 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:44.664122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-75410ae8-e0a9-4f33-8ca1-66bfe8628725 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146836 Aug 06 12:55:44.664699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1213/2420] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:44 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:45.085212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:45.085815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:45.092006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:45.092453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:45.092888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:45.093580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:45.094034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:45.094457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:45.154645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:45.162876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:45.164357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:45.165477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-861beb10-a2ed-4ec8-af9a-a011aa149a29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084177 Aug 06 12:55:45.166015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1208/2421] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:45.341693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bc9de85b-64dd-4215-a50d-2d1ab22a1427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:45.342353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bc9de85b-64dd-4215-a50d-2d1ab22a1427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:45.348674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc9de85b-64dd-4215-a50d-2d1ab22a1427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:45.349175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc9de85b-64dd-4215-a50d-2d1ab22a1427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:45.349636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc9de85b-64dd-4215-a50d-2d1ab22a1427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:45.350310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc9de85b-64dd-4215-a50d-2d1ab22a1427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:45.350759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc9de85b-64dd-4215-a50d-2d1ab22a1427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:45.351178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc9de85b-64dd-4215-a50d-2d1ab22a1427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:45.476776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bc9de85b-64dd-4215-a50d-2d1ab22a1427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:45.485480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bc9de85b-64dd-4215-a50d-2d1ab22a1427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148176 Aug 06 12:55:45.486010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1214/2422] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:45.684791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d954aa2e-93ec-4294-82a4-435d2a45371a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:45.685378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d954aa2e-93ec-4294-82a4-435d2a45371a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:45.691730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d954aa2e-93ec-4294-82a4-435d2a45371a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:45.692204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d954aa2e-93ec-4294-82a4-435d2a45371a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:45.692658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d954aa2e-93ec-4294-82a4-435d2a45371a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:45.693332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d954aa2e-93ec-4294-82a4-435d2a45371a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:45.693778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d954aa2e-93ec-4294-82a4-435d2a45371a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:45.694194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d954aa2e-93ec-4294-82a4-435d2a45371a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:45.821448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d954aa2e-93ec-4294-82a4-435d2a45371a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:45.829793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d954aa2e-93ec-4294-82a4-435d2a45371a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148862 Aug 06 12:55:45.830351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1209/2423] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:45 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:46.188759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:46.189366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:46.195845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:46.196353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:46.196794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:46.197472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:46.197924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:46.198347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:46.261850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:46.270789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:46.272282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:46.273430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bac5bcc6-2106-4288-aa9e-24ac3010fa94 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089184 Aug 06 12:55:46.273987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1215/2424] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:46.506093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2cf42be1-981b-4b87-91f0-1310544b9158 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:46.506698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2cf42be1-981b-4b87-91f0-1310544b9158 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:46.512793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cf42be1-981b-4b87-91f0-1310544b9158 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:46.513207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cf42be1-981b-4b87-91f0-1310544b9158 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:46.513631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cf42be1-981b-4b87-91f0-1310544b9158 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:46.514305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cf42be1-981b-4b87-91f0-1310544b9158 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:46.514751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cf42be1-981b-4b87-91f0-1310544b9158 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:46.515168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cf42be1-981b-4b87-91f0-1310544b9158 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:46.640493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2cf42be1-981b-4b87-91f0-1310544b9158 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:46.648240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2cf42be1-981b-4b87-91f0-1310544b9158 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145959 Aug 06 12:55:46.648823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1210/2425] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:46.850563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-377350ec-615b-418e-9d3e-2bdcf4442d61 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:46.851162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-377350ec-615b-418e-9d3e-2bdcf4442d61 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:46.857841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-377350ec-615b-418e-9d3e-2bdcf4442d61 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:46.858321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-377350ec-615b-418e-9d3e-2bdcf4442d61 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:46.858782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-377350ec-615b-418e-9d3e-2bdcf4442d61 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:46.859756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-377350ec-615b-418e-9d3e-2bdcf4442d61 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:46.860210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-377350ec-615b-418e-9d3e-2bdcf4442d61 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:46.860664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-377350ec-615b-418e-9d3e-2bdcf4442d61 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:46.985894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-377350ec-615b-418e-9d3e-2bdcf4442d61 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:46.993878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-377350ec-615b-418e-9d3e-2bdcf4442d61 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147090 Aug 06 12:55:46.994635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1216/2426] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:46 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:47.295935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:47.296566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:47.303036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:47.303511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:47.303940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:47.304637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:47.305086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:47.305500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:47.365912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:47.374063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:47.375540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:47.376713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-24932bfb-57f5-4790-ad2e-7f14f0822077 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084687 Aug 06 12:55:47.377257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1211/2427] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:47.669025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dcced29b-3208-495c-8a51-1ec603da9049 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:47.669624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dcced29b-3208-495c-8a51-1ec603da9049 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:47.675905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcced29b-3208-495c-8a51-1ec603da9049 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:47.676404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcced29b-3208-495c-8a51-1ec603da9049 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:47.676830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcced29b-3208-495c-8a51-1ec603da9049 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:47.677498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcced29b-3208-495c-8a51-1ec603da9049 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:47.677940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcced29b-3208-495c-8a51-1ec603da9049 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:47.678352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dcced29b-3208-495c-8a51-1ec603da9049 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:47.802538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dcced29b-3208-495c-8a51-1ec603da9049 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:47.810806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dcced29b-3208-495c-8a51-1ec603da9049 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145634 Aug 06 12:55:47.811349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1217/2428] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:48.014997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f8564266-6cac-492b-bc9b-c3d6da93675d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:48.015598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f8564266-6cac-492b-bc9b-c3d6da93675d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:48.021489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8564266-6cac-492b-bc9b-c3d6da93675d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:48.021970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8564266-6cac-492b-bc9b-c3d6da93675d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:48.022395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8564266-6cac-492b-bc9b-c3d6da93675d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:48.023096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8564266-6cac-492b-bc9b-c3d6da93675d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:48.023540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8564266-6cac-492b-bc9b-c3d6da93675d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:48.023954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8564266-6cac-492b-bc9b-c3d6da93675d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:48.157983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f8564266-6cac-492b-bc9b-c3d6da93675d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:48.165860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f8564266-6cac-492b-bc9b-c3d6da93675d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154768 Aug 06 12:55:48.166439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1212/2429] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:48 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:48.399104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:48.399699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:48.406220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:48.406692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:48.407122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:48.407790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:48.408228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:48.408667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:48.470621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:48.478790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:48.480266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:48.482076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bf93be45-3606-426c-87e8-03075dc60a7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086191 Aug 06 12:55:48.482624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1218/2430] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:48.831481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c788ecd3-622e-44d5-bad1-d7733471f686 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:48.832220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c788ecd3-622e-44d5-bad1-d7733471f686 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:48.838470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c788ecd3-622e-44d5-bad1-d7733471f686 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:48.838943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c788ecd3-622e-44d5-bad1-d7733471f686 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:48.839372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c788ecd3-622e-44d5-bad1-d7733471f686 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:48.840049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c788ecd3-622e-44d5-bad1-d7733471f686 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:48.841511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c788ecd3-622e-44d5-bad1-d7733471f686 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:48.841939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c788ecd3-622e-44d5-bad1-d7733471f686 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:48.967961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c788ecd3-622e-44d5-bad1-d7733471f686 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:48.975733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c788ecd3-622e-44d5-bad1-d7733471f686 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148205 Aug 06 12:55:48.976290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1213/2431] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:49.187526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b38e25d3-1273-4830-aeaf-6199ee29ee91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:49.188050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b38e25d3-1273-4830-aeaf-6199ee29ee91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:49.194402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b38e25d3-1273-4830-aeaf-6199ee29ee91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:49.194878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b38e25d3-1273-4830-aeaf-6199ee29ee91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:49.195321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b38e25d3-1273-4830-aeaf-6199ee29ee91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:49.195982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b38e25d3-1273-4830-aeaf-6199ee29ee91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:49.196531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b38e25d3-1273-4830-aeaf-6199ee29ee91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:49.196954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b38e25d3-1273-4830-aeaf-6199ee29ee91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:49.323829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b38e25d3-1273-4830-aeaf-6199ee29ee91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:49.332361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b38e25d3-1273-4830-aeaf-6199ee29ee91 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149255 Aug 06 12:55:49.332918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1219/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:49 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:49.504405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:49.504949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:49.510847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:49.511322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:49.511750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:49.512456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:49.512907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:49.513353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:49.572532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:49.580994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:49.582482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:49.583608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-08d1fd3c-70b2-41ac-a645-ade2034b60c5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083163 Aug 06 12:55:49.584156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1214/2433] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:49.997147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-904b469e-87a0-4cd1-a402-900c779b6239 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:49.997742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-904b469e-87a0-4cd1-a402-900c779b6239 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:50.003874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904b469e-87a0-4cd1-a402-900c779b6239 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:50.004378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904b469e-87a0-4cd1-a402-900c779b6239 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:50.004805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904b469e-87a0-4cd1-a402-900c779b6239 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:50.005480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904b469e-87a0-4cd1-a402-900c779b6239 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:50.005923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904b469e-87a0-4cd1-a402-900c779b6239 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:50.006337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-904b469e-87a0-4cd1-a402-900c779b6239 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:50.130987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-904b469e-87a0-4cd1-a402-900c779b6239 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:50.139305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-904b469e-87a0-4cd1-a402-900c779b6239 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146022 Aug 06 12:55:50.139863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1220/2434] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:50.353481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-457b6d70-f894-4b05-8118-7e33bb83c0e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:50.354095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-457b6d70-f894-4b05-8118-7e33bb83c0e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:50.360999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-457b6d70-f894-4b05-8118-7e33bb83c0e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:50.361486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-457b6d70-f894-4b05-8118-7e33bb83c0e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:50.361922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-457b6d70-f894-4b05-8118-7e33bb83c0e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:50.362610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-457b6d70-f894-4b05-8118-7e33bb83c0e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:50.363069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-457b6d70-f894-4b05-8118-7e33bb83c0e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:50.363488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-457b6d70-f894-4b05-8118-7e33bb83c0e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:50.491870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-457b6d70-f894-4b05-8118-7e33bb83c0e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:50.500215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-457b6d70-f894-4b05-8118-7e33bb83c0e3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150538 Aug 06 12:55:50.500812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1215/2435] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:50 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:50.604763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:50.605304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:50.611780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:50.612252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:50.612704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:50.613381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:50.613827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:50.614245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:50.629134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:50.678130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:50.686879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:50.688403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:50.689523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ba6293dc-ff83-4b08-9835-4c8568ecf860 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088694 Aug 06 12:55:50.690078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1221/2436] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:51.161201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-827d1f21-60c1-4534-80b8-1a6368164e27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:51.161809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-827d1f21-60c1-4534-80b8-1a6368164e27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:51.167704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-827d1f21-60c1-4534-80b8-1a6368164e27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:51.168322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-827d1f21-60c1-4534-80b8-1a6368164e27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:51.169266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-827d1f21-60c1-4534-80b8-1a6368164e27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:51.169942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-827d1f21-60c1-4534-80b8-1a6368164e27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:51.170391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-827d1f21-60c1-4534-80b8-1a6368164e27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:51.170811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-827d1f21-60c1-4534-80b8-1a6368164e27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:51.296661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-827d1f21-60c1-4534-80b8-1a6368164e27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:51.304461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-827d1f21-60c1-4534-80b8-1a6368164e27 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147050 Aug 06 12:55:51.305046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1216/2437] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:51.521712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cc2145b2-4f00-4e62-901a-01d20e297a23 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:51.522338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cc2145b2-4f00-4e62-901a-01d20e297a23 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:51.528776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc2145b2-4f00-4e62-901a-01d20e297a23 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:51.529250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc2145b2-4f00-4e62-901a-01d20e297a23 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:51.529677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc2145b2-4f00-4e62-901a-01d20e297a23 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:51.530348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc2145b2-4f00-4e62-901a-01d20e297a23 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:51.530794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc2145b2-4f00-4e62-901a-01d20e297a23 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:51.531213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc2145b2-4f00-4e62-901a-01d20e297a23 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:51.656473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cc2145b2-4f00-4e62-901a-01d20e297a23 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:51.665065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cc2145b2-4f00-4e62-901a-01d20e297a23 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147219 Aug 06 12:55:51.665624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1222/2438] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:51 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:51.712465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:51.713063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:51.719938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:51.720444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:51.720874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:51.721548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:51.721994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:51.722414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:51.783522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:51.794359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:51.794359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:51.795171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aaddb6f5-2546-40b1-a3cf-b72bef1d65d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086524 Aug 06 12:55:51.795741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1217/2439] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:52.325843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eb073b5b-76a1-4768-934b-b42e34eea0c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:52.326438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eb073b5b-76a1-4768-934b-b42e34eea0c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:52.332223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb073b5b-76a1-4768-934b-b42e34eea0c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:52.333000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb073b5b-76a1-4768-934b-b42e34eea0c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:52.333733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb073b5b-76a1-4768-934b-b42e34eea0c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:52.334434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb073b5b-76a1-4768-934b-b42e34eea0c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:52.334879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb073b5b-76a1-4768-934b-b42e34eea0c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:52.335295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb073b5b-76a1-4768-934b-b42e34eea0c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:52.466699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eb073b5b-76a1-4768-934b-b42e34eea0c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:52.474458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eb073b5b-76a1-4768-934b-b42e34eea0c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.153075 Aug 06 12:55:52.475005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1223/2440] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:52 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:52.686297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1733e0cb-2420-4c49-908f-954b9460c949 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:52.686826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1733e0cb-2420-4c49-908f-954b9460c949 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:52.692838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1733e0cb-2420-4c49-908f-954b9460c949 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:52.693320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1733e0cb-2420-4c49-908f-954b9460c949 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:52.693756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1733e0cb-2420-4c49-908f-954b9460c949 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:52.694436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1733e0cb-2420-4c49-908f-954b9460c949 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:52.694888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1733e0cb-2420-4c49-908f-954b9460c949 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:52.695310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1733e0cb-2420-4c49-908f-954b9460c949 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:52.819220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:52.819901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:52.826312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:52.826795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:52.827230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:52.827915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:52.828391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:52.828817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:52.831729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1733e0cb-2420-4c49-908f-954b9460c949 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:52.839511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1733e0cb-2420-4c49-908f-954b9460c949 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.157599 Aug 06 12:55:52.840065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1218/2441] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:52 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:52.892689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:52.900921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:52.902417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:52.904031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5315937d-3cce-4b22-a486-f893c34e6347 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088770 Aug 06 12:55:52.904619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1224/2442] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:53.496161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aeecf2df-8a6d-4154-93fb-06c82d68a434 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:53.497307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aeecf2df-8a6d-4154-93fb-06c82d68a434 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:53.503182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aeecf2df-8a6d-4154-93fb-06c82d68a434 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:53.503655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aeecf2df-8a6d-4154-93fb-06c82d68a434 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:53.504121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aeecf2df-8a6d-4154-93fb-06c82d68a434 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:53.504821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aeecf2df-8a6d-4154-93fb-06c82d68a434 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:53.505267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aeecf2df-8a6d-4154-93fb-06c82d68a434 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:53.505684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aeecf2df-8a6d-4154-93fb-06c82d68a434 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:53.631467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aeecf2df-8a6d-4154-93fb-06c82d68a434 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:53.639794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aeecf2df-8a6d-4154-93fb-06c82d68a434 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147423 Aug 06 12:55:53.640371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1219/2443] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:53 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:53.861624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2e81df5b-31fd-41cc-81c4-2676d0a3cbf8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:53.862226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2e81df5b-31fd-41cc-81c4-2676d0a3cbf8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:53.868604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e81df5b-31fd-41cc-81c4-2676d0a3cbf8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:53.869079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e81df5b-31fd-41cc-81c4-2676d0a3cbf8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:53.869508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e81df5b-31fd-41cc-81c4-2676d0a3cbf8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:53.870182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e81df5b-31fd-41cc-81c4-2676d0a3cbf8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:53.870658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e81df5b-31fd-41cc-81c4-2676d0a3cbf8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:53.871077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e81df5b-31fd-41cc-81c4-2676d0a3cbf8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:53.926884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:53.927604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:53.933829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:53.934858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:53.935288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:53.935962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:53.936433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:53.936856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:53.999808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:54.002039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:54.003926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e81df5b-31fd-41cc-81c4-2676d0a3cbf8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:54.009662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:54.011147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:54.011691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2e81df5b-31fd-41cc-81c4-2676d0a3cbf8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154210 Aug 06 12:55:54.012275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1225/2444] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:53 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:54.012433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-304a3df6-26c7-445e-b58c-0e8cb7438788 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089242 Aug 06 12:55:54.012854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1220/2445] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:54.660828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fe387d73-9470-41c3-b8f9-abb37892bbc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:54.661430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fe387d73-9470-41c3-b8f9-abb37892bbc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:54.667305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe387d73-9470-41c3-b8f9-abb37892bbc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:54.667781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe387d73-9470-41c3-b8f9-abb37892bbc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:54.668212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe387d73-9470-41c3-b8f9-abb37892bbc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:54.668915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe387d73-9470-41c3-b8f9-abb37892bbc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:54.669363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe387d73-9470-41c3-b8f9-abb37892bbc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:54.669780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe387d73-9470-41c3-b8f9-abb37892bbc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:54.797709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fe387d73-9470-41c3-b8f9-abb37892bbc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:54.805683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fe387d73-9470-41c3-b8f9-abb37892bbc8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148698 Aug 06 12:55:54.806240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1226/2446] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:54 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:55.033247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7c79825a-8d52-4990-a7e6-437f85bcf714 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:55.034072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7c79825a-8d52-4990-a7e6-437f85bcf714 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:55.036335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:55.036790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:55.042059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c79825a-8d52-4990-a7e6-437f85bcf714 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:55.042540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c79825a-8d52-4990-a7e6-437f85bcf714 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:55.042965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c79825a-8d52-4990-a7e6-437f85bcf714 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:55.043660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c79825a-8d52-4990-a7e6-437f85bcf714 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:55.044105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c79825a-8d52-4990-a7e6-437f85bcf714 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:55.044544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c79825a-8d52-4990-a7e6-437f85bcf714 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:55.045735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:55.046223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:55.047794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:55.047794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:55.047794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:55.048255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:55.116077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:55.124939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:55.126417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:55.127644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ffa77fbc-3788-4eb4-9ed7-fe69070f7adf tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.096536 Aug 06 12:55:55.128102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1227/2447] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:55:55.176904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7c79825a-8d52-4990-a7e6-437f85bcf714 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:55.185108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7c79825a-8d52-4990-a7e6-437f85bcf714 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.155984 Aug 06 12:55:55.185659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1221/2448] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:55 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:55.826691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-72608cbd-0a71-4e2e-8c51-c5861b205873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:55.827285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-72608cbd-0a71-4e2e-8c51-c5861b205873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:55.833111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72608cbd-0a71-4e2e-8c51-c5861b205873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:55.833586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72608cbd-0a71-4e2e-8c51-c5861b205873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:55.834010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72608cbd-0a71-4e2e-8c51-c5861b205873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:55.834687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72608cbd-0a71-4e2e-8c51-c5861b205873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:55.835130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72608cbd-0a71-4e2e-8c51-c5861b205873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:55.835548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72608cbd-0a71-4e2e-8c51-c5861b205873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:55.960508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-72608cbd-0a71-4e2e-8c51-c5861b205873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:55.968750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-72608cbd-0a71-4e2e-8c51-c5861b205873 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145907 Aug 06 12:55:55.969297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1228/2449] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:55 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:56.150268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:56.150800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:56.153706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=78 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:56.158967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:56.159451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:56.159888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:56.160607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:56.161063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:56.161489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:56.206460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-72a3e051-a6a0-485b-89a3-cf2de635f6a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:56.207066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-72a3e051-a6a0-485b-89a3-cf2de635f6a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:56.213417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72a3e051-a6a0-485b-89a3-cf2de635f6a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:56.213894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72a3e051-a6a0-485b-89a3-cf2de635f6a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:56.214324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72a3e051-a6a0-485b-89a3-cf2de635f6a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:56.215009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72a3e051-a6a0-485b-89a3-cf2de635f6a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:56.216035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72a3e051-a6a0-485b-89a3-cf2de635f6a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:56.216493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72a3e051-a6a0-485b-89a3-cf2de635f6a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:56.222440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:56.230839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:56.232360 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:56.233505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f8e7a1fa-b572-4a62-a240-88dc9414d214 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087247 Aug 06 12:55:56.234330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1222/2450] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:56 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:56.345349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-72a3e051-a6a0-485b-89a3-cf2de635f6a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:56.353178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-72a3e051-a6a0-485b-89a3-cf2de635f6a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150558 Aug 06 12:55:56.353738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1229/2451] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:56 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:55:56.989820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0e73f0ae-7d49-4c9d-9112-5bedecd594ef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:56.990425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0e73f0ae-7d49-4c9d-9112-5bedecd594ef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:56.997258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e73f0ae-7d49-4c9d-9112-5bedecd594ef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:56.997732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e73f0ae-7d49-4c9d-9112-5bedecd594ef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:56.998159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e73f0ae-7d49-4c9d-9112-5bedecd594ef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:56.998851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e73f0ae-7d49-4c9d-9112-5bedecd594ef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:56.999298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e73f0ae-7d49-4c9d-9112-5bedecd594ef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:56.999716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e73f0ae-7d49-4c9d-9112-5bedecd594ef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:57.127517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0e73f0ae-7d49-4c9d-9112-5bedecd594ef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:57.135449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0e73f0ae-7d49-4c9d-9112-5bedecd594ef tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149455 Aug 06 12:55:57.136009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1223/2452] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:57.256291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:57.256868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:57.259151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=80 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:55:57.264334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:57.264806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:57.265251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:57.265909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:57.266357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:57.266775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:57.330731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:57.338989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:57.340988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:57.342109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-423ecd45-b137-408d-88c3-8156aee244a0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089841 Aug 06 12:55:57.342659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1230/2453] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:57.374620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-99c362ee-2a97-4437-bcf5-624a52b672d3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:57.375228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-99c362ee-2a97-4437-bcf5-624a52b672d3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:57.381670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99c362ee-2a97-4437-bcf5-624a52b672d3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:57.382149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99c362ee-2a97-4437-bcf5-624a52b672d3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:57.382582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99c362ee-2a97-4437-bcf5-624a52b672d3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:57.383274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99c362ee-2a97-4437-bcf5-624a52b672d3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:57.383722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99c362ee-2a97-4437-bcf5-624a52b672d3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:57.384143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99c362ee-2a97-4437-bcf5-624a52b672d3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:57.509832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-99c362ee-2a97-4437-bcf5-624a52b672d3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:57.517661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-99c362ee-2a97-4437-bcf5-624a52b672d3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147024 Aug 06 12:55:57.518346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1224/2454] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:57 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:58.156272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-65eac03a-820a-4794-91db-eb0d1b0c9907 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:58.156895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-65eac03a-820a-4794-91db-eb0d1b0c9907 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:58.162784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65eac03a-820a-4794-91db-eb0d1b0c9907 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:58.163261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65eac03a-820a-4794-91db-eb0d1b0c9907 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:58.163694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65eac03a-820a-4794-91db-eb0d1b0c9907 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:58.164401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65eac03a-820a-4794-91db-eb0d1b0c9907 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:58.164854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65eac03a-820a-4794-91db-eb0d1b0c9907 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:58.165307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65eac03a-820a-4794-91db-eb0d1b0c9907 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:58.289046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-65eac03a-820a-4794-91db-eb0d1b0c9907 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:58.296869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-65eac03a-820a-4794-91db-eb0d1b0c9907 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.144424 Aug 06 12:55:58.297425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1231/2455] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:58.364615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:58.365212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:58.371169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:58.372142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:58.372633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:58.373319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:58.373770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:58.374192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:58.436932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:58.445095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:58.446585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:58.447740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0b3d35a7-8f3a-454d-a75e-5664495d1248 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086927 Aug 06 12:55:58.448295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1225/2456] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:58.538155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2d7c2203-e88c-41b9-b488-0b502c349cc5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:58.538720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2d7c2203-e88c-41b9-b488-0b502c349cc5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:58.545473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7c2203-e88c-41b9-b488-0b502c349cc5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:58.545953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7c2203-e88c-41b9-b488-0b502c349cc5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:58.546382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7c2203-e88c-41b9-b488-0b502c349cc5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:58.547061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7c2203-e88c-41b9-b488-0b502c349cc5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:58.547543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7c2203-e88c-41b9-b488-0b502c349cc5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:58.547965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7c2203-e88c-41b9-b488-0b502c349cc5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:58.674524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2d7c2203-e88c-41b9-b488-0b502c349cc5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:58.682319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2d7c2203-e88c-41b9-b488-0b502c349cc5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147996 Aug 06 12:55:58.682877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1232/2457] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:58 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:59.318227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5ea947cd-8ed7-4b51-aa09-cec7dc00a732 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:59.318824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5ea947cd-8ed7-4b51-aa09-cec7dc00a732 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:59.324729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea947cd-8ed7-4b51-aa09-cec7dc00a732 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:59.325202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea947cd-8ed7-4b51-aa09-cec7dc00a732 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:59.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea947cd-8ed7-4b51-aa09-cec7dc00a732 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:59.326296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea947cd-8ed7-4b51-aa09-cec7dc00a732 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:59.326739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea947cd-8ed7-4b51-aa09-cec7dc00a732 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:59.327154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea947cd-8ed7-4b51-aa09-cec7dc00a732 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:59.454953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5ea947cd-8ed7-4b51-aa09-cec7dc00a732 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:59.462983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5ea947cd-8ed7-4b51-aa09-cec7dc00a732 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148597 Aug 06 12:55:59.463573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1226/2458] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:55:59.469926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:59.470532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:59.476882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:59.477360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:59.477790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:59.478462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:59.478911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:59.479328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:59.540818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:59.549697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:59.551170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:59.552345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-08085467-9388-4f70-8c51-f7a257233c43 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086243 Aug 06 12:55:59.552908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1233/2459] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:55:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:55:59.703730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61c33fb5-bca6-4363-b2b8-d757491e77e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:55:59.704265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61c33fb5-bca6-4363-b2b8-d757491e77e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:55:59.710109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c33fb5-bca6-4363-b2b8-d757491e77e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:59.710581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c33fb5-bca6-4363-b2b8-d757491e77e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:59.711008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c33fb5-bca6-4363-b2b8-d757491e77e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:59.711677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c33fb5-bca6-4363-b2b8-d757491e77e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:55:59.712120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c33fb5-bca6-4363-b2b8-d757491e77e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:55:59.712560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61c33fb5-bca6-4363-b2b8-d757491e77e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:55:59.836734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61c33fb5-bca6-4363-b2b8-d757491e77e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:55:59.844927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61c33fb5-bca6-4363-b2b8-d757491e77e9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145118 Aug 06 12:55:59.845487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1227/2460] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:55:59 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:00.485295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-99ebf47d-96e8-46a8-ac1c-739b7f9943ca tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:00.485893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-99ebf47d-96e8-46a8-ac1c-739b7f9943ca tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:00.492150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99ebf47d-96e8-46a8-ac1c-739b7f9943ca tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:00.492646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99ebf47d-96e8-46a8-ac1c-739b7f9943ca tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:00.493081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99ebf47d-96e8-46a8-ac1c-739b7f9943ca tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:00.493747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99ebf47d-96e8-46a8-ac1c-739b7f9943ca tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:00.494194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99ebf47d-96e8-46a8-ac1c-739b7f9943ca tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:00.494607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99ebf47d-96e8-46a8-ac1c-739b7f9943ca tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:00.574495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:00.575103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:00.581493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:00.581975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:00.582410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:00.583095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:00.583544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:00.583995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:00.620955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-99ebf47d-96e8-46a8-ac1c-739b7f9943ca tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:00.629170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-99ebf47d-96e8-46a8-ac1c-739b7f9943ca tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148513 Aug 06 12:56:00.629741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1234/2461] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:00 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:00.645398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:00.655058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:00.656490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:00.657647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2004bc6b-e60e-4c0d-81b1-e9e3d6a3682a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087063 Aug 06 12:56:00.658264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1228/2462] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:00.866253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7c8f57d4-cd24-4bc9-979b-a8cee2627729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:00.866885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7c8f57d4-cd24-4bc9-979b-a8cee2627729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:00.872724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8f57d4-cd24-4bc9-979b-a8cee2627729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:00.873200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8f57d4-cd24-4bc9-979b-a8cee2627729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:00.873629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8f57d4-cd24-4bc9-979b-a8cee2627729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:00.874305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8f57d4-cd24-4bc9-979b-a8cee2627729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:00.874751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8f57d4-cd24-4bc9-979b-a8cee2627729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:00.875167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c8f57d4-cd24-4bc9-979b-a8cee2627729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:01.004614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7c8f57d4-cd24-4bc9-979b-a8cee2627729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:01.013147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7c8f57d4-cd24-4bc9-979b-a8cee2627729 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150746 Aug 06 12:56:01.013699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1235/2463] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:00 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:01.650337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d12951ce-9bc6-4cff-9319-f16cebbd98a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:01.650949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d12951ce-9bc6-4cff-9319-f16cebbd98a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:01.657359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d12951ce-9bc6-4cff-9319-f16cebbd98a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:01.657844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d12951ce-9bc6-4cff-9319-f16cebbd98a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:01.658275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d12951ce-9bc6-4cff-9319-f16cebbd98a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:01.658953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d12951ce-9bc6-4cff-9319-f16cebbd98a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:01.659405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d12951ce-9bc6-4cff-9319-f16cebbd98a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:01.659825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d12951ce-9bc6-4cff-9319-f16cebbd98a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:01.678890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:01.679482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:01.686272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:01.686752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:01.687165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:01.687834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:01.688274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:01.688715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:01.749959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:01.758433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:01.759971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:01.761275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-154d5980-34b4-474f-8cf7-085cebe9e67a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086260 Aug 06 12:56:01.762015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1236/2464] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:01.789936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d12951ce-9bc6-4cff-9319-f16cebbd98a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:01.798344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d12951ce-9bc6-4cff-9319-f16cebbd98a0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151877 Aug 06 12:56:01.798906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1229/2465] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:01 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:02.034480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-44309584-13be-4a35-8482-891294f28b2d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:02.035080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-44309584-13be-4a35-8482-891294f28b2d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:02.040926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44309584-13be-4a35-8482-891294f28b2d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:02.041398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44309584-13be-4a35-8482-891294f28b2d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:02.041822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44309584-13be-4a35-8482-891294f28b2d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:02.042489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44309584-13be-4a35-8482-891294f28b2d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:02.042930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44309584-13be-4a35-8482-891294f28b2d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:02.043999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44309584-13be-4a35-8482-891294f28b2d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:02.168842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-44309584-13be-4a35-8482-891294f28b2d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:02.176662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-44309584-13be-4a35-8482-891294f28b2d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146004 Aug 06 12:56:02.177217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1237/2466] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:02 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:02.783519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:02.784125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:02.790483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:02.790962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:02.791395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:02.792083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:02.792557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:02.793011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:02.818857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-738d8915-26cd-4bae-8758-dccd1dbe5ceb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:02.819454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-738d8915-26cd-4bae-8758-dccd1dbe5ceb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:02.826735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-738d8915-26cd-4bae-8758-dccd1dbe5ceb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:02.827302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-738d8915-26cd-4bae-8758-dccd1dbe5ceb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:02.827810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-738d8915-26cd-4bae-8758-dccd1dbe5ceb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:02.828610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-738d8915-26cd-4bae-8758-dccd1dbe5ceb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:02.829135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-738d8915-26cd-4bae-8758-dccd1dbe5ceb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:02.829645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-738d8915-26cd-4bae-8758-dccd1dbe5ceb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:02.833890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:02.854503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:02.863220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:02.864738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:02.865874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-25aea14a-99a9-4705-80fe-488ee126db1c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086267 Aug 06 12:56:02.866428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1230/2467] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:02 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:02.959794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-738d8915-26cd-4bae-8758-dccd1dbe5ceb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:02.967668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-738d8915-26cd-4bae-8758-dccd1dbe5ceb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152549 Aug 06 12:56:02.968227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1238/2468] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:02 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:03.197721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90375817-4c6b-43e4-8e70-e4bcbb4fbbf0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:03.198249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90375817-4c6b-43e4-8e70-e4bcbb4fbbf0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:03.204194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90375817-4c6b-43e4-8e70-e4bcbb4fbbf0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:03.204703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90375817-4c6b-43e4-8e70-e4bcbb4fbbf0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:03.205136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90375817-4c6b-43e4-8e70-e4bcbb4fbbf0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:03.205816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90375817-4c6b-43e4-8e70-e4bcbb4fbbf0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:03.206264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90375817-4c6b-43e4-8e70-e4bcbb4fbbf0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:03.206688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90375817-4c6b-43e4-8e70-e4bcbb4fbbf0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:03.330595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90375817-4c6b-43e4-8e70-e4bcbb4fbbf0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:03.338468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90375817-4c6b-43e4-8e70-e4bcbb4fbbf0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.144861 Aug 06 12:56:03.339026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1231/2469] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:03 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:03.889158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:03.889749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:03.895846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:03.896351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:03.896789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:03.897476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:03.897927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:03.898346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:03.961609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:03.970558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:03.972089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:03.973255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5b76b549-cb9a-4eb5-870f-b3f7388c7bc3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088420 Aug 06 12:56:03.973814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1239/2470] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:03.989271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7a1fb731-f666-45be-bb64-19b669171546 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:03.990551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7a1fb731-f666-45be-bb64-19b669171546 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:03.997169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a1fb731-f666-45be-bb64-19b669171546 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:03.997649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a1fb731-f666-45be-bb64-19b669171546 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:03.998081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a1fb731-f666-45be-bb64-19b669171546 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:03.998777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a1fb731-f666-45be-bb64-19b669171546 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:03.999231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a1fb731-f666-45be-bb64-19b669171546 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:03.999659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a1fb731-f666-45be-bb64-19b669171546 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:04.127769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a1fb731-f666-45be-bb64-19b669171546 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:04.135693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7a1fb731-f666-45be-bb64-19b669171546 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150249 Aug 06 12:56:04.136275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1232/2471] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:03 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:04.358863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-379e0d5d-5410-4326-909e-be67970456ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:04.359726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-379e0d5d-5410-4326-909e-be67970456ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:04.365556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379e0d5d-5410-4326-909e-be67970456ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:04.366025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379e0d5d-5410-4326-909e-be67970456ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:04.366478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379e0d5d-5410-4326-909e-be67970456ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:04.367148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379e0d5d-5410-4326-909e-be67970456ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:04.367591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379e0d5d-5410-4326-909e-be67970456ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:04.368004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379e0d5d-5410-4326-909e-be67970456ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:04.491802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-379e0d5d-5410-4326-909e-be67970456ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:04.500159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-379e0d5d-5410-4326-909e-be67970456ac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145081 Aug 06 12:56:04.500748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1240/2472] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:04 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:04.995680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:04.996368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:05.002743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:05.003225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:05.003660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:05.004367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:05.004822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:05.005246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:05.066944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:05.075179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:05.076690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:05.077827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-88ee87f8-bd6b-4b72-8fc5-7511876e45d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086116 Aug 06 12:56:05.078385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1233/2473] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:05.156879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e7546143-dbf9-4a8e-952d-d177cc262bdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:05.157479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e7546143-dbf9-4a8e-952d-d177cc262bdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:05.163983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7546143-dbf9-4a8e-952d-d177cc262bdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:05.164536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7546143-dbf9-4a8e-952d-d177cc262bdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:05.164962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7546143-dbf9-4a8e-952d-d177cc262bdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:05.165631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7546143-dbf9-4a8e-952d-d177cc262bdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:05.166074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7546143-dbf9-4a8e-952d-d177cc262bdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:05.166490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7546143-dbf9-4a8e-952d-d177cc262bdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:05.297002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e7546143-dbf9-4a8e-952d-d177cc262bdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:05.305025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e7546143-dbf9-4a8e-952d-d177cc262bdc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.152614 Aug 06 12:56:05.305588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1241/2474] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:05 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:05.520675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b88f39e7-853f-44d4-8204-c55c7297aba8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:05.521230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b88f39e7-853f-44d4-8204-c55c7297aba8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:05.527052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b88f39e7-853f-44d4-8204-c55c7297aba8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:05.527581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b88f39e7-853f-44d4-8204-c55c7297aba8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:05.528009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b88f39e7-853f-44d4-8204-c55c7297aba8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:05.528708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b88f39e7-853f-44d4-8204-c55c7297aba8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:05.529161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b88f39e7-853f-44d4-8204-c55c7297aba8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:05.529575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b88f39e7-853f-44d4-8204-c55c7297aba8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:05.653179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b88f39e7-853f-44d4-8204-c55c7297aba8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:05.660949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b88f39e7-853f-44d4-8204-c55c7297aba8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.144338 Aug 06 12:56:05.661509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1234/2475] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:05 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:06.100530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:06.101159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:06.107542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:06.108019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:06.108475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:06.109421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:06.109870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:06.110287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:06.172020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:06.180362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:06.181866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:06.182982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-80183553-2175-48aa-af5f-12b6221f9ad6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086348 Aug 06 12:56:06.184161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1242/2476] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:06 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:06.326021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-765f1891-458b-4d66-ab5e-4ae703aac4c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:06.326668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-765f1891-458b-4d66-ab5e-4ae703aac4c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:06.333103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-765f1891-458b-4d66-ab5e-4ae703aac4c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:06.333583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-765f1891-458b-4d66-ab5e-4ae703aac4c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:06.334024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-765f1891-458b-4d66-ab5e-4ae703aac4c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:06.334709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-765f1891-458b-4d66-ab5e-4ae703aac4c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:06.335162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-765f1891-458b-4d66-ab5e-4ae703aac4c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:06.335588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-765f1891-458b-4d66-ab5e-4ae703aac4c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:06.463858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-765f1891-458b-4d66-ab5e-4ae703aac4c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:06.472208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-765f1891-458b-4d66-ab5e-4ae703aac4c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.149985 Aug 06 12:56:06.472798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1235/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:06 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:06.681668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e061db32-0148-40b5-99a8-e789ac2c0c9c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:06.682220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e061db32-0148-40b5-99a8-e789ac2c0c9c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:06.688059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e061db32-0148-40b5-99a8-e789ac2c0c9c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:06.688560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e061db32-0148-40b5-99a8-e789ac2c0c9c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:06.688989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e061db32-0148-40b5-99a8-e789ac2c0c9c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:06.689652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e061db32-0148-40b5-99a8-e789ac2c0c9c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:06.690091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e061db32-0148-40b5-99a8-e789ac2c0c9c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:06.690503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e061db32-0148-40b5-99a8-e789ac2c0c9c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:06.817456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e061db32-0148-40b5-99a8-e789ac2c0c9c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:06.825736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e061db32-0148-40b5-99a8-e789ac2c0c9c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147862 Aug 06 12:56:06.826305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1243/2478] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:06 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:07.205836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:07.206443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:07.212377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:07.212861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:07.213293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:07.213971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:07.214424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:07.214843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:07.275171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:07.283694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:07.285229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:07.286364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e206691a-a741-4c40-9870-7318962e0340 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084490 Aug 06 12:56:07.286946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1236/2479] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:07 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:07.494306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-799d0f4b-a7ca-4bdf-9ea2-2a3c0807e716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:07.494849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-799d0f4b-a7ca-4bdf-9ea2-2a3c0807e716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:07.501804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799d0f4b-a7ca-4bdf-9ea2-2a3c0807e716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:07.502281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799d0f4b-a7ca-4bdf-9ea2-2a3c0807e716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:07.502713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799d0f4b-a7ca-4bdf-9ea2-2a3c0807e716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:07.503393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799d0f4b-a7ca-4bdf-9ea2-2a3c0807e716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:07.503847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799d0f4b-a7ca-4bdf-9ea2-2a3c0807e716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:07.504271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799d0f4b-a7ca-4bdf-9ea2-2a3c0807e716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:07.632686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-799d0f4b-a7ca-4bdf-9ea2-2a3c0807e716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:07.640530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-799d0f4b-a7ca-4bdf-9ea2-2a3c0807e716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150291 Aug 06 12:56:07.641091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1244/2480] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:07 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:07.846898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b5c43dcd-161f-4ffb-b3a2-a2bb3c004d3b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:07.847507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b5c43dcd-161f-4ffb-b3a2-a2bb3c004d3b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:07.854044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5c43dcd-161f-4ffb-b3a2-a2bb3c004d3b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:07.854526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5c43dcd-161f-4ffb-b3a2-a2bb3c004d3b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:07.854962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5c43dcd-161f-4ffb-b3a2-a2bb3c004d3b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:07.856280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5c43dcd-161f-4ffb-b3a2-a2bb3c004d3b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:07.856757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5c43dcd-161f-4ffb-b3a2-a2bb3c004d3b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:07.857187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5c43dcd-161f-4ffb-b3a2-a2bb3c004d3b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:07.872031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:07.986261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b5c43dcd-161f-4ffb-b3a2-a2bb3c004d3b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:07.994413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b5c43dcd-161f-4ffb-b3a2-a2bb3c004d3b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151338 Aug 06 12:56:07.995172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1237/2481] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:07 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:08.308857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:08.309458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:08.315333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:08.315806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:08.316232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:08.316933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:08.317378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:08.317792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:08.377990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:08.386948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:08.388467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:08.389596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5c35b8e8-f52a-4a23-941b-59e8ede4f1a2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084644 Aug 06 12:56:08.390142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1245/2482] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:08 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:08.660644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e64a6e24-8c23-40bd-87f9-f5b4f24fd48f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:08.661200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e64a6e24-8c23-40bd-87f9-f5b4f24fd48f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:08.667146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e64a6e24-8c23-40bd-87f9-f5b4f24fd48f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:08.667628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e64a6e24-8c23-40bd-87f9-f5b4f24fd48f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:08.668059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e64a6e24-8c23-40bd-87f9-f5b4f24fd48f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:08.668789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e64a6e24-8c23-40bd-87f9-f5b4f24fd48f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:08.669245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e64a6e24-8c23-40bd-87f9-f5b4f24fd48f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:08.669670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e64a6e24-8c23-40bd-87f9-f5b4f24fd48f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:08.795095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e64a6e24-8c23-40bd-87f9-f5b4f24fd48f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:08.803013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e64a6e24-8c23-40bd-87f9-f5b4f24fd48f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146290 Aug 06 12:56:08.803568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1238/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:08 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:09.014828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e83d7550-4c4f-41fe-a0e1-90355f21893d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:09.015436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e83d7550-4c4f-41fe-a0e1-90355f21893d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:09.021947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83d7550-4c4f-41fe-a0e1-90355f21893d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:09.022423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83d7550-4c4f-41fe-a0e1-90355f21893d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:09.022850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83d7550-4c4f-41fe-a0e1-90355f21893d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:09.023530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83d7550-4c4f-41fe-a0e1-90355f21893d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:09.023976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83d7550-4c4f-41fe-a0e1-90355f21893d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:09.024438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83d7550-4c4f-41fe-a0e1-90355f21893d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:09.152016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e83d7550-4c4f-41fe-a0e1-90355f21893d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:09.159805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e83d7550-4c4f-41fe-a0e1-90355f21893d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148782 Aug 06 12:56:09.160373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1246/2484] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:09 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:09.411997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:09.412669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:09.419594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:09.420072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:09.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:09.421238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:09.421695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:09.422114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:09.483050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:09.492816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:09.494303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:09.495430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c543c825-88dd-4d1a-8aa6-64e0d8b6f74b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087374 Aug 06 12:56:09.495994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1239/2485] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:09.825469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-62f9ffb7-6c85-4c3b-becd-4c70b7f4ed12 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:09.826073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-62f9ffb7-6c85-4c3b-becd-4c70b7f4ed12 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:09.831929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62f9ffb7-6c85-4c3b-becd-4c70b7f4ed12 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:09.832439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62f9ffb7-6c85-4c3b-becd-4c70b7f4ed12 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:09.833145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62f9ffb7-6c85-4c3b-becd-4c70b7f4ed12 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:09.833821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62f9ffb7-6c85-4c3b-becd-4c70b7f4ed12 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:09.834266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62f9ffb7-6c85-4c3b-becd-4c70b7f4ed12 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:09.834682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62f9ffb7-6c85-4c3b-becd-4c70b7f4ed12 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:10.158478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-62f9ffb7-6c85-4c3b-becd-4c70b7f4ed12 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:10.166394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-62f9ffb7-6c85-4c3b-becd-4c70b7f4ed12 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.345281 Aug 06 12:56:10.166959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1247/2486] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:09 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:10.180973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c12c2d3d-05c3-41e7-bde8-018db5adcce5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:10.181584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c12c2d3d-05c3-41e7-bde8-018db5adcce5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:10.188002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c12c2d3d-05c3-41e7-bde8-018db5adcce5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:10.188525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c12c2d3d-05c3-41e7-bde8-018db5adcce5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:10.188959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c12c2d3d-05c3-41e7-bde8-018db5adcce5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:10.189634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c12c2d3d-05c3-41e7-bde8-018db5adcce5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:10.190083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c12c2d3d-05c3-41e7-bde8-018db5adcce5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:10.190505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c12c2d3d-05c3-41e7-bde8-018db5adcce5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:10.319883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c12c2d3d-05c3-41e7-bde8-018db5adcce5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:10.328920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c12c2d3d-05c3-41e7-bde8-018db5adcce5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151683 Aug 06 12:56:10.329487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1240/2487] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:10 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:10.517690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:10.518188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:10.524034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:10.524536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:10.524959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:10.525625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:10.526094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:10.526508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:10.586575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:10.594687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:10.596175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:10.597305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-95a00e00-2b00-40a5-b4ff-31344997f13e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083628 Aug 06 12:56:10.597856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1248/2488] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:10 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:11.187272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8b84bcb-a7fc-4430-a7b4-c6b991cc7e51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:11.187885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8b84bcb-a7fc-4430-a7b4-c6b991cc7e51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:11.194251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b84bcb-a7fc-4430-a7b4-c6b991cc7e51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:11.194730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b84bcb-a7fc-4430-a7b4-c6b991cc7e51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:11.195162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b84bcb-a7fc-4430-a7b4-c6b991cc7e51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:11.195870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b84bcb-a7fc-4430-a7b4-c6b991cc7e51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:11.196356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b84bcb-a7fc-4430-a7b4-c6b991cc7e51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:11.196783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b84bcb-a7fc-4430-a7b4-c6b991cc7e51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:11.323412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8b84bcb-a7fc-4430-a7b4-c6b991cc7e51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:11.331270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8b84bcb-a7fc-4430-a7b4-c6b991cc7e51 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.147896 Aug 06 12:56:11.331822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1241/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:11 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:11.353787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ba6ce030-d4de-4401-8913-b10765199286 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:11.354390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ba6ce030-d4de-4401-8913-b10765199286 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:11.361484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6ce030-d4de-4401-8913-b10765199286 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:11.361956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6ce030-d4de-4401-8913-b10765199286 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:11.362382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6ce030-d4de-4401-8913-b10765199286 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:11.363046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6ce030-d4de-4401-8913-b10765199286 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:11.363487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6ce030-d4de-4401-8913-b10765199286 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:11.363900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6ce030-d4de-4401-8913-b10765199286 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:11.494078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ba6ce030-d4de-4401-8913-b10765199286 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:11.501941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ba6ce030-d4de-4401-8913-b10765199286 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151916 Aug 06 12:56:11.502503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1249/2490] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:11 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:11.619865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:11.620508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:11.626333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:11.626804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:11.627235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:11.627907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:11.628379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:11.628804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:11.689767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:11.698047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:11.700043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:11.701203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-274c95dc-2d38-4710-90a6-8506197f8912 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085148 Aug 06 12:56:11.701756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1242/2491] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:11 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:12.352637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2b73fd65-612e-4b3c-8dca-ff1358fab81f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:12.353238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2b73fd65-612e-4b3c-8dca-ff1358fab81f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:12.360541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b73fd65-612e-4b3c-8dca-ff1358fab81f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:12.361145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b73fd65-612e-4b3c-8dca-ff1358fab81f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:12.361424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b73fd65-612e-4b3c-8dca-ff1358fab81f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:12.362095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b73fd65-612e-4b3c-8dca-ff1358fab81f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:12.362537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b73fd65-612e-4b3c-8dca-ff1358fab81f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:12.362950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b73fd65-612e-4b3c-8dca-ff1358fab81f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:12.488024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2b73fd65-612e-4b3c-8dca-ff1358fab81f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:12.495721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2b73fd65-612e-4b3c-8dca-ff1358fab81f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146902 Aug 06 12:56:12.496275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1250/2492] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:12 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:12.523152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7396ac22-fa46-4109-a4f7-1dba098e3e14 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:12.523779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7396ac22-fa46-4109-a4f7-1dba098e3e14 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:12.530080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7396ac22-fa46-4109-a4f7-1dba098e3e14 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:12.530553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7396ac22-fa46-4109-a4f7-1dba098e3e14 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:12.530979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7396ac22-fa46-4109-a4f7-1dba098e3e14 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:12.531649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7396ac22-fa46-4109-a4f7-1dba098e3e14 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:12.532093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7396ac22-fa46-4109-a4f7-1dba098e3e14 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:12.532534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7396ac22-fa46-4109-a4f7-1dba098e3e14 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:12.660938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7396ac22-fa46-4109-a4f7-1dba098e3e14 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:12.669510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7396ac22-fa46-4109-a4f7-1dba098e3e14 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150092 Aug 06 12:56:12.670081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1243/2493] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:12 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:12.722808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:12.723396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:12.729236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:12.729701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:12.730123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:12.731439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:12.731884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:12.732295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:12.791789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:12.801003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:12.802479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:12.803593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-75d24ac0-d8b6-4192-a649-5133186cd324 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084632 Aug 06 12:56:12.804131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1251/2494] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:12 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:13.518114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7eee8f0-53d8-4cec-9efe-711f7b8b2308 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:13.518728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7eee8f0-53d8-4cec-9efe-711f7b8b2308 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:13.524731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7eee8f0-53d8-4cec-9efe-711f7b8b2308 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:13.525279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7eee8f0-53d8-4cec-9efe-711f7b8b2308 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:13.525634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7eee8f0-53d8-4cec-9efe-711f7b8b2308 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:13.526316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7eee8f0-53d8-4cec-9efe-711f7b8b2308 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:13.526773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7eee8f0-53d8-4cec-9efe-711f7b8b2308 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:13.527202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7eee8f0-53d8-4cec-9efe-711f7b8b2308 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:13.651604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7eee8f0-53d8-4cec-9efe-711f7b8b2308 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:13.659470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7eee8f0-53d8-4cec-9efe-711f7b8b2308 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145308 Aug 06 12:56:13.660034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1244/2495] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:13 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:13.690699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-20abbbf1-c150-4aae-b7a7-bdf247c14d1a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:13.691300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-20abbbf1-c150-4aae-b7a7-bdf247c14d1a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:13.697576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20abbbf1-c150-4aae-b7a7-bdf247c14d1a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:13.698047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20abbbf1-c150-4aae-b7a7-bdf247c14d1a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:13.698473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20abbbf1-c150-4aae-b7a7-bdf247c14d1a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:13.699138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20abbbf1-c150-4aae-b7a7-bdf247c14d1a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:13.700203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20abbbf1-c150-4aae-b7a7-bdf247c14d1a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:13.700638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-20abbbf1-c150-4aae-b7a7-bdf247c14d1a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:13.825996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:13.826685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:13.826820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-20abbbf1-c150-4aae-b7a7-bdf247c14d1a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:13.832579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:13.833059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:13.833487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:13.834172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:13.834626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:13.834740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-20abbbf1-c150-4aae-b7a7-bdf247c14d1a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147704 Aug 06 12:56:13.835050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:13.835222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1252/2496] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:13 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:13.894959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:13.903139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:13.904665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:13.905787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-66fbd16a-5946-42d7-ad81-8e632d50a6e8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083734 Aug 06 12:56:13.906339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1245/2497] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:13 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:14.680582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1ac13c5d-7a3f-4b69-9328-559c39983d53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:14.681183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1ac13c5d-7a3f-4b69-9328-559c39983d53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:14.687353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ac13c5d-7a3f-4b69-9328-559c39983d53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:14.687825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ac13c5d-7a3f-4b69-9328-559c39983d53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:14.688249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ac13c5d-7a3f-4b69-9328-559c39983d53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:14.688950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ac13c5d-7a3f-4b69-9328-559c39983d53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:14.689396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ac13c5d-7a3f-4b69-9328-559c39983d53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:14.689812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ac13c5d-7a3f-4b69-9328-559c39983d53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:14.814766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1ac13c5d-7a3f-4b69-9328-559c39983d53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:14.822546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1ac13c5d-7a3f-4b69-9328-559c39983d53 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.145880 Aug 06 12:56:14.823098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1253/2498] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:14 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:14.855852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4b005ae4-f626-4df9-92d5-ed3f2228ae7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:14.856495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4b005ae4-f626-4df9-92d5-ed3f2228ae7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:14.863052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b005ae4-f626-4df9-92d5-ed3f2228ae7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:14.863533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b005ae4-f626-4df9-92d5-ed3f2228ae7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:14.863967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b005ae4-f626-4df9-92d5-ed3f2228ae7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:14.864674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b005ae4-f626-4df9-92d5-ed3f2228ae7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:14.865127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b005ae4-f626-4df9-92d5-ed3f2228ae7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:14.865550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b005ae4-f626-4df9-92d5-ed3f2228ae7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:14.928443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:14.929144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:14.935571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:14.935984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:14.936433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:14.937143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:14.937589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:14.938004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:14.997965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4b005ae4-f626-4df9-92d5-ed3f2228ae7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:14.999747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:15.001940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:15.006294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4b005ae4-f626-4df9-92d5-ed3f2228ae7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154409 Aug 06 12:56:15.012537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1246/2499] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:14 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:15.012687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:15.012687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:15.012928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-73cd029a-6e41-4cd0-9595-eb293c73c9ec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087680 Aug 06 12:56:15.013313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1254/2500] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:15.844279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7215de38-7b11-4134-ab5a-5a32ab7fc6d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:15.844906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7215de38-7b11-4134-ab5a-5a32ab7fc6d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:15.850913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7215de38-7b11-4134-ab5a-5a32ab7fc6d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:15.851390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7215de38-7b11-4134-ab5a-5a32ab7fc6d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:15.851823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7215de38-7b11-4134-ab5a-5a32ab7fc6d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:15.852551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7215de38-7b11-4134-ab5a-5a32ab7fc6d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:15.853007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7215de38-7b11-4134-ab5a-5a32ab7fc6d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:15.853460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7215de38-7b11-4134-ab5a-5a32ab7fc6d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:15.978006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7215de38-7b11-4134-ab5a-5a32ab7fc6d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:15.986732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7215de38-7b11-4134-ab5a-5a32ab7fc6d1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.146790 Aug 06 12:56:15.987295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1247/2501] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:15 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:16.027006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c7c7cf3f-831e-4e39-82e6-da42e24804d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:16.028111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c7c7cf3f-831e-4e39-82e6-da42e24804d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:16.034453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7cf3f-831e-4e39-82e6-da42e24804d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:16.034653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:16.034934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7cf3f-831e-4e39-82e6-da42e24804d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:16.035236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:16.035367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7cf3f-831e-4e39-82e6-da42e24804d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:16.036036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7cf3f-831e-4e39-82e6-da42e24804d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:16.036517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7cf3f-831e-4e39-82e6-da42e24804d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:16.036939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7c7cf3f-831e-4e39-82e6-da42e24804d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:16.041342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:16.041840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:16.042279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:16.042973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:16.043969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:16.044424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:16.106669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:16.115292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:16.116818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:16.117964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6be0a6e5-6509-4186-a78d-978617da4ca7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087222 Aug 06 12:56:16.118524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1248/2502] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:16.166989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c7c7cf3f-831e-4e39-82e6-da42e24804d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:16.175585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c7c7cf3f-831e-4e39-82e6-da42e24804d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152388 Aug 06 12:56:16.176149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1255/2503] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:16 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:17.007477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b5fcddbb-de30-4df2-b270-c98414ab8321 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:17.008105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b5fcddbb-de30-4df2-b270-c98414ab8321 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:17.015147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5fcddbb-de30-4df2-b270-c98414ab8321 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:17.015621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5fcddbb-de30-4df2-b270-c98414ab8321 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:17.016045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5fcddbb-de30-4df2-b270-c98414ab8321 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:17.016739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5fcddbb-de30-4df2-b270-c98414ab8321 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:17.017185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5fcddbb-de30-4df2-b270-c98414ab8321 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:17.017601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5fcddbb-de30-4df2-b270-c98414ab8321 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:17.140830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:17.141514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:17.144812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b5fcddbb-de30-4df2-b270-c98414ab8321 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:17.148025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:17.148647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:17.149440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:17.149827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:17.150278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:17.150693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:17.154409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b5fcddbb-de30-4df2-b270-c98414ab8321 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151065 Aug 06 12:56:17.156596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1249/2504] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:17 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:17.196204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b3e83017-2668-4160-bfb2-3589360bbe0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:17.196901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b3e83017-2668-4160-bfb2-3589360bbe0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:17.202772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3e83017-2668-4160-bfb2-3589360bbe0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:17.203247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3e83017-2668-4160-bfb2-3589360bbe0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:17.203674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3e83017-2668-4160-bfb2-3589360bbe0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:17.204374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3e83017-2668-4160-bfb2-3589360bbe0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:17.204821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3e83017-2668-4160-bfb2-3589360bbe0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:17.205262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3e83017-2668-4160-bfb2-3589360bbe0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:17.213331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:17.221663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:17.223143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:17.224338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7521fc2a-735d-417a-8f62-28241fb9a363 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088025 Aug 06 12:56:17.224836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1256/2505] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:17 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:17.331050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b3e83017-2668-4160-bfb2-3589360bbe0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:17.338979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b3e83017-2668-4160-bfb2-3589360bbe0a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146589 Aug 06 12:56:17.339562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1250/2506] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:17 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:18.176726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2661c6a2-70ca-44a9-a594-fb3498d8b7a3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:18.177334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2661c6a2-70ca-44a9-a594-fb3498d8b7a3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:18.183663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2661c6a2-70ca-44a9-a594-fb3498d8b7a3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:18.184138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2661c6a2-70ca-44a9-a594-fb3498d8b7a3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:18.184600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2661c6a2-70ca-44a9-a594-fb3498d8b7a3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:18.185274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2661c6a2-70ca-44a9-a594-fb3498d8b7a3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:18.185720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2661c6a2-70ca-44a9-a594-fb3498d8b7a3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:18.186139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2661c6a2-70ca-44a9-a594-fb3498d8b7a3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:18.247588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:18.248188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:18.254853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:18.255268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:18.255702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:18.256435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:18.256886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:18.257313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:18.316652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2661c6a2-70ca-44a9-a594-fb3498d8b7a3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:18.321714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:18.325299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2661c6a2-70ca-44a9-a594-fb3498d8b7a3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.151692 Aug 06 12:56:18.325955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1257/2507] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:18 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:18.330634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:18.332123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:18.333286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b411638-3b0c-4d72-944f-243b2c7ef8a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090175 Aug 06 12:56:18.333821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1251/2508] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:18.360921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-212ef76c-d36a-49b5-8dd3-ad99745c5da6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:18.361522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-212ef76c-d36a-49b5-8dd3-ad99745c5da6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:18.367263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-212ef76c-d36a-49b5-8dd3-ad99745c5da6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:18.367736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-212ef76c-d36a-49b5-8dd3-ad99745c5da6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:18.368160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-212ef76c-d36a-49b5-8dd3-ad99745c5da6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:18.368855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-212ef76c-d36a-49b5-8dd3-ad99745c5da6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:18.369336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-212ef76c-d36a-49b5-8dd3-ad99745c5da6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:18.369750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-212ef76c-d36a-49b5-8dd3-ad99745c5da6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:18.495011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-212ef76c-d36a-49b5-8dd3-ad99745c5da6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:18.503166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-212ef76c-d36a-49b5-8dd3-ad99745c5da6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147067 Aug 06 12:56:18.503714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1258/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:18 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:19.347069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a5b0c1d5-f4c7-48f3-a165-ca2c6ff1a44e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:19.347680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a5b0c1d5-f4c7-48f3-a165-ca2c6ff1a44e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:19.354129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5b0c1d5-f4c7-48f3-a165-ca2c6ff1a44e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:19.354518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:19.354940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5b0c1d5-f4c7-48f3-a165-ca2c6ff1a44e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:19.355064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5b0c1d5-f4c7-48f3-a165-ca2c6ff1a44e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:19.355169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:19.356539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5b0c1d5-f4c7-48f3-a165-ca2c6ff1a44e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:19.356774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5b0c1d5-f4c7-48f3-a165-ca2c6ff1a44e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:19.357265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5b0c1d5-f4c7-48f3-a165-ca2c6ff1a44e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:19.362439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:19.362938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:19.363366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:19.364051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:19.364533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:19.364953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:19.426029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:19.434547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:19.436055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:19.437214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-06af3ceb-7cdf-49b6-b696-f971a9346064 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086550 Aug 06 12:56:19.437771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1259/2510] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:19.485728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a5b0c1d5-f4c7-48f3-a165-ca2c6ff1a44e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:19.493450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a5b0c1d5-f4c7-48f3-a165-ca2c6ff1a44e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.150229 Aug 06 12:56:19.494012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1252/2511] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:19 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:19.524726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6e4b8420-03e1-4c38-91e0-b2a6bbf7a22b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:19.525336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6e4b8420-03e1-4c38-91e0-b2a6bbf7a22b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:19.532253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e4b8420-03e1-4c38-91e0-b2a6bbf7a22b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:19.532793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e4b8420-03e1-4c38-91e0-b2a6bbf7a22b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:19.533230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e4b8420-03e1-4c38-91e0-b2a6bbf7a22b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:19.533904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e4b8420-03e1-4c38-91e0-b2a6bbf7a22b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:19.534357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e4b8420-03e1-4c38-91e0-b2a6bbf7a22b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:19.534807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e4b8420-03e1-4c38-91e0-b2a6bbf7a22b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:19.661097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6e4b8420-03e1-4c38-91e0-b2a6bbf7a22b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:19.668926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6e4b8420-03e1-4c38-91e0-b2a6bbf7a22b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148113 Aug 06 12:56:19.669484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1260/2512] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:19 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:20.460179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:20.460809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:20.467898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:20.468407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:20.468842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:20.469519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:20.469967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:20.470386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:20.514837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e340bcb2-a678-4170-9f0d-07458d2ea45d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:20.515435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e340bcb2-a678-4170-9f0d-07458d2ea45d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:20.521735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e340bcb2-a678-4170-9f0d-07458d2ea45d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:20.522212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e340bcb2-a678-4170-9f0d-07458d2ea45d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:20.522643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e340bcb2-a678-4170-9f0d-07458d2ea45d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:20.523319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e340bcb2-a678-4170-9f0d-07458d2ea45d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:20.523766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e340bcb2-a678-4170-9f0d-07458d2ea45d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:20.524186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e340bcb2-a678-4170-9f0d-07458d2ea45d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:20.530949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:20.539186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:20.540693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:20.541815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-11d4e452-466d-4a26-9ce7-d16967567227 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085582 Aug 06 12:56:20.542553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1253/2513] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:20.651262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e340bcb2-a678-4170-9f0d-07458d2ea45d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:20.659392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e340bcb2-a678-4170-9f0d-07458d2ea45d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148848 Aug 06 12:56:20.659953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1261/2514] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:20 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:20.689184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-517cd3cc-e79a-4adf-8d8c-6d45c2d59ada tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:20.689782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-517cd3cc-e79a-4adf-8d8c-6d45c2d59ada tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:20.695575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-517cd3cc-e79a-4adf-8d8c-6d45c2d59ada tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:20.696049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-517cd3cc-e79a-4adf-8d8c-6d45c2d59ada tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:20.696508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-517cd3cc-e79a-4adf-8d8c-6d45c2d59ada tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:20.697180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-517cd3cc-e79a-4adf-8d8c-6d45c2d59ada tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:20.697622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-517cd3cc-e79a-4adf-8d8c-6d45c2d59ada tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:20.698038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-517cd3cc-e79a-4adf-8d8c-6d45c2d59ada tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:20.702654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:20.827034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-517cd3cc-e79a-4adf-8d8c-6d45c2d59ada tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:20.834821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-517cd3cc-e79a-4adf-8d8c-6d45c2d59ada tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149436 Aug 06 12:56:20.835399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1254/2515] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:20 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:21.564378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:21.564985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:21.571403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:21.571879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:21.572322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:21.573007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:21.573451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:21.573867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:21.633895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:21.642393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:21.643873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:21.646061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9be0df1d-4622-40eb-9bbb-e059bef07009 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084587 Aug 06 12:56:21.646987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1262/2516] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:21 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:21.680295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-42b3d791-3634-497d-a544-f820064e246d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:21.680921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-42b3d791-3634-497d-a544-f820064e246d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:21.687499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42b3d791-3634-497d-a544-f820064e246d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:21.687984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42b3d791-3634-497d-a544-f820064e246d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:21.688446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42b3d791-3634-497d-a544-f820064e246d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:21.689134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42b3d791-3634-497d-a544-f820064e246d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:21.689586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42b3d791-3634-497d-a544-f820064e246d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:21.690010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42b3d791-3634-497d-a544-f820064e246d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:21.816673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-42b3d791-3634-497d-a544-f820064e246d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:21.824621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-42b3d791-3634-497d-a544-f820064e246d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148229 Aug 06 12:56:21.825180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1255/2517] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:21 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:21.855089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f42c106a-d0ab-427a-b17f-20da4c9a3228 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:21.856320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f42c106a-d0ab-427a-b17f-20da4c9a3228 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:21.862474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f42c106a-d0ab-427a-b17f-20da4c9a3228 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:21.862948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f42c106a-d0ab-427a-b17f-20da4c9a3228 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:21.863377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f42c106a-d0ab-427a-b17f-20da4c9a3228 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:21.864080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f42c106a-d0ab-427a-b17f-20da4c9a3228 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:21.864555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f42c106a-d0ab-427a-b17f-20da4c9a3228 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:21.864977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f42c106a-d0ab-427a-b17f-20da4c9a3228 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:21.992993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f42c106a-d0ab-427a-b17f-20da4c9a3228 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:22.001312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f42c106a-d0ab-427a-b17f-20da4c9a3228 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150036 Aug 06 12:56:22.001868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1263/2518] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:21 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:22.669176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:22.669794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:22.675720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:22.676194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:22.676661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:22.677336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:22.677783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:22.678203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:22.743377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:22.752256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:22.753805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:22.754941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0c1e2ec2-4de0-4b46-896d-3bc88eb1ee66 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089758 Aug 06 12:56:22.755487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1256/2519] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:22.940680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b9da5058-b7f8-48c4-9e10-b31fabf048c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:22.941284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b9da5058-b7f8-48c4-9e10-b31fabf048c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:22.947105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9da5058-b7f8-48c4-9e10-b31fabf048c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:22.947576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9da5058-b7f8-48c4-9e10-b31fabf048c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:22.947995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9da5058-b7f8-48c4-9e10-b31fabf048c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:22.948693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9da5058-b7f8-48c4-9e10-b31fabf048c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:22.949196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9da5058-b7f8-48c4-9e10-b31fabf048c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:22.949610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9da5058-b7f8-48c4-9e10-b31fabf048c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:23.023765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8af8b2d-0ffb-404c-8019-2c899a31415d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:23.024430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8af8b2d-0ffb-404c-8019-2c899a31415d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:23.030402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8af8b2d-0ffb-404c-8019-2c899a31415d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:23.030889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8af8b2d-0ffb-404c-8019-2c899a31415d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:23.031319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8af8b2d-0ffb-404c-8019-2c899a31415d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:23.032015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8af8b2d-0ffb-404c-8019-2c899a31415d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:23.032496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8af8b2d-0ffb-404c-8019-2c899a31415d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:23.032922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8af8b2d-0ffb-404c-8019-2c899a31415d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:23.081408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b9da5058-b7f8-48c4-9e10-b31fabf048c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:23.089469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b9da5058-b7f8-48c4-9e10-b31fabf048c3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.247913 Aug 06 12:56:23.090038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1264/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:22 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:23.164321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8af8b2d-0ffb-404c-8019-2c899a31415d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:23.173085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8af8b2d-0ffb-404c-8019-2c899a31415d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153202 Aug 06 12:56:23.173876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1257/2521] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:23 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:23.873063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:23.873660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:23.879523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:23.879992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:23.880460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:23.881171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:23.881653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:23.882028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:23.944020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:23.952726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:23.954206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:23.955315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-edce50ba-74c4-4730-a2b7-032ced52b22c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.181428 Aug 06 12:56:23.955860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1265/2522] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:24.110724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8816628d-7685-46a7-8d00-60b9fd970f08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:24.111328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8816628d-7685-46a7-8d00-60b9fd970f08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:24.117636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8816628d-7685-46a7-8d00-60b9fd970f08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:24.118110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8816628d-7685-46a7-8d00-60b9fd970f08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:24.118538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8816628d-7685-46a7-8d00-60b9fd970f08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:24.119211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8816628d-7685-46a7-8d00-60b9fd970f08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:24.119656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8816628d-7685-46a7-8d00-60b9fd970f08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:24.120072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8816628d-7685-46a7-8d00-60b9fd970f08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:24.194496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-29cf7b34-d0d6-4be2-afe6-f6aa3cf14f41 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:24.195100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-29cf7b34-d0d6-4be2-afe6-f6aa3cf14f41 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:24.201753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29cf7b34-d0d6-4be2-afe6-f6aa3cf14f41 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:24.202233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29cf7b34-d0d6-4be2-afe6-f6aa3cf14f41 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:24.202666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29cf7b34-d0d6-4be2-afe6-f6aa3cf14f41 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:24.203351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29cf7b34-d0d6-4be2-afe6-f6aa3cf14f41 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:24.203802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29cf7b34-d0d6-4be2-afe6-f6aa3cf14f41 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:24.204226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29cf7b34-d0d6-4be2-afe6-f6aa3cf14f41 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:24.246981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8816628d-7685-46a7-8d00-60b9fd970f08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:24.255272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8816628d-7685-46a7-8d00-60b9fd970f08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.148571 Aug 06 12:56:24.255848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1258/2523] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:24.333659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-29cf7b34-d0d6-4be2-afe6-f6aa3cf14f41 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:24.341558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-29cf7b34-d0d6-4be2-afe6-f6aa3cf14f41 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150946 Aug 06 12:56:24.342107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1266/2524] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:24 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:24.977719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:24.978386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:24.984423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:24.984901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:24.985334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:24.986013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:24.986462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:24.986885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:25.052884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:25.063587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:25.065121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:25.066371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a32e0fa7-5cd8-4194-9469-2f8a66c0ae32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.092484 Aug 06 12:56:25.066924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1259/2525] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:25.111800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2a08f133-4d81-40c1-857a-41a3497b751e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:25.112511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2a08f133-4d81-40c1-857a-41a3497b751e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:25.119020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a08f133-4d81-40c1-857a-41a3497b751e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:25.119565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a08f133-4d81-40c1-857a-41a3497b751e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:25.120063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a08f133-4d81-40c1-857a-41a3497b751e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:25.121314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a08f133-4d81-40c1-857a-41a3497b751e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:25.121933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a08f133-4d81-40c1-857a-41a3497b751e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:25.122349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a08f133-4d81-40c1-857a-41a3497b751e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:25.147436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2a08f133-4d81-40c1-857a-41a3497b751e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 12:56:25.219703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2a08f133-4d81-40c1-857a-41a3497b751e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 204 len: 0 microversion: 2.1 time: 0.111745 Aug 06 12:56:25.220261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1267/2526] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:56:25 2022] DELETE /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 12:56:25.228367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2f7b2780-2bde-4d53-be7c-6907a6c29244 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:25.228977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2f7b2780-2bde-4d53-be7c-6907a6c29244 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:25.235457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7b2780-2bde-4d53-be7c-6907a6c29244 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:25.235931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7b2780-2bde-4d53-be7c-6907a6c29244 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:25.236384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7b2780-2bde-4d53-be7c-6907a6c29244 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:25.237061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7b2780-2bde-4d53-be7c-6907a6c29244 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:25.237511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7b2780-2bde-4d53-be7c-6907a6c29244 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:25.237931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7b2780-2bde-4d53-be7c-6907a6c29244 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:25.277341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9957e4f6-84b9-47d6-9a17-2ea27a832608 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:25.278026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9957e4f6-84b9-47d6-9a17-2ea27a832608 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:25.284577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9957e4f6-84b9-47d6-9a17-2ea27a832608 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:25.285053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9957e4f6-84b9-47d6-9a17-2ea27a832608 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:25.285483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9957e4f6-84b9-47d6-9a17-2ea27a832608 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:25.286209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9957e4f6-84b9-47d6-9a17-2ea27a832608 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:25.286858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9957e4f6-84b9-47d6-9a17-2ea27a832608 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:25.287486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9957e4f6-84b9-47d6-9a17-2ea27a832608 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:25.387190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2f7b2780-2bde-4d53-be7c-6907a6c29244 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:25.402790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2f7b2780-2bde-4d53-be7c-6907a6c29244 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.178074 Aug 06 12:56:25.403714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1260/2527] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:25 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:25.411626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b47a5a61-778d-453a-a2d9-3ab1f89cb131 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:25.412287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b47a5a61-778d-453a-a2d9-3ab1f89cb131 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:25.420666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b47a5a61-778d-453a-a2d9-3ab1f89cb131 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:25.422104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b47a5a61-778d-453a-a2d9-3ab1f89cb131 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:25.422569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b47a5a61-778d-453a-a2d9-3ab1f89cb131 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:25.423257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b47a5a61-778d-453a-a2d9-3ab1f89cb131 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:25.423703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b47a5a61-778d-453a-a2d9-3ab1f89cb131 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:25.424122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b47a5a61-778d-453a-a2d9-3ab1f89cb131 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:25.450986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9957e4f6-84b9-47d6-9a17-2ea27a832608 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:25.459386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9957e4f6-84b9-47d6-9a17-2ea27a832608 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.186164 Aug 06 12:56:25.459945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1268/2528] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:25 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:25.553999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b47a5a61-778d-453a-a2d9-3ab1f89cb131 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:25.562556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b47a5a61-778d-453a-a2d9-3ab1f89cb131 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.156616 Aug 06 12:56:25.563112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1261/2529] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:25 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:26.093080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:26.093680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:26.099761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:26.100234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:26.100696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:26.101375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:26.101820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:26.102237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:26.164931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:26.167304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:26.175557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:26.177106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:26.179067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1e1329ac-6cc9-4ad9-a767-85c03c20cc6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090472 Aug 06 12:56:26.179628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1269/2530] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:26.424349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eac387d0-9728-472d-a2f8-d46746184df4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:26.424948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eac387d0-9728-472d-a2f8-d46746184df4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:26.427280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=80 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:26.432439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eac387d0-9728-472d-a2f8-d46746184df4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:26.432917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eac387d0-9728-472d-a2f8-d46746184df4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:26.433345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eac387d0-9728-472d-a2f8-d46746184df4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:26.434021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eac387d0-9728-472d-a2f8-d46746184df4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:26.434468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eac387d0-9728-472d-a2f8-d46746184df4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:26.434886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eac387d0-9728-472d-a2f8-d46746184df4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:26.482524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-428b5977-558e-41ee-b598-f3ba5275cb7c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:26.483121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-428b5977-558e-41ee-b598-f3ba5275cb7c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:26.490027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-428b5977-558e-41ee-b598-f3ba5275cb7c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:26.490502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-428b5977-558e-41ee-b598-f3ba5275cb7c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:26.490928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-428b5977-558e-41ee-b598-f3ba5275cb7c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:26.491605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-428b5977-558e-41ee-b598-f3ba5275cb7c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:26.492048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-428b5977-558e-41ee-b598-f3ba5275cb7c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:26.492495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-428b5977-558e-41ee-b598-f3ba5275cb7c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:26.565998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eac387d0-9728-472d-a2f8-d46746184df4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:26.574657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eac387d0-9728-472d-a2f8-d46746184df4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153534 Aug 06 12:56:26.575228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1262/2531] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:26 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:26.582435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-caa46a79-51a9-4f31-95f1-712b1b16a0fb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:26.583117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-caa46a79-51a9-4f31-95f1-712b1b16a0fb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:26.589495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-caa46a79-51a9-4f31-95f1-712b1b16a0fb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:26.590284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-caa46a79-51a9-4f31-95f1-712b1b16a0fb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:26.590726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-caa46a79-51a9-4f31-95f1-712b1b16a0fb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:26.591423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-caa46a79-51a9-4f31-95f1-712b1b16a0fb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:26.591879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-caa46a79-51a9-4f31-95f1-712b1b16a0fb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:26.592321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-caa46a79-51a9-4f31-95f1-712b1b16a0fb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:26.624917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-428b5977-558e-41ee-b598-f3ba5275cb7c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:26.632948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-428b5977-558e-41ee-b598-f3ba5275cb7c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1725 microversion: 2.1 time: 0.155939 Aug 06 12:56:26.633515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1270/2532] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:26.783593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-caa46a79-51a9-4f31-95f1-712b1b16a0fb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:26.791402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-caa46a79-51a9-4f31-95f1-712b1b16a0fb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.212510 Aug 06 12:56:26.791968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1263/2533] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:26 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:27.201876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:27.202480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:27.209862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:27.210350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:27.210785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:27.211494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:27.211949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:27.212400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:27.280494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:27.289152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:27.290714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:27.291848 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a301b19f-1bde-4c83-8f63-7c7197ef8f9e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.094347 Aug 06 12:56:27.295668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1271/2534] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:27.598802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1117b2b1-6371-441a-a329-4c49e154dfae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:27.599870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1117b2b1-6371-441a-a329-4c49e154dfae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:27.608435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1117b2b1-6371-441a-a329-4c49e154dfae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:27.609455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1117b2b1-6371-441a-a329-4c49e154dfae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:27.610082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1117b2b1-6371-441a-a329-4c49e154dfae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:27.610793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1117b2b1-6371-441a-a329-4c49e154dfae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:27.611247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1117b2b1-6371-441a-a329-4c49e154dfae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:27.611670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1117b2b1-6371-441a-a329-4c49e154dfae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:27.654767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-11d77ea2-0e54-4137-9fb7-36ad6551e163 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:27.655374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-11d77ea2-0e54-4137-9fb7-36ad6551e163 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:27.657396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:27.663946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11d77ea2-0e54-4137-9fb7-36ad6551e163 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:27.664745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11d77ea2-0e54-4137-9fb7-36ad6551e163 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:27.665419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11d77ea2-0e54-4137-9fb7-36ad6551e163 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:27.666207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11d77ea2-0e54-4137-9fb7-36ad6551e163 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:27.666876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11d77ea2-0e54-4137-9fb7-36ad6551e163 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:27.667365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11d77ea2-0e54-4137-9fb7-36ad6551e163 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:27.736577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-11d77ea2-0e54-4137-9fb7-36ad6551e163 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:27.750137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-11d77ea2-0e54-4137-9fb7-36ad6551e163 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1658 microversion: 2.1 time: 0.098998 Aug 06 12:56:27.751173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1272/2535] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:27 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1658 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:27.812846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d77e2de5-8c8a-4f2e-8026-e0f70b506e6c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:27.813450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d77e2de5-8c8a-4f2e-8026-e0f70b506e6c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:27.819415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d77e2de5-8c8a-4f2e-8026-e0f70b506e6c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:27.819833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d77e2de5-8c8a-4f2e-8026-e0f70b506e6c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:27.820267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d77e2de5-8c8a-4f2e-8026-e0f70b506e6c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:27.821674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d77e2de5-8c8a-4f2e-8026-e0f70b506e6c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:27.822125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d77e2de5-8c8a-4f2e-8026-e0f70b506e6c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:27.822549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d77e2de5-8c8a-4f2e-8026-e0f70b506e6c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:27.824922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1117b2b1-6371-441a-a329-4c49e154dfae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:27.834124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1117b2b1-6371-441a-a329-4c49e154dfae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.242306 Aug 06 12:56:27.835491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1264/2536] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:27 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:27.865282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-bd2ea7fd-495f-4e93-bfb3-3f546b0c2b7e req-34f01031-da61-4bea-ae23-7b19114ad600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe37e0-b98f-49eb-aef9-6e6279dae867", "name": "network-vif-deleted", "tag": "d5229f58-fe7a-4bcb-b624-651ae519779d"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:56:27.875472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-bd2ea7fd-495f-4e93-bfb3-3f546b0c2b7e req-34f01031-da61-4bea-ae23-7b19114ad600 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:27.875953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-bd2ea7fd-495f-4e93-bfb3-3f546b0c2b7e req-34f01031-da61-4bea-ae23-7b19114ad600 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:27.876405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-bd2ea7fd-495f-4e93-bfb3-3f546b0c2b7e req-34f01031-da61-4bea-ae23-7b19114ad600 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:27.889166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-bd2ea7fd-495f-4e93-bfb3-3f546b0c2b7e req-34f01031-da61-4bea-ae23-7b19114ad600 service nova] Creating event network-vif-deleted:d5229f58-fe7a-4bcb-b624-651ae519779d for instance acfe37e0-b98f-49eb-aef9-6e6279dae867 on hv-cinder-85199 Aug 06 12:56:27.895639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-bd2ea7fd-495f-4e93-bfb3-3f546b0c2b7e req-34f01031-da61-4bea-ae23-7b19114ad600 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034213 Aug 06 12:56:27.896687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1265/2537] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:56:27.967970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d77e2de5-8c8a-4f2e-8026-e0f70b506e6c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:27.976070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d77e2de5-8c8a-4f2e-8026-e0f70b506e6c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.167520 Aug 06 12:56:27.976666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1273/2538] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:27 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:28.315372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:28.316390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:28.322663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:28.323140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:28.323567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:28.324243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:28.324714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:28.325129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:28.390330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:28.398742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:28.400217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:28.401416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c0bc261c-20bc-474e-abe7-cf95e722d4fc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090416 Aug 06 12:56:28.402493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1266/2539] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:28.770933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6cb3b9e9-f4e0-401d-9058-7782cf4a7a5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:28.771567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6cb3b9e9-f4e0-401d-9058-7782cf4a7a5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:28.778533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cb3b9e9-f4e0-401d-9058-7782cf4a7a5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:28.779004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cb3b9e9-f4e0-401d-9058-7782cf4a7a5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:28.779430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cb3b9e9-f4e0-401d-9058-7782cf4a7a5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:28.780104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cb3b9e9-f4e0-401d-9058-7782cf4a7a5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:28.780576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cb3b9e9-f4e0-401d-9058-7782cf4a7a5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:28.780993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6cb3b9e9-f4e0-401d-9058-7782cf4a7a5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:28.842193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6cb3b9e9-f4e0-401d-9058-7782cf4a7a5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:28.850168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6cb3b9e9-f4e0-401d-9058-7782cf4a7a5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083114 Aug 06 12:56:28.850849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1274/2540] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:28 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:28.857584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1f0d2e5d-1de1-45fb-bea3-7d3b2e3d5c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:28.858266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1f0d2e5d-1de1-45fb-bea3-7d3b2e3d5c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:28.868576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0d2e5d-1de1-45fb-bea3-7d3b2e3d5c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:28.869071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0d2e5d-1de1-45fb-bea3-7d3b2e3d5c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:28.869508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0d2e5d-1de1-45fb-bea3-7d3b2e3d5c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:28.870231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0d2e5d-1de1-45fb-bea3-7d3b2e3d5c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:28.871232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0d2e5d-1de1-45fb-bea3-7d3b2e3d5c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:28.871663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0d2e5d-1de1-45fb-bea3-7d3b2e3d5c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:29.002235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7510ed14-bbeb-457b-b6f4-9a5c3784cb52 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:29.002838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1f0d2e5d-1de1-45fb-bea3-7d3b2e3d5c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:29.003030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7510ed14-bbeb-457b-b6f4-9a5c3784cb52 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:29.008950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7510ed14-bbeb-457b-b6f4-9a5c3784cb52 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:29.009429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7510ed14-bbeb-457b-b6f4-9a5c3784cb52 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:29.009862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7510ed14-bbeb-457b-b6f4-9a5c3784cb52 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:29.010550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7510ed14-bbeb-457b-b6f4-9a5c3784cb52 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:29.010663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1f0d2e5d-1de1-45fb-bea3-7d3b2e3d5c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.157277 Aug 06 12:56:29.011003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7510ed14-bbeb-457b-b6f4-9a5c3784cb52 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:29.011153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1267/2541] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:28 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:29.012080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7510ed14-bbeb-457b-b6f4-9a5c3784cb52 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:29.135977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7510ed14-bbeb-457b-b6f4-9a5c3784cb52 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:29.144497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7510ed14-bbeb-457b-b6f4-9a5c3784cb52 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150118 Aug 06 12:56:29.145003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1275/2542] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:28 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:29.423646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:29.424189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:29.430300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:29.430777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:29.431208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:29.431894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:29.432365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:29.432792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:29.492278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:29.501337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:29.502818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:29.503940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f133f8a4-56c4-4198-a79b-e2be74b09c04 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084335 Aug 06 12:56:29.504522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1268/2543] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:29.870400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-149e9d48-6770-40b2-a54b-817a0aeac9ed tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:29.871030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-149e9d48-6770-40b2-a54b-817a0aeac9ed tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:29.877494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149e9d48-6770-40b2-a54b-817a0aeac9ed tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:29.877964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149e9d48-6770-40b2-a54b-817a0aeac9ed tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:29.878389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149e9d48-6770-40b2-a54b-817a0aeac9ed tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:29.879058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149e9d48-6770-40b2-a54b-817a0aeac9ed tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:29.879502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149e9d48-6770-40b2-a54b-817a0aeac9ed tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:29.879916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149e9d48-6770-40b2-a54b-817a0aeac9ed tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:29.943136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-149e9d48-6770-40b2-a54b-817a0aeac9ed tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:29.951377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-149e9d48-6770-40b2-a54b-817a0aeac9ed tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084820 Aug 06 12:56:29.951934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1276/2544] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:29 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:30.033098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38387ec0-cc42-4cbd-b9f5-e6aa3c8f5e17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:30.033715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38387ec0-cc42-4cbd-b9f5-e6aa3c8f5e17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:30.040218 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38387ec0-cc42-4cbd-b9f5-e6aa3c8f5e17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:30.040732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38387ec0-cc42-4cbd-b9f5-e6aa3c8f5e17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:30.041169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38387ec0-cc42-4cbd-b9f5-e6aa3c8f5e17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:30.041852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38387ec0-cc42-4cbd-b9f5-e6aa3c8f5e17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:30.042310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38387ec0-cc42-4cbd-b9f5-e6aa3c8f5e17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:30.042740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38387ec0-cc42-4cbd-b9f5-e6aa3c8f5e17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:30.165376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2a1474f5-b5b9-46ac-bede-8125801df532 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:30.165982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2a1474f5-b5b9-46ac-bede-8125801df532 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:30.170907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-38387ec0-cc42-4cbd-b9f5-e6aa3c8f5e17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:30.171818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a1474f5-b5b9-46ac-bede-8125801df532 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:30.172294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a1474f5-b5b9-46ac-bede-8125801df532 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:30.172753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a1474f5-b5b9-46ac-bede-8125801df532 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:30.173433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a1474f5-b5b9-46ac-bede-8125801df532 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:30.173877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a1474f5-b5b9-46ac-bede-8125801df532 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:30.174295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a1474f5-b5b9-46ac-bede-8125801df532 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:30.178948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38387ec0-cc42-4cbd-b9f5-e6aa3c8f5e17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149735 Aug 06 12:56:30.179598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1269/2545] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:30 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:30.301570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2a1474f5-b5b9-46ac-bede-8125801df532 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:30.309313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2a1474f5-b5b9-46ac-bede-8125801df532 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147762 Aug 06 12:56:30.309866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1277/2546] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:30 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:30.526178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:30.526704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:30.532650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:30.533149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:30.533583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:30.534262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:30.534714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:30.535136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:30.597299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:30.605449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:30.606995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:30.608125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-40d21e24-f51c-49f6-8c4c-aa25ca070f2c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085959 Aug 06 12:56:30.608958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1270/2547] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:30.972844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8af61393-6415-455c-a62d-84f8b7a49152 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:30.973474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8af61393-6415-455c-a62d-84f8b7a49152 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:30.979759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8af61393-6415-455c-a62d-84f8b7a49152 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:30.980745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8af61393-6415-455c-a62d-84f8b7a49152 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:30.981173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8af61393-6415-455c-a62d-84f8b7a49152 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:30.981840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8af61393-6415-455c-a62d-84f8b7a49152 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:30.982289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8af61393-6415-455c-a62d-84f8b7a49152 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:30.982694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8af61393-6415-455c-a62d-84f8b7a49152 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:31.044332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8af61393-6415-455c-a62d-84f8b7a49152 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:31.052193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8af61393-6415-455c-a62d-84f8b7a49152 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083207 Aug 06 12:56:31.052788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1278/2548] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:30 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:31.199802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-141f81af-c81f-4e24-b2cd-5865c4009c03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:31.200433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-141f81af-c81f-4e24-b2cd-5865c4009c03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:31.206471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141f81af-c81f-4e24-b2cd-5865c4009c03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:31.206953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141f81af-c81f-4e24-b2cd-5865c4009c03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:31.207387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141f81af-c81f-4e24-b2cd-5865c4009c03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:31.208070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141f81af-c81f-4e24-b2cd-5865c4009c03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:31.208570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141f81af-c81f-4e24-b2cd-5865c4009c03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:31.208997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-141f81af-c81f-4e24-b2cd-5865c4009c03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:31.223870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:31.330116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-002bda5d-30b3-4677-8585-e964a75a3203 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:31.330714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-002bda5d-30b3-4677-8585-e964a75a3203 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:31.335167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-141f81af-c81f-4e24-b2cd-5865c4009c03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:31.336600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-002bda5d-30b3-4677-8585-e964a75a3203 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:31.337073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-002bda5d-30b3-4677-8585-e964a75a3203 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:31.337496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-002bda5d-30b3-4677-8585-e964a75a3203 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:31.338170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-002bda5d-30b3-4677-8585-e964a75a3203 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:31.338612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-002bda5d-30b3-4677-8585-e964a75a3203 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:31.339025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-002bda5d-30b3-4677-8585-e964a75a3203 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:31.343775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-141f81af-c81f-4e24-b2cd-5865c4009c03 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147600 Aug 06 12:56:31.344364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1271/2549] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:31 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:31.469161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-002bda5d-30b3-4677-8585-e964a75a3203 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:31.477053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-002bda5d-30b3-4677-8585-e964a75a3203 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150638 Aug 06 12:56:31.477549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1279/2550] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:31 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:31.631862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:31.632504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:31.638832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:31.639305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:31.639730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:31.640439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:31.640884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:31.641302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:31.704089 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:31.712419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:31.713893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:31.715618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-218ee2b5-79b1-4143-a7f1-34b83d6110f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088002 Aug 06 12:56:31.716166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1272/2551] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:32.073210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b49723af-72bb-4987-971b-a475c309904b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:32.074395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b49723af-72bb-4987-971b-a475c309904b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:32.080809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49723af-72bb-4987-971b-a475c309904b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:32.081288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49723af-72bb-4987-971b-a475c309904b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:32.081718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49723af-72bb-4987-971b-a475c309904b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:32.082395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49723af-72bb-4987-971b-a475c309904b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:32.082847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49723af-72bb-4987-971b-a475c309904b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:32.083258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b49723af-72bb-4987-971b-a475c309904b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:32.145074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b49723af-72bb-4987-971b-a475c309904b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:32.152908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b49723af-72bb-4987-971b-a475c309904b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083546 Aug 06 12:56:32.153468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1280/2552] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:32.365722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e29f51c6-e888-4de0-8d3f-4818c8b926ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:32.366331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e29f51c6-e888-4de0-8d3f-4818c8b926ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:32.373410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e29f51c6-e888-4de0-8d3f-4818c8b926ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:32.373895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e29f51c6-e888-4de0-8d3f-4818c8b926ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:32.374330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e29f51c6-e888-4de0-8d3f-4818c8b926ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:32.375022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e29f51c6-e888-4de0-8d3f-4818c8b926ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:32.375476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e29f51c6-e888-4de0-8d3f-4818c8b926ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:32.375903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e29f51c6-e888-4de0-8d3f-4818c8b926ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:32.499649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-522be879-c4fc-48c8-8927-2d01f8ca8785 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:32.499963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e29f51c6-e888-4de0-8d3f-4818c8b926ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:32.500253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-522be879-c4fc-48c8-8927-2d01f8ca8785 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:32.506176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522be879-c4fc-48c8-8927-2d01f8ca8785 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:32.506653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522be879-c4fc-48c8-8927-2d01f8ca8785 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:32.507082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522be879-c4fc-48c8-8927-2d01f8ca8785 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:32.507765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522be879-c4fc-48c8-8927-2d01f8ca8785 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:32.507872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e29f51c6-e888-4de0-8d3f-4818c8b926ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146003 Aug 06 12:56:32.508215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522be879-c4fc-48c8-8927-2d01f8ca8785 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:32.508719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1273/2553] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:32 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:32.508876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-522be879-c4fc-48c8-8927-2d01f8ca8785 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:32.634652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-522be879-c4fc-48c8-8927-2d01f8ca8785 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:32.642483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-522be879-c4fc-48c8-8927-2d01f8ca8785 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147375 Aug 06 12:56:32.643043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1281/2554] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:32 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:32.737681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:32.738323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:32.744206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:32.744715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:32.745152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:32.745892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:32.746346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:32.746771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:32.807875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:32.816407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:32.817906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:32.819044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aaaec55f-2b3b-43d4-aa4f-a9dc0a2c0446 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085459 Aug 06 12:56:32.819601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1274/2555] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:33.174280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-23881724-ff4d-43f3-aff8-065d3f8809c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:33.174910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-23881724-ff4d-43f3-aff8-065d3f8809c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:33.181183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23881724-ff4d-43f3-aff8-065d3f8809c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:33.181655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23881724-ff4d-43f3-aff8-065d3f8809c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:33.182077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23881724-ff4d-43f3-aff8-065d3f8809c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:33.182738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23881724-ff4d-43f3-aff8-065d3f8809c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:33.183179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23881724-ff4d-43f3-aff8-065d3f8809c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:33.183592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23881724-ff4d-43f3-aff8-065d3f8809c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:33.247333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23881724-ff4d-43f3-aff8-065d3f8809c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:33.255126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-23881724-ff4d-43f3-aff8-065d3f8809c7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084642 Aug 06 12:56:33.255618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1282/2556] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:33.528810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b466589a-8957-4d0b-8c08-8582e01b1fe5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:33.529353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b466589a-8957-4d0b-8c08-8582e01b1fe5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:33.535408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b466589a-8957-4d0b-8c08-8582e01b1fe5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:33.535879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b466589a-8957-4d0b-8c08-8582e01b1fe5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:33.536319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b466589a-8957-4d0b-8c08-8582e01b1fe5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:33.536998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b466589a-8957-4d0b-8c08-8582e01b1fe5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:33.537446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b466589a-8957-4d0b-8c08-8582e01b1fe5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:33.537864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b466589a-8957-4d0b-8c08-8582e01b1fe5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:33.664158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fd8d37df-7b00-4d03-bad9-9941cc51a326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:33.664786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fd8d37df-7b00-4d03-bad9-9941cc51a326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:33.669037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b466589a-8957-4d0b-8c08-8582e01b1fe5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:33.670744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8d37df-7b00-4d03-bad9-9941cc51a326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:33.671223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8d37df-7b00-4d03-bad9-9941cc51a326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:33.671651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8d37df-7b00-4d03-bad9-9941cc51a326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:33.672390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8d37df-7b00-4d03-bad9-9941cc51a326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:33.672840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8d37df-7b00-4d03-bad9-9941cc51a326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:33.673261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8d37df-7b00-4d03-bad9-9941cc51a326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:33.677052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b466589a-8957-4d0b-8c08-8582e01b1fe5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152102 Aug 06 12:56:33.677618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1275/2557] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:33 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:33.799125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fd8d37df-7b00-4d03-bad9-9941cc51a326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:33.806986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fd8d37df-7b00-4d03-bad9-9941cc51a326 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146682 Aug 06 12:56:33.807549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1283/2558] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:33 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:33.841267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:33.841871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:33.847683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:33.848163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:33.848642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:33.849320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:33.849781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:33.850224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:33.911907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:33.920795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:33.922277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:33.923412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3101c993-2dd9-45d0-bfb8-311f02f1c25e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086004 Aug 06 12:56:33.923965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1276/2559] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:34.275989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ba726366-93ef-4378-a855-ba07b64961d8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:34.276549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ba726366-93ef-4378-a855-ba07b64961d8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:34.283471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba726366-93ef-4378-a855-ba07b64961d8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:34.283944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba726366-93ef-4378-a855-ba07b64961d8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:34.284398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba726366-93ef-4378-a855-ba07b64961d8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:34.285068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba726366-93ef-4378-a855-ba07b64961d8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:34.285512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba726366-93ef-4378-a855-ba07b64961d8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:34.285927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba726366-93ef-4378-a855-ba07b64961d8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:34.353859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ba726366-93ef-4378-a855-ba07b64961d8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:34.362635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ba726366-93ef-4378-a855-ba07b64961d8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.090592 Aug 06 12:56:34.363181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1284/2560] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:34 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:34.699187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1a17c93f-923e-4667-b538-84a04d82b06a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:34.699817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1a17c93f-923e-4667-b538-84a04d82b06a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:34.706274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a17c93f-923e-4667-b538-84a04d82b06a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:34.706754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a17c93f-923e-4667-b538-84a04d82b06a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:34.707189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a17c93f-923e-4667-b538-84a04d82b06a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:34.707873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a17c93f-923e-4667-b538-84a04d82b06a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:34.708347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a17c93f-923e-4667-b538-84a04d82b06a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:34.708774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a17c93f-923e-4667-b538-84a04d82b06a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:34.829523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ebc889c3-5ae5-46d9-aa92-b1ef5a06a706 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:34.830297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ebc889c3-5ae5-46d9-aa92-b1ef5a06a706 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:34.836438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebc889c3-5ae5-46d9-aa92-b1ef5a06a706 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:34.836993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebc889c3-5ae5-46d9-aa92-b1ef5a06a706 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:34.837458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1a17c93f-923e-4667-b538-84a04d82b06a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:34.837621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebc889c3-5ae5-46d9-aa92-b1ef5a06a706 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:34.838286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebc889c3-5ae5-46d9-aa92-b1ef5a06a706 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:34.838800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebc889c3-5ae5-46d9-aa92-b1ef5a06a706 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:34.839932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebc889c3-5ae5-46d9-aa92-b1ef5a06a706 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:34.846091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1a17c93f-923e-4667-b538-84a04d82b06a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151297 Aug 06 12:56:34.847012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1277/2561] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:34 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:34.946343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:34.946947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:34.953790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:34.954200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:34.954633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:34.955321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:34.955771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:34.956188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:34.974761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ebc889c3-5ae5-46d9-aa92-b1ef5a06a706 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:34.983903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ebc889c3-5ae5-46d9-aa92-b1ef5a06a706 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.158412 Aug 06 12:56:34.984567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1285/2562] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:34 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:35.022606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:35.031001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:35.032513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:35.033634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6eef31c2-fc3b-44d0-aa25-b3a387ce81eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.091193 Aug 06 12:56:35.034182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1278/2563] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:35.386003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0b11f0f9-4a7f-4d91-ae3d-86f1dc860dbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:35.387552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0b11f0f9-4a7f-4d91-ae3d-86f1dc860dbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:35.394304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b11f0f9-4a7f-4d91-ae3d-86f1dc860dbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:35.394789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b11f0f9-4a7f-4d91-ae3d-86f1dc860dbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:35.395223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b11f0f9-4a7f-4d91-ae3d-86f1dc860dbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:35.395907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b11f0f9-4a7f-4d91-ae3d-86f1dc860dbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:35.396380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b11f0f9-4a7f-4d91-ae3d-86f1dc860dbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:35.396805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b11f0f9-4a7f-4d91-ae3d-86f1dc860dbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:35.412484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:35.459404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0b11f0f9-4a7f-4d91-ae3d-86f1dc860dbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:35.467646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0b11f0f9-4a7f-4d91-ae3d-86f1dc860dbc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085520 Aug 06 12:56:35.468199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1286/2564] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:35 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:35.867869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bef2de4c-9090-406c-af52-0a8ed692c3c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:35.868513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bef2de4c-9090-406c-af52-0a8ed692c3c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:35.874923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef2de4c-9090-406c-af52-0a8ed692c3c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:35.875399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef2de4c-9090-406c-af52-0a8ed692c3c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:35.875833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef2de4c-9090-406c-af52-0a8ed692c3c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:35.876536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef2de4c-9090-406c-af52-0a8ed692c3c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:35.876986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef2de4c-9090-406c-af52-0a8ed692c3c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:35.877407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef2de4c-9090-406c-af52-0a8ed692c3c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:36.004281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bef2de4c-9090-406c-af52-0a8ed692c3c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:36.005508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4da27918-fa6c-40ad-b113-2a8d3b0b26f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:36.006120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4da27918-fa6c-40ad-b113-2a8d3b0b26f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:36.012564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4da27918-fa6c-40ad-b113-2a8d3b0b26f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:36.012909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bef2de4c-9090-406c-af52-0a8ed692c3c6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148785 Aug 06 12:56:36.013069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4da27918-fa6c-40ad-b113-2a8d3b0b26f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:36.013479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1279/2565] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:35 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:36.013708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4da27918-fa6c-40ad-b113-2a8d3b0b26f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:36.014563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4da27918-fa6c-40ad-b113-2a8d3b0b26f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:36.015008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4da27918-fa6c-40ad-b113-2a8d3b0b26f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:36.015424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4da27918-fa6c-40ad-b113-2a8d3b0b26f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:36.056173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:36.056825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:36.062810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:36.063286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:36.063736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:36.064443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:36.064895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:36.065316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:36.126066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:36.134447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:36.136478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:36.137631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1d65654d-9a57-41df-99f8-72850735a237 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085315 Aug 06 12:56:36.138194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1280/2566] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:36.141216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4da27918-fa6c-40ad-b113-2a8d3b0b26f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:36.149097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4da27918-fa6c-40ad-b113-2a8d3b0b26f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147388 Aug 06 12:56:36.150350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1287/2567] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:36 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:36.488979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-09a04fdf-4c08-4324-80cd-6c53c6c9ae9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:36.489587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-09a04fdf-4c08-4324-80cd-6c53c6c9ae9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:36.496623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a04fdf-4c08-4324-80cd-6c53c6c9ae9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:36.497411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a04fdf-4c08-4324-80cd-6c53c6c9ae9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:36.498098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a04fdf-4c08-4324-80cd-6c53c6c9ae9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:36.499307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a04fdf-4c08-4324-80cd-6c53c6c9ae9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:36.500134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a04fdf-4c08-4324-80cd-6c53c6c9ae9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:36.500913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a04fdf-4c08-4324-80cd-6c53c6c9ae9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:36.566155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09a04fdf-4c08-4324-80cd-6c53c6c9ae9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:36.573945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-09a04fdf-4c08-4324-80cd-6c53c6c9ae9f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.088813 Aug 06 12:56:36.574508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1281/2568] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:36 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:37.033909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-689be643-8813-4f30-9b9b-ed9fb1e36481 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:37.034538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-689be643-8813-4f30-9b9b-ed9fb1e36481 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:37.041004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-689be643-8813-4f30-9b9b-ed9fb1e36481 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:37.041477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-689be643-8813-4f30-9b9b-ed9fb1e36481 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:37.041903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-689be643-8813-4f30-9b9b-ed9fb1e36481 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:37.042574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-689be643-8813-4f30-9b9b-ed9fb1e36481 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:37.043016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-689be643-8813-4f30-9b9b-ed9fb1e36481 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:37.043430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-689be643-8813-4f30-9b9b-ed9fb1e36481 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:37.161244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:37.161853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:37.168533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:37.169092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:37.170779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:37.171468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:37.171883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:37.172399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:37.176490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-689be643-8813-4f30-9b9b-ed9fb1e36481 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:37.187856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-689be643-8813-4f30-9b9b-ed9fb1e36481 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.157734 Aug 06 12:56:37.188518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1288/2569] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:37 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:37.193152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-30cc0623-ca76-404a-88e6-53cde020d02d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:37.193740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-30cc0623-ca76-404a-88e6-53cde020d02d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:37.199974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30cc0623-ca76-404a-88e6-53cde020d02d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:37.200469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30cc0623-ca76-404a-88e6-53cde020d02d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:37.200898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30cc0623-ca76-404a-88e6-53cde020d02d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:37.201570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30cc0623-ca76-404a-88e6-53cde020d02d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:37.202139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30cc0623-ca76-404a-88e6-53cde020d02d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:37.202555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-30cc0623-ca76-404a-88e6-53cde020d02d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:37.237670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:37.246653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:37.248159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:37.249340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f382e359-7909-48e9-beec-48350fb01e50 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.092086 Aug 06 12:56:37.249908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1282/2570] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:37.330495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-30cc0623-ca76-404a-88e6-53cde020d02d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:37.338395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-30cc0623-ca76-404a-88e6-53cde020d02d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148949 Aug 06 12:56:37.338951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1289/2571] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:37 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:37.594447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-47cd35e1-7f1f-49c4-a89c-9666546da2e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:37.595055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-47cd35e1-7f1f-49c4-a89c-9666546da2e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:37.601048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47cd35e1-7f1f-49c4-a89c-9666546da2e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:37.601528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47cd35e1-7f1f-49c4-a89c-9666546da2e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:37.601958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47cd35e1-7f1f-49c4-a89c-9666546da2e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:37.602635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47cd35e1-7f1f-49c4-a89c-9666546da2e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:37.603087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47cd35e1-7f1f-49c4-a89c-9666546da2e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:37.603509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47cd35e1-7f1f-49c4-a89c-9666546da2e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:37.665746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-47cd35e1-7f1f-49c4-a89c-9666546da2e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:37.674180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-47cd35e1-7f1f-49c4-a89c-9666546da2e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083605 Aug 06 12:56:37.674743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1283/2572] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:38.209572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-506b9a85-382b-4ee4-95e0-b8be16a1a8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:38.210173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-506b9a85-382b-4ee4-95e0-b8be16a1a8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:38.217157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-506b9a85-382b-4ee4-95e0-b8be16a1a8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:38.217631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-506b9a85-382b-4ee4-95e0-b8be16a1a8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:38.218055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-506b9a85-382b-4ee4-95e0-b8be16a1a8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:38.218722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-506b9a85-382b-4ee4-95e0-b8be16a1a8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:38.219166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-506b9a85-382b-4ee4-95e0-b8be16a1a8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:38.219580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-506b9a85-382b-4ee4-95e0-b8be16a1a8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:38.272588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:38.273187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:38.280596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:38.281082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:38.281516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:38.282206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:38.282658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:38.283080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:38.344882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:38.355438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:38.357576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:38.358222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-506b9a85-382b-4ee4-95e0-b8be16a1a8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:38.361250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-17f4d50a-402c-4ef6-b2a4-1d6478850904 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090214 Aug 06 12:56:38.362107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1284/2573] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:38.368552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-506b9a85-382b-4ee4-95e0-b8be16a1a8ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.163104 Aug 06 12:56:38.368740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e8deefff-5805-42a3-bd4e-ba24c0299fbe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:38.377009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e8deefff-5805-42a3-bd4e-ba24c0299fbe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:38.377193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1290/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:38 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:38.377310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e8deefff-5805-42a3-bd4e-ba24c0299fbe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:38.377310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e8deefff-5805-42a3-bd4e-ba24c0299fbe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:38.377310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e8deefff-5805-42a3-bd4e-ba24c0299fbe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:38.377310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e8deefff-5805-42a3-bd4e-ba24c0299fbe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:38.377708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e8deefff-5805-42a3-bd4e-ba24c0299fbe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:38.377812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e8deefff-5805-42a3-bd4e-ba24c0299fbe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:38.505268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e8deefff-5805-42a3-bd4e-ba24c0299fbe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:38.513566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e8deefff-5805-42a3-bd4e-ba24c0299fbe tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150794 Aug 06 12:56:38.514127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1285/2575] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:38 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:38.695298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4e66cc8a-3280-45a2-9c31-b85735493dcb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:38.695919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4e66cc8a-3280-45a2-9c31-b85735493dcb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:38.703621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e66cc8a-3280-45a2-9c31-b85735493dcb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:38.704100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e66cc8a-3280-45a2-9c31-b85735493dcb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:38.704556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e66cc8a-3280-45a2-9c31-b85735493dcb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:38.705241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e66cc8a-3280-45a2-9c31-b85735493dcb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:38.705697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e66cc8a-3280-45a2-9c31-b85735493dcb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:38.706119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e66cc8a-3280-45a2-9c31-b85735493dcb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:38.775127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4e66cc8a-3280-45a2-9c31-b85735493dcb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:38.783050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4e66cc8a-3280-45a2-9c31-b85735493dcb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.091578 Aug 06 12:56:38.783620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1291/2576] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:39.382974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:39.383619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:39.389625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4f4636d4-c571-4792-9a35-3a6611a40479 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:39.390116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:39.390247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4f4636d4-c571-4792-9a35-3a6611a40479 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:39.390601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:39.391036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:39.391721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:39.392182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:39.392634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:39.396404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f4636d4-c571-4792-9a35-3a6611a40479 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:39.396881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f4636d4-c571-4792-9a35-3a6611a40479 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:39.397308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f4636d4-c571-4792-9a35-3a6611a40479 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:39.397986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f4636d4-c571-4792-9a35-3a6611a40479 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:39.398428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f4636d4-c571-4792-9a35-3a6611a40479 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:39.398846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f4636d4-c571-4792-9a35-3a6611a40479 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:39.454122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:39.462533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:39.464540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:39.465665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-301c5123-6d56-4eee-92e4-6ced55f0dea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086664 Aug 06 12:56:39.466217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1286/2577] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:39.526229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4f4636d4-c571-4792-9a35-3a6611a40479 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:39.534783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4f4636d4-c571-4792-9a35-3a6611a40479 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148835 Aug 06 12:56:39.534964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9d39382d-2e06-4f2b-8958-2b95db37a3e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:39.535381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1292/2578] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:39 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:39.535604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9d39382d-2e06-4f2b-8958-2b95db37a3e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:39.541213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d39382d-2e06-4f2b-8958-2b95db37a3e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:39.541702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d39382d-2e06-4f2b-8958-2b95db37a3e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:39.542774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d39382d-2e06-4f2b-8958-2b95db37a3e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:39.543451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d39382d-2e06-4f2b-8958-2b95db37a3e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:39.543895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d39382d-2e06-4f2b-8958-2b95db37a3e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:39.544327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d39382d-2e06-4f2b-8958-2b95db37a3e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:39.675048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9d39382d-2e06-4f2b-8958-2b95db37a3e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:39.682930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9d39382d-2e06-4f2b-8958-2b95db37a3e4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151742 Aug 06 12:56:39.683552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1287/2579] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:39 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:39.803616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e37051f3-b53b-436a-80ad-67265565eb50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:39.804226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e37051f3-b53b-436a-80ad-67265565eb50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:39.810084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37051f3-b53b-436a-80ad-67265565eb50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:39.810562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37051f3-b53b-436a-80ad-67265565eb50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:39.810995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37051f3-b53b-436a-80ad-67265565eb50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:39.811707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37051f3-b53b-436a-80ad-67265565eb50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:39.812160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37051f3-b53b-436a-80ad-67265565eb50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:39.812609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37051f3-b53b-436a-80ad-67265565eb50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:39.875892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e37051f3-b53b-436a-80ad-67265565eb50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:39.883850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e37051f3-b53b-436a-80ad-67265565eb50 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084023 Aug 06 12:56:39.884442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1293/2580] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:39 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:40.488794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:40.489386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:40.495865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:40.496375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:40.496816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:40.497501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:40.497955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:40.498380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:40.502225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:40.556450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e2c89179-fdb2-44f1-bd4a-b7698baa04d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:40.557065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e2c89179-fdb2-44f1-bd4a-b7698baa04d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:40.562486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:40.563563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2c89179-fdb2-44f1-bd4a-b7698baa04d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:40.564122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2c89179-fdb2-44f1-bd4a-b7698baa04d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:40.564646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2c89179-fdb2-44f1-bd4a-b7698baa04d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:40.565426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2c89179-fdb2-44f1-bd4a-b7698baa04d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:40.565951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2c89179-fdb2-44f1-bd4a-b7698baa04d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:40.566441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2c89179-fdb2-44f1-bd4a-b7698baa04d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:40.571039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:40.572593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:40.574219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e660eb2e-601b-4dbc-96b0-3b5447246442 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089305 Aug 06 12:56:40.574777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1288/2581] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:40.703497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e2c89179-fdb2-44f1-bd4a-b7698baa04d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:40.707630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7add782a-cc2c-4f37-8957-1e44dd8ed436 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:40.708663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7add782a-cc2c-4f37-8957-1e44dd8ed436 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:40.711628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e2c89179-fdb2-44f1-bd4a-b7698baa04d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.159066 Aug 06 12:56:40.712187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1294/2582] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:40 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:40.718344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7add782a-cc2c-4f37-8957-1e44dd8ed436 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:40.719068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7add782a-cc2c-4f37-8957-1e44dd8ed436 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:40.719730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7add782a-cc2c-4f37-8957-1e44dd8ed436 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:40.720801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7add782a-cc2c-4f37-8957-1e44dd8ed436 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:40.722230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7add782a-cc2c-4f37-8957-1e44dd8ed436 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:40.722230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7add782a-cc2c-4f37-8957-1e44dd8ed436 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:40.853032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7add782a-cc2c-4f37-8957-1e44dd8ed436 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:40.861088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7add782a-cc2c-4f37-8957-1e44dd8ed436 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.159727 Aug 06 12:56:40.861672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1289/2583] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:40 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:40.904136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ec9d3c53-d4e6-4fff-ae9e-108820902e84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:40.904761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ec9d3c53-d4e6-4fff-ae9e-108820902e84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:40.910532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec9d3c53-d4e6-4fff-ae9e-108820902e84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:40.911008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec9d3c53-d4e6-4fff-ae9e-108820902e84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:40.911437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec9d3c53-d4e6-4fff-ae9e-108820902e84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:40.912111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec9d3c53-d4e6-4fff-ae9e-108820902e84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:40.912597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec9d3c53-d4e6-4fff-ae9e-108820902e84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:40.913013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec9d3c53-d4e6-4fff-ae9e-108820902e84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:40.972647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ec9d3c53-d4e6-4fff-ae9e-108820902e84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:40.980419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ec9d3c53-d4e6-4fff-ae9e-108820902e84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.080142 Aug 06 12:56:40.980976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1295/2584] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:40 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:41.596459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:41.597074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:41.603403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:41.603883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:41.604333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:41.605617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:41.606069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:41.606492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:41.671622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:41.679900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:41.681576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:41.682742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2c1dda71-2b38-474c-9558-d747cbb0f463 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090239 Aug 06 12:56:41.683295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1290/2585] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:41.735040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4e3c3bb6-a449-4cd0-928d-cf9fc7faa6da tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:41.735638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4e3c3bb6-a449-4cd0-928d-cf9fc7faa6da tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:41.741963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e3c3bb6-a449-4cd0-928d-cf9fc7faa6da tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:41.742434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e3c3bb6-a449-4cd0-928d-cf9fc7faa6da tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:41.742859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e3c3bb6-a449-4cd0-928d-cf9fc7faa6da tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:41.743525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e3c3bb6-a449-4cd0-928d-cf9fc7faa6da tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:41.743968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e3c3bb6-a449-4cd0-928d-cf9fc7faa6da tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:41.744411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e3c3bb6-a449-4cd0-928d-cf9fc7faa6da tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:41.874941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4e3c3bb6-a449-4cd0-928d-cf9fc7faa6da tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:41.882865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-12540b1e-d36b-4c7f-81ef-50ed905f1523 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:41.883221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4e3c3bb6-a449-4cd0-928d-cf9fc7faa6da tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152170 Aug 06 12:56:41.883478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-12540b1e-d36b-4c7f-81ef-50ed905f1523 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:41.883795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1296/2586] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:41 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:41.889478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12540b1e-d36b-4c7f-81ef-50ed905f1523 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:41.889959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12540b1e-d36b-4c7f-81ef-50ed905f1523 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:41.890396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12540b1e-d36b-4c7f-81ef-50ed905f1523 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:41.891083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12540b1e-d36b-4c7f-81ef-50ed905f1523 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:41.891535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12540b1e-d36b-4c7f-81ef-50ed905f1523 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:41.891984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12540b1e-d36b-4c7f-81ef-50ed905f1523 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:42.001555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-36c34a1f-5731-4a9f-b17b-caaead84e056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:42.004194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-36c34a1f-5731-4a9f-b17b-caaead84e056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:42.009961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36c34a1f-5731-4a9f-b17b-caaead84e056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:42.010434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36c34a1f-5731-4a9f-b17b-caaead84e056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:42.011350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36c34a1f-5731-4a9f-b17b-caaead84e056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:42.012027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36c34a1f-5731-4a9f-b17b-caaead84e056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:42.012501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36c34a1f-5731-4a9f-b17b-caaead84e056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:42.012918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36c34a1f-5731-4a9f-b17b-caaead84e056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:42.022589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-12540b1e-d36b-4c7f-81ef-50ed905f1523 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:42.031202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-12540b1e-d36b-4c7f-81ef-50ed905f1523 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152120 Aug 06 12:56:42.031752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1291/2587] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:41 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:42.073743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-36c34a1f-5731-4a9f-b17b-caaead84e056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:42.081509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-36c34a1f-5731-4a9f-b17b-caaead84e056 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083886 Aug 06 12:56:42.082076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1297/2588] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:41 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:42.705447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:42.706021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:42.713327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:42.714135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:42.714568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:42.715242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:42.715688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:42.716104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:42.778501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:42.786980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:42.788483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:42.789603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c7ef46c7-9ac3-4cf1-bef9-ff7cfa87b0c4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088084 Aug 06 12:56:42.790150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1292/2589] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:42.904172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9123545a-f9c4-4a8b-9075-0e018173d08a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:42.904813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9123545a-f9c4-4a8b-9075-0e018173d08a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:42.911146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9123545a-f9c4-4a8b-9075-0e018173d08a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:42.911629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9123545a-f9c4-4a8b-9075-0e018173d08a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:42.912063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9123545a-f9c4-4a8b-9075-0e018173d08a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:42.912782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9123545a-f9c4-4a8b-9075-0e018173d08a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:42.913238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9123545a-f9c4-4a8b-9075-0e018173d08a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:42.913664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9123545a-f9c4-4a8b-9075-0e018173d08a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:43.040219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9123545a-f9c4-4a8b-9075-0e018173d08a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:43.048711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9123545a-f9c4-4a8b-9075-0e018173d08a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148355 Aug 06 12:56:43.049319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1298/2590] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:42 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:43.053021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90452b28-f428-4a87-a11d-8ae8daa3a357 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:43.053630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90452b28-f428-4a87-a11d-8ae8daa3a357 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:43.060124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90452b28-f428-4a87-a11d-8ae8daa3a357 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:43.060646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90452b28-f428-4a87-a11d-8ae8daa3a357 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:43.061077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90452b28-f428-4a87-a11d-8ae8daa3a357 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:43.061756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90452b28-f428-4a87-a11d-8ae8daa3a357 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:43.062207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90452b28-f428-4a87-a11d-8ae8daa3a357 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:43.062627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90452b28-f428-4a87-a11d-8ae8daa3a357 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:43.103533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b760b8ec-2b32-472e-8e97-60308b734509 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:43.104248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b760b8ec-2b32-472e-8e97-60308b734509 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:43.111154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b760b8ec-2b32-472e-8e97-60308b734509 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:43.111634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b760b8ec-2b32-472e-8e97-60308b734509 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:43.112071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b760b8ec-2b32-472e-8e97-60308b734509 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:43.112793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b760b8ec-2b32-472e-8e97-60308b734509 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:43.113246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b760b8ec-2b32-472e-8e97-60308b734509 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:43.113669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b760b8ec-2b32-472e-8e97-60308b734509 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:43.180934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b760b8ec-2b32-472e-8e97-60308b734509 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:43.188966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b760b8ec-2b32-472e-8e97-60308b734509 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.090230 Aug 06 12:56:43.189535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1299/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:43.191926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90452b28-f428-4a87-a11d-8ae8daa3a357 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:43.202679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90452b28-f428-4a87-a11d-8ae8daa3a357 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153552 Aug 06 12:56:43.203243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1293/2592] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:43 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:43.812052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:43.812680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:43.818542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:43.819013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:43.819438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:43.820105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:43.820575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:43.820991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:43.881180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:43.890013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:43.891484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:43.892630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5ae3bf6e-3939-4b05-8dff-f78b5e8e5117 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084377 Aug 06 12:56:43.893170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1300/2593] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:44.070582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6ece5151-5a15-4598-b810-a33852fc1b25 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:44.071119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6ece5151-5a15-4598-b810-a33852fc1b25 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:44.078180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ece5151-5a15-4598-b810-a33852fc1b25 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:44.078654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ece5151-5a15-4598-b810-a33852fc1b25 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:44.079082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ece5151-5a15-4598-b810-a33852fc1b25 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:44.079761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ece5151-5a15-4598-b810-a33852fc1b25 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:44.080208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ece5151-5a15-4598-b810-a33852fc1b25 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:44.080652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ece5151-5a15-4598-b810-a33852fc1b25 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:44.209554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8b1bcef7-1403-4c28-b0c0-036363e91242 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:44.210236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8b1bcef7-1403-4c28-b0c0-036363e91242 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:44.210726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6ece5151-5a15-4598-b810-a33852fc1b25 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:44.217358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b1bcef7-1403-4c28-b0c0-036363e91242 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:44.217835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b1bcef7-1403-4c28-b0c0-036363e91242 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:44.218256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b1bcef7-1403-4c28-b0c0-036363e91242 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:44.218717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6ece5151-5a15-4598-b810-a33852fc1b25 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151993 Aug 06 12:56:44.219007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b1bcef7-1403-4c28-b0c0-036363e91242 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:44.219371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b1bcef7-1403-4c28-b0c0-036363e91242 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:44.219595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1294/2594] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:44 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:44.219784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8b1bcef7-1403-4c28-b0c0-036363e91242 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:44.223952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eada4b04-15e1-43e7-bd59-d5dfb98ff38a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:44.224575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eada4b04-15e1-43e7-bd59-d5dfb98ff38a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:44.230893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eada4b04-15e1-43e7-bd59-d5dfb98ff38a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:44.231370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eada4b04-15e1-43e7-bd59-d5dfb98ff38a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:44.231804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eada4b04-15e1-43e7-bd59-d5dfb98ff38a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:44.232521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eada4b04-15e1-43e7-bd59-d5dfb98ff38a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:44.232970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eada4b04-15e1-43e7-bd59-d5dfb98ff38a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:44.233390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eada4b04-15e1-43e7-bd59-d5dfb98ff38a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:44.282113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8b1bcef7-1403-4c28-b0c0-036363e91242 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:44.290404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8b1bcef7-1403-4c28-b0c0-036363e91242 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084814 Aug 06 12:56:44.290971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1301/2595] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:44.360110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eada4b04-15e1-43e7-bd59-d5dfb98ff38a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:44.367969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eada4b04-15e1-43e7-bd59-d5dfb98ff38a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147442 Aug 06 12:56:44.368545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1295/2596] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:44 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:44.914454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:44.915051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:44.921503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:44.921973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:44.922398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:44.923064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:44.923503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:44.923916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:44.986123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:44.994713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:44.996214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:44.997498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fcc07011-5cb6-42ad-ab9a-fade3e66311c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086920 Aug 06 12:56:44.998048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1302/2597] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:45.240513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-72c1f0e4-17fd-46e5-85eb-3b673c27347f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:45.241144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-72c1f0e4-17fd-46e5-85eb-3b673c27347f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:45.247422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c1f0e4-17fd-46e5-85eb-3b673c27347f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:45.247897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c1f0e4-17fd-46e5-85eb-3b673c27347f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:45.248344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c1f0e4-17fd-46e5-85eb-3b673c27347f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:45.249020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c1f0e4-17fd-46e5-85eb-3b673c27347f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:45.249468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c1f0e4-17fd-46e5-85eb-3b673c27347f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:45.249888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72c1f0e4-17fd-46e5-85eb-3b673c27347f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:45.311197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-183844e8-9cc1-444c-ba72-c8228a0d1b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:45.311919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-183844e8-9cc1-444c-ba72-c8228a0d1b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:45.318302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-183844e8-9cc1-444c-ba72-c8228a0d1b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:45.318776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-183844e8-9cc1-444c-ba72-c8228a0d1b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:45.319208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-183844e8-9cc1-444c-ba72-c8228a0d1b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:45.319887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-183844e8-9cc1-444c-ba72-c8228a0d1b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:45.320424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-183844e8-9cc1-444c-ba72-c8228a0d1b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:45.320961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-183844e8-9cc1-444c-ba72-c8228a0d1b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:45.325423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:45.386831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-72c1f0e4-17fd-46e5-85eb-3b673c27347f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:45.388133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-183844e8-9cc1-444c-ba72-c8228a0d1b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:45.394818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-72c1f0e4-17fd-46e5-85eb-3b673c27347f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.158165 Aug 06 12:56:45.395381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1296/2598] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:45 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:45.396106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-183844e8-9cc1-444c-ba72-c8228a0d1b6c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.088767 Aug 06 12:56:45.402737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1303/2599] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:45.402906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-058c1a12-f210-4c0b-a28e-b746c165935b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:45.402906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-058c1a12-f210-4c0b-a28e-b746c165935b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:45.406169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-058c1a12-f210-4c0b-a28e-b746c165935b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:45.406645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-058c1a12-f210-4c0b-a28e-b746c165935b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:45.407075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-058c1a12-f210-4c0b-a28e-b746c165935b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:45.407747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-058c1a12-f210-4c0b-a28e-b746c165935b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:45.408194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-058c1a12-f210-4c0b-a28e-b746c165935b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:45.408658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-058c1a12-f210-4c0b-a28e-b746c165935b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:45.534615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-058c1a12-f210-4c0b-a28e-b746c165935b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:45.542405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-058c1a12-f210-4c0b-a28e-b746c165935b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146097 Aug 06 12:56:45.542967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1297/2600] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:45 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:46.022984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:46.023588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:46.029704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:46.030182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:46.030614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:46.031289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:46.031738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:46.032186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:46.092382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:46.100637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:46.102131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:46.103250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b28afa50-7d0b-440d-b9ce-e6108af1c8cc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084195 Aug 06 12:56:46.103807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1304/2601] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:46.416319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3f2cec38-8252-41ce-b0fd-166826764394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:46.417436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-66346cef-dbe9-4536-971b-d12bd0bd0326 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:46.417826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3f2cec38-8252-41ce-b0fd-166826764394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:46.417943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-66346cef-dbe9-4536-971b-d12bd0bd0326 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:46.423625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66346cef-dbe9-4536-971b-d12bd0bd0326 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:46.423796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f2cec38-8252-41ce-b0fd-166826764394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:46.424096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66346cef-dbe9-4536-971b-d12bd0bd0326 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:46.424240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f2cec38-8252-41ce-b0fd-166826764394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:46.424561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66346cef-dbe9-4536-971b-d12bd0bd0326 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:46.424695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f2cec38-8252-41ce-b0fd-166826764394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:46.425230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66346cef-dbe9-4536-971b-d12bd0bd0326 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:46.425347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f2cec38-8252-41ce-b0fd-166826764394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:46.425675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66346cef-dbe9-4536-971b-d12bd0bd0326 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:46.426043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f2cec38-8252-41ce-b0fd-166826764394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:46.426163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66346cef-dbe9-4536-971b-d12bd0bd0326 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:46.426468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f2cec38-8252-41ce-b0fd-166826764394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:46.489625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-66346cef-dbe9-4536-971b-d12bd0bd0326 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:46.497609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-66346cef-dbe9-4536-971b-d12bd0bd0326 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085081 Aug 06 12:56:46.498167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1305/2602] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:46.556517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3f2cec38-8252-41ce-b0fd-166826764394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:46.562874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8e6f8d4e-76f0-448c-9145-87b638ae139c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:46.563564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8e6f8d4e-76f0-448c-9145-87b638ae139c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:46.564450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3f2cec38-8252-41ce-b0fd-166826764394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151903 Aug 06 12:56:46.565016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1298/2603] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:46 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:46.569750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e6f8d4e-76f0-448c-9145-87b638ae139c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:46.570299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e6f8d4e-76f0-448c-9145-87b638ae139c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:46.570735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e6f8d4e-76f0-448c-9145-87b638ae139c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:46.571415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e6f8d4e-76f0-448c-9145-87b638ae139c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:46.571863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e6f8d4e-76f0-448c-9145-87b638ae139c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:46.572280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e6f8d4e-76f0-448c-9145-87b638ae139c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:46.696824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8e6f8d4e-76f0-448c-9145-87b638ae139c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:46.704991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8e6f8d4e-76f0-448c-9145-87b638ae139c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145932 Aug 06 12:56:46.705561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1306/2604] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:46 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:47.126993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:47.127594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:47.133505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:47.133983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:47.134415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:47.135093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:47.136192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:47.136642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:47.199779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:47.208275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:47.209790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:47.210925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-af51ee84-600a-478c-8524-1ae060bf437a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087839 Aug 06 12:56:47.211483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1299/2605] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:47.517890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a9fe4c0-7124-49b8-b211-d32b0a8af885 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:47.518500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6a9fe4c0-7124-49b8-b211-d32b0a8af885 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:47.524907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a9fe4c0-7124-49b8-b211-d32b0a8af885 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:47.525387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a9fe4c0-7124-49b8-b211-d32b0a8af885 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:47.525820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a9fe4c0-7124-49b8-b211-d32b0a8af885 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:47.526496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a9fe4c0-7124-49b8-b211-d32b0a8af885 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:47.526943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a9fe4c0-7124-49b8-b211-d32b0a8af885 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:47.527363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a9fe4c0-7124-49b8-b211-d32b0a8af885 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:47.585736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4898c004-94d8-47a8-a90a-8b49f2c5629b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:47.586450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4898c004-94d8-47a8-a90a-8b49f2c5629b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:47.593249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6a9fe4c0-7124-49b8-b211-d32b0a8af885 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:47.593859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4898c004-94d8-47a8-a90a-8b49f2c5629b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:47.594359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4898c004-94d8-47a8-a90a-8b49f2c5629b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:47.594790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4898c004-94d8-47a8-a90a-8b49f2c5629b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:47.595492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4898c004-94d8-47a8-a90a-8b49f2c5629b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:47.595943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4898c004-94d8-47a8-a90a-8b49f2c5629b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:47.596772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4898c004-94d8-47a8-a90a-8b49f2c5629b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:47.601175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6a9fe4c0-7124-49b8-b211-d32b0a8af885 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.087133 Aug 06 12:56:47.601737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1307/2606] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:47.724819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4898c004-94d8-47a8-a90a-8b49f2c5629b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:47.726716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a0367704-1c99-4a05-bb18-7f1604348ac4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:47.727322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a0367704-1c99-4a05-bb18-7f1604348ac4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:47.733345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4898c004-94d8-47a8-a90a-8b49f2c5629b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151437 Aug 06 12:56:47.733991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0367704-1c99-4a05-bb18-7f1604348ac4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:47.734339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1300/2607] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:47 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:47.735237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0367704-1c99-4a05-bb18-7f1604348ac4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:47.735693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0367704-1c99-4a05-bb18-7f1604348ac4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:47.736422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0367704-1c99-4a05-bb18-7f1604348ac4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:47.736880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0367704-1c99-4a05-bb18-7f1604348ac4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:47.737301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0367704-1c99-4a05-bb18-7f1604348ac4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:47.863957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a0367704-1c99-4a05-bb18-7f1604348ac4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:47.871793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a0367704-1c99-4a05-bb18-7f1604348ac4 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148948 Aug 06 12:56:47.872372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1308/2608] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:47 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:48.233356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:48.234201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:48.240095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:48.240596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:48.241022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:48.241691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:48.242136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:48.242550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:48.302031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:48.310334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:48.311809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:48.312961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f1c56742-5d28-40b1-9e8c-5ea24280c0c7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083534 Aug 06 12:56:48.313517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1301/2609] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:48.623129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e83b32ba-b1f1-4cef-b545-51c6b4553b03 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:48.623654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e83b32ba-b1f1-4cef-b545-51c6b4553b03 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:48.630050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83b32ba-b1f1-4cef-b545-51c6b4553b03 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:48.630522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83b32ba-b1f1-4cef-b545-51c6b4553b03 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:48.631225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83b32ba-b1f1-4cef-b545-51c6b4553b03 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:48.631902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83b32ba-b1f1-4cef-b545-51c6b4553b03 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:48.632372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83b32ba-b1f1-4cef-b545-51c6b4553b03 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:48.632793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e83b32ba-b1f1-4cef-b545-51c6b4553b03 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:48.692578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e83b32ba-b1f1-4cef-b545-51c6b4553b03 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:48.700941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e83b32ba-b1f1-4cef-b545-51c6b4553b03 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082162 Aug 06 12:56:48.701499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1309/2610] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:48.753578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cf6e6645-9317-44fc-8e39-09b13a916429 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:48.754183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cf6e6645-9317-44fc-8e39-09b13a916429 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:48.760696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf6e6645-9317-44fc-8e39-09b13a916429 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:48.761171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf6e6645-9317-44fc-8e39-09b13a916429 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:48.761598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf6e6645-9317-44fc-8e39-09b13a916429 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:48.762270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf6e6645-9317-44fc-8e39-09b13a916429 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:48.762714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf6e6645-9317-44fc-8e39-09b13a916429 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:48.763129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf6e6645-9317-44fc-8e39-09b13a916429 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:48.892891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ffdf30c5-874e-4389-90c3-0e201cc799f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:48.893416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ffdf30c5-874e-4389-90c3-0e201cc799f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:48.896113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cf6e6645-9317-44fc-8e39-09b13a916429 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:48.899369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdf30c5-874e-4389-90c3-0e201cc799f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:48.899925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdf30c5-874e-4389-90c3-0e201cc799f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:48.900478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdf30c5-874e-4389-90c3-0e201cc799f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:48.901267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdf30c5-874e-4389-90c3-0e201cc799f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:48.901786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdf30c5-874e-4389-90c3-0e201cc799f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:48.902289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdf30c5-874e-4389-90c3-0e201cc799f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:48.903989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cf6e6645-9317-44fc-8e39-09b13a916429 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154193 Aug 06 12:56:48.904635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1302/2611] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:48 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:49.033851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ffdf30c5-874e-4389-90c3-0e201cc799f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:49.042234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ffdf30c5-874e-4389-90c3-0e201cc799f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152796 Aug 06 12:56:49.042786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1310/2612] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:48 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:49.334735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:49.335325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:49.341678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:49.342151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:49.342578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:49.343248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:49.343692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:49.344107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:49.405926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:49.414378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:49.415878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:49.417623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-194b073a-0203-4996-8950-7b1fa241c380 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086814 Aug 06 12:56:49.418179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1303/2613] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:49.721374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-060ddc1a-712a-44cc-9508-1ec38a6c56e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:49.722001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-060ddc1a-712a-44cc-9508-1ec38a6c56e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:49.728280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-060ddc1a-712a-44cc-9508-1ec38a6c56e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:49.728781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-060ddc1a-712a-44cc-9508-1ec38a6c56e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:49.729207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-060ddc1a-712a-44cc-9508-1ec38a6c56e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:49.729880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-060ddc1a-712a-44cc-9508-1ec38a6c56e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:49.730321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-060ddc1a-712a-44cc-9508-1ec38a6c56e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:49.730737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-060ddc1a-712a-44cc-9508-1ec38a6c56e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:49.791190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-060ddc1a-712a-44cc-9508-1ec38a6c56e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:49.798881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-060ddc1a-712a-44cc-9508-1ec38a6c56e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081357 Aug 06 12:56:49.799430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1311/2614] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:49.925529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd4402da-2015-45ba-b1e7-74844fd60b60 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:49.926133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd4402da-2015-45ba-b1e7-74844fd60b60 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:49.933042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4402da-2015-45ba-b1e7-74844fd60b60 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:49.933521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4402da-2015-45ba-b1e7-74844fd60b60 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:49.933950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4402da-2015-45ba-b1e7-74844fd60b60 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:49.934627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4402da-2015-45ba-b1e7-74844fd60b60 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:49.935076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4402da-2015-45ba-b1e7-74844fd60b60 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:49.935497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd4402da-2015-45ba-b1e7-74844fd60b60 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:50.062694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd4402da-2015-45ba-b1e7-74844fd60b60 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:50.063614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-12c13028-7ee9-4b3e-83f8-8249a48a4155 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:50.064248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-12c13028-7ee9-4b3e-83f8-8249a48a4155 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:50.064926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:50.070278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12c13028-7ee9-4b3e-83f8-8249a48a4155 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:50.070750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12c13028-7ee9-4b3e-83f8-8249a48a4155 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:50.071176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12c13028-7ee9-4b3e-83f8-8249a48a4155 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:50.071846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12c13028-7ee9-4b3e-83f8-8249a48a4155 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:50.072170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd4402da-2015-45ba-b1e7-74844fd60b60 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150446 Aug 06 12:56:50.072293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12c13028-7ee9-4b3e-83f8-8249a48a4155 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:50.072732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-12c13028-7ee9-4b3e-83f8-8249a48a4155 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:50.072897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1304/2615] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:49 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:50.197148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-12c13028-7ee9-4b3e-83f8-8249a48a4155 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:50.205652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-12c13028-7ee9-4b3e-83f8-8249a48a4155 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145854 Aug 06 12:56:50.206202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1312/2616] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:50 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:50.439821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:50.440462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:50.446336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:50.446804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:50.447246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:50.447897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:50.448367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:50.448784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:50.511771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:50.520032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:50.521538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:50.522659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2eb8d2d6-eb52-4001-bc39-a7f2be048844 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086929 Aug 06 12:56:50.523209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1305/2617] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:50.818863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-75830ce9-ba06-4fa4-9413-4ba37abb2e89 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:50.819465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-75830ce9-ba06-4fa4-9413-4ba37abb2e89 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:50.825770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75830ce9-ba06-4fa4-9413-4ba37abb2e89 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:50.826240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75830ce9-ba06-4fa4-9413-4ba37abb2e89 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:50.826666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75830ce9-ba06-4fa4-9413-4ba37abb2e89 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:50.827337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75830ce9-ba06-4fa4-9413-4ba37abb2e89 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:50.827782 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75830ce9-ba06-4fa4-9413-4ba37abb2e89 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:50.828196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75830ce9-ba06-4fa4-9413-4ba37abb2e89 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:50.894885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75830ce9-ba06-4fa4-9413-4ba37abb2e89 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:50.903255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-75830ce9-ba06-4fa4-9413-4ba37abb2e89 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.088192 Aug 06 12:56:50.903808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1313/2618] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:50 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:51.094296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-54da652b-6925-4218-b6bc-b3c1159251f6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:51.094837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-54da652b-6925-4218-b6bc-b3c1159251f6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:51.101203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54da652b-6925-4218-b6bc-b3c1159251f6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:51.101684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54da652b-6925-4218-b6bc-b3c1159251f6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:51.102120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54da652b-6925-4218-b6bc-b3c1159251f6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:51.102805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54da652b-6925-4218-b6bc-b3c1159251f6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:51.103256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54da652b-6925-4218-b6bc-b3c1159251f6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:51.103679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54da652b-6925-4218-b6bc-b3c1159251f6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:51.229637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-31eccb2b-1b19-4d4f-9a3f-8c3aec2d048d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:51.230336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-31eccb2b-1b19-4d4f-9a3f-8c3aec2d048d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:51.234252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-54da652b-6925-4218-b6bc-b3c1159251f6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:51.237579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31eccb2b-1b19-4d4f-9a3f-8c3aec2d048d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:51.238069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31eccb2b-1b19-4d4f-9a3f-8c3aec2d048d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:51.238507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31eccb2b-1b19-4d4f-9a3f-8c3aec2d048d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:51.239232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31eccb2b-1b19-4d4f-9a3f-8c3aec2d048d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:51.239774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31eccb2b-1b19-4d4f-9a3f-8c3aec2d048d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:51.240098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-31eccb2b-1b19-4d4f-9a3f-8c3aec2d048d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:51.242704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-54da652b-6925-4218-b6bc-b3c1159251f6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152274 Aug 06 12:56:51.243275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1306/2619] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:51 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:51.365418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-31eccb2b-1b19-4d4f-9a3f-8c3aec2d048d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:51.373868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-31eccb2b-1b19-4d4f-9a3f-8c3aec2d048d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150385 Aug 06 12:56:51.374426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1314/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:51 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:51.544594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:51.545195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:51.551050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:51.551529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:51.551960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:51.552668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:51.553120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:51.553549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:51.613388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:51.621981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:51.623475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:51.624626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-03749457-a06d-40d8-954d-b7f1335a52ae tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083923 Aug 06 12:56:51.625188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1307/2621] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:51.924140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7d5620f1-7641-4295-b0d8-358a277f599b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:51.924702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7d5620f1-7641-4295-b0d8-358a277f599b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:51.931014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d5620f1-7641-4295-b0d8-358a277f599b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:51.931496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d5620f1-7641-4295-b0d8-358a277f599b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:51.931932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d5620f1-7641-4295-b0d8-358a277f599b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:51.933228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d5620f1-7641-4295-b0d8-358a277f599b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:51.933684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d5620f1-7641-4295-b0d8-358a277f599b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:51.934110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d5620f1-7641-4295-b0d8-358a277f599b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:51.994600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7d5620f1-7641-4295-b0d8-358a277f599b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:52.003167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7d5620f1-7641-4295-b0d8-358a277f599b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082970 Aug 06 12:56:52.003722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1315/2622] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:52.263738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-97e03da0-05d1-4952-872a-201b45f9b1ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:52.264273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-97e03da0-05d1-4952-872a-201b45f9b1ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:52.270774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97e03da0-05d1-4952-872a-201b45f9b1ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:52.271256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97e03da0-05d1-4952-872a-201b45f9b1ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:52.271685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97e03da0-05d1-4952-872a-201b45f9b1ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:52.272394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97e03da0-05d1-4952-872a-201b45f9b1ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:52.272849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97e03da0-05d1-4952-872a-201b45f9b1ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:52.273270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97e03da0-05d1-4952-872a-201b45f9b1ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:52.394899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f23c5a06-56a4-4fe1-a673-81b80ae5cf28 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:52.395540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f23c5a06-56a4-4fe1-a673-81b80ae5cf28 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:52.401774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-97e03da0-05d1-4952-872a-201b45f9b1ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:52.402256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f23c5a06-56a4-4fe1-a673-81b80ae5cf28 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:52.402745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f23c5a06-56a4-4fe1-a673-81b80ae5cf28 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:52.403182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f23c5a06-56a4-4fe1-a673-81b80ae5cf28 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:52.403875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f23c5a06-56a4-4fe1-a673-81b80ae5cf28 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:52.404355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f23c5a06-56a4-4fe1-a673-81b80ae5cf28 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:52.404786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f23c5a06-56a4-4fe1-a673-81b80ae5cf28 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:52.409607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-97e03da0-05d1-4952-872a-201b45f9b1ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149853 Aug 06 12:56:52.410273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1308/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:52 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:52.535077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f23c5a06-56a4-4fe1-a673-81b80ae5cf28 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:52.542952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f23c5a06-56a4-4fe1-a673-81b80ae5cf28 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151856 Aug 06 12:56:52.543510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1316/2624] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:52 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:52.647216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:52.647820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:52.654333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:52.654816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:52.655248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:52.655926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:52.656400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:52.656823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:52.716576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:52.724826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:52.726316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:52.727447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-888299a4-46b2-4672-a5d5-d02b335a922a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084078 Aug 06 12:56:52.727997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1309/2625] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:53.022963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1bddbede-7a11-490f-a515-e7b2159668a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:53.023570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1bddbede-7a11-490f-a515-e7b2159668a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:53.030084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1bddbede-7a11-490f-a515-e7b2159668a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:53.030566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1bddbede-7a11-490f-a515-e7b2159668a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:53.030998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1bddbede-7a11-490f-a515-e7b2159668a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:53.031682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1bddbede-7a11-490f-a515-e7b2159668a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:53.032131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1bddbede-7a11-490f-a515-e7b2159668a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:53.032577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1bddbede-7a11-490f-a515-e7b2159668a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:53.092837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1bddbede-7a11-490f-a515-e7b2159668a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:53.100670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1bddbede-7a11-490f-a515-e7b2159668a4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081525 Aug 06 12:56:53.101229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1317/2626] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:53 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:53.434607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6a97562b-422c-4dc0-ab30-55a3044c543a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:53.435301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6a97562b-422c-4dc0-ab30-55a3044c543a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:53.441721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a97562b-422c-4dc0-ab30-55a3044c543a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:53.442200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a97562b-422c-4dc0-ab30-55a3044c543a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:53.442624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a97562b-422c-4dc0-ab30-55a3044c543a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:53.443296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a97562b-422c-4dc0-ab30-55a3044c543a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:53.443740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a97562b-422c-4dc0-ab30-55a3044c543a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:53.444156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a97562b-422c-4dc0-ab30-55a3044c543a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:53.564149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f3508b52-811a-403f-b277-0de8357fe2d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:53.564773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f3508b52-811a-403f-b277-0de8357fe2d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:53.570658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3508b52-811a-403f-b277-0de8357fe2d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:53.571127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3508b52-811a-403f-b277-0de8357fe2d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:53.571425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6a97562b-422c-4dc0-ab30-55a3044c543a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:53.571575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3508b52-811a-403f-b277-0de8357fe2d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:53.572214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3508b52-811a-403f-b277-0de8357fe2d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:53.572684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3508b52-811a-403f-b277-0de8357fe2d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:53.573099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3508b52-811a-403f-b277-0de8357fe2d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:53.579448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6a97562b-422c-4dc0-ab30-55a3044c543a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150034 Aug 06 12:56:53.580010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1310/2627] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:53 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:53.697652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f3508b52-811a-403f-b277-0de8357fe2d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:53.705973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f3508b52-811a-403f-b277-0de8357fe2d2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145566 Aug 06 12:56:53.706526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1318/2628] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:53 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:53.750119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:53.750715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:53.756562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:53.757032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:53.757459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:53.758129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:53.758574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:53.758989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:53.822605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:53.830982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:53.832517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:53.833651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e6428644-4023-492a-982b-75e3ab42b0f1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087436 Aug 06 12:56:53.834207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1311/2629] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:54.121433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-93747c20-b28a-4869-994e-ff77bdb0f07d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:54.122026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-93747c20-b28a-4869-994e-ff77bdb0f07d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:54.128372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93747c20-b28a-4869-994e-ff77bdb0f07d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:54.128842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93747c20-b28a-4869-994e-ff77bdb0f07d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:54.129264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93747c20-b28a-4869-994e-ff77bdb0f07d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:54.129930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93747c20-b28a-4869-994e-ff77bdb0f07d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:54.130372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93747c20-b28a-4869-994e-ff77bdb0f07d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:54.130783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93747c20-b28a-4869-994e-ff77bdb0f07d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:54.194139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-93747c20-b28a-4869-994e-ff77bdb0f07d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:54.196370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:54.203683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-93747c20-b28a-4869-994e-ff77bdb0f07d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.086180 Aug 06 12:56:54.204238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1319/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:54 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:54.600912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d61ce4c2-e71e-4c55-bcb1-9ef3337bc532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:54.601503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d61ce4c2-e71e-4c55-bcb1-9ef3337bc532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:54.603795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:54.609356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d61ce4c2-e71e-4c55-bcb1-9ef3337bc532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:54.609829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d61ce4c2-e71e-4c55-bcb1-9ef3337bc532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:54.610256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d61ce4c2-e71e-4c55-bcb1-9ef3337bc532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:54.610930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d61ce4c2-e71e-4c55-bcb1-9ef3337bc532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:54.611375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d61ce4c2-e71e-4c55-bcb1-9ef3337bc532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:54.611792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d61ce4c2-e71e-4c55-bcb1-9ef3337bc532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:54.727822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-56a5f29c-1ff7-4542-8d8b-22095900a925 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:54.728458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-56a5f29c-1ff7-4542-8d8b-22095900a925 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:54.734974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a5f29c-1ff7-4542-8d8b-22095900a925 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:54.735452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a5f29c-1ff7-4542-8d8b-22095900a925 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:54.735882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a5f29c-1ff7-4542-8d8b-22095900a925 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:54.736590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a5f29c-1ff7-4542-8d8b-22095900a925 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:54.737045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a5f29c-1ff7-4542-8d8b-22095900a925 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:54.737469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56a5f29c-1ff7-4542-8d8b-22095900a925 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:54.738252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d61ce4c2-e71e-4c55-bcb1-9ef3337bc532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:54.746764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d61ce4c2-e71e-4c55-bcb1-9ef3337bc532 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149670 Aug 06 12:56:54.747465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1312/2631] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:54 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:54.861441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:54.862067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:54.865035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-56a5f29c-1ff7-4542-8d8b-22095900a925 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:54.868049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:54.868683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:54.869115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:54.870383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:54.870828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:54.871245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:54.873862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-56a5f29c-1ff7-4542-8d8b-22095900a925 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149675 Aug 06 12:56:54.874510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1320/2632] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:54 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:54.931154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:54.940116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:54.941623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:54.942733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-51050d35-c739-4c90-b19a-655ced51a81b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086148 Aug 06 12:56:54.943288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1313/2633] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:55.224829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c1be940-b3ef-4db6-b03b-1d51c423195f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:55.225470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c1be940-b3ef-4db6-b03b-1d51c423195f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:55.232852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c1be940-b3ef-4db6-b03b-1d51c423195f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:55.233337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c1be940-b3ef-4db6-b03b-1d51c423195f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:55.234020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c1be940-b3ef-4db6-b03b-1d51c423195f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:55.234706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c1be940-b3ef-4db6-b03b-1d51c423195f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:55.235160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c1be940-b3ef-4db6-b03b-1d51c423195f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:55.235586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c1be940-b3ef-4db6-b03b-1d51c423195f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:55.298342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4c1be940-b3ef-4db6-b03b-1d51c423195f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:55.306223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c1be940-b3ef-4db6-b03b-1d51c423195f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085248 Aug 06 12:56:55.306784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1321/2634] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:55 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:55.767917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50438109-fd9a-42fd-a246-0194821a4e3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:55.768539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50438109-fd9a-42fd-a246-0194821a4e3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:55.774981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50438109-fd9a-42fd-a246-0194821a4e3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:55.775459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50438109-fd9a-42fd-a246-0194821a4e3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:55.776499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50438109-fd9a-42fd-a246-0194821a4e3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:55.777186 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50438109-fd9a-42fd-a246-0194821a4e3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:55.777638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50438109-fd9a-42fd-a246-0194821a4e3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:55.778060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50438109-fd9a-42fd-a246-0194821a4e3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:55.894967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-821989d6-b5bf-403b-92bf-1cbac7d4fc4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:55.895571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-821989d6-b5bf-403b-92bf-1cbac7d4fc4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:55.897467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:55.902772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-821989d6-b5bf-403b-92bf-1cbac7d4fc4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:55.903249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-821989d6-b5bf-403b-92bf-1cbac7d4fc4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:55.903678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-821989d6-b5bf-403b-92bf-1cbac7d4fc4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:55.904390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-821989d6-b5bf-403b-92bf-1cbac7d4fc4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:55.904842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-821989d6-b5bf-403b-92bf-1cbac7d4fc4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:55.905267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-821989d6-b5bf-403b-92bf-1cbac7d4fc4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:55.907470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-50438109-fd9a-42fd-a246-0194821a4e3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:55.915486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-50438109-fd9a-42fd-a246-0194821a4e3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151422 Aug 06 12:56:55.916077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1314/2635] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:55 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:55.964913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:55.965516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:55.971341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:55.971821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:55.972255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:55.972965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:55.973417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:55.973842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:56.037849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-821989d6-b5bf-403b-92bf-1cbac7d4fc4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:56.039026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:56.048214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-821989d6-b5bf-403b-92bf-1cbac7d4fc4d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.157050 Aug 06 12:56:56.048824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1322/2636] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:55 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:56.049831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:56.051853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:56.053037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9312a849-a85a-4a24-aa5f-433be9172a41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.091986 Aug 06 12:56:56.053597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1315/2637] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:56.326738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-424c5566-d8a2-4a11-8b67-2a4a1d25ef84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:56.327259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-424c5566-d8a2-4a11-8b67-2a4a1d25ef84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:56.333686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-424c5566-d8a2-4a11-8b67-2a4a1d25ef84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:56.334158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-424c5566-d8a2-4a11-8b67-2a4a1d25ef84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:56.334580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-424c5566-d8a2-4a11-8b67-2a4a1d25ef84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:56.335254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-424c5566-d8a2-4a11-8b67-2a4a1d25ef84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:56.335698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-424c5566-d8a2-4a11-8b67-2a4a1d25ef84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:56.336112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-424c5566-d8a2-4a11-8b67-2a4a1d25ef84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:56.405043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-424c5566-d8a2-4a11-8b67-2a4a1d25ef84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:56.412890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-424c5566-d8a2-4a11-8b67-2a4a1d25ef84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.090085 Aug 06 12:56:56.413446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1323/2638] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:56.936545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-be60b454-72ea-4a40-a431-0259a79e0196 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:56.937146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-be60b454-72ea-4a40-a431-0259a79e0196 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:56.943423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be60b454-72ea-4a40-a431-0259a79e0196 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:56.943898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be60b454-72ea-4a40-a431-0259a79e0196 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:56.944345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be60b454-72ea-4a40-a431-0259a79e0196 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:56.945018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be60b454-72ea-4a40-a431-0259a79e0196 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:56.945461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be60b454-72ea-4a40-a431-0259a79e0196 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:56.945875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be60b454-72ea-4a40-a431-0259a79e0196 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:57.074842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-938d36e3-5ecb-436a-8bbd-821affe85eba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:57.075547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-938d36e3-5ecb-436a-8bbd-821affe85eba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:57.081588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-938d36e3-5ecb-436a-8bbd-821affe85eba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:57.081755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-be60b454-72ea-4a40-a431-0259a79e0196 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:57.082074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-938d36e3-5ecb-436a-8bbd-821affe85eba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:57.082505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-938d36e3-5ecb-436a-8bbd-821affe85eba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:57.083193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-938d36e3-5ecb-436a-8bbd-821affe85eba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:57.083648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-938d36e3-5ecb-436a-8bbd-821affe85eba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:57.084066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-938d36e3-5ecb-436a-8bbd-821affe85eba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:57.090181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-be60b454-72ea-4a40-a431-0259a79e0196 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.157481 Aug 06 12:56:57.090738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1316/2639] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:56 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:57.095117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:57.095707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:57.101413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:57.102161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:57.102395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:57.103073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:57.103586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:57.104001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:57.168061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:57.176541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:57.178014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:57.179137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d7d9b977-e947-438d-a7e3-abf03126564d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087501 Aug 06 12:56:57.179690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1317/2640] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:57.214690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-938d36e3-5ecb-436a-8bbd-821affe85eba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:57.222472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-938d36e3-5ecb-436a-8bbd-821affe85eba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151958 Aug 06 12:56:57.223014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1324/2641] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:57 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:57.434211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5f9a6b98-46e4-4441-935e-58160f9a2d4f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:57.434865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5f9a6b98-46e4-4441-935e-58160f9a2d4f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:57.440753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f9a6b98-46e4-4441-935e-58160f9a2d4f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:57.441226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f9a6b98-46e4-4441-935e-58160f9a2d4f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:57.441658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f9a6b98-46e4-4441-935e-58160f9a2d4f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:57.442336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f9a6b98-46e4-4441-935e-58160f9a2d4f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:57.442792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f9a6b98-46e4-4441-935e-58160f9a2d4f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:57.443213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f9a6b98-46e4-4441-935e-58160f9a2d4f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:57.502879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f9a6b98-46e4-4441-935e-58160f9a2d4f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:57.511502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5f9a6b98-46e4-4441-935e-58160f9a2d4f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081600 Aug 06 12:56:57.512058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1318/2642] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:57 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:58.111683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5b0f298e-e78f-4c89-8a5b-6519609784e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:58.112274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5b0f298e-e78f-4c89-8a5b-6519609784e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:58.118653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0f298e-e78f-4c89-8a5b-6519609784e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:58.119124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0f298e-e78f-4c89-8a5b-6519609784e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:58.119580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0f298e-e78f-4c89-8a5b-6519609784e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:58.120249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0f298e-e78f-4c89-8a5b-6519609784e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:58.120717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0f298e-e78f-4c89-8a5b-6519609784e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:58.121131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b0f298e-e78f-4c89-8a5b-6519609784e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:58.201787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:58.202421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:58.208874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:58.209350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:58.209778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:58.210462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:58.210908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:58.211322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:58.250029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b0f298e-e78f-4c89-8a5b-6519609784e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:58.258063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5b0f298e-e78f-4c89-8a5b-6519609784e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150351 Aug 06 12:56:58.258554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1325/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:58 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:58.262904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2d7bfcbd-a098-49eb-bcca-a158ac1479e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:58.263497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2d7bfcbd-a098-49eb-bcca-a158ac1479e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:58.269244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7bfcbd-a098-49eb-bcca-a158ac1479e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:58.269717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7bfcbd-a098-49eb-bcca-a158ac1479e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:58.270143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7bfcbd-a098-49eb-bcca-a158ac1479e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:58.270820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7bfcbd-a098-49eb-bcca-a158ac1479e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:58.271263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7bfcbd-a098-49eb-bcca-a158ac1479e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:58.271678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d7bfcbd-a098-49eb-bcca-a158ac1479e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:58.276385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:58.285699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:58.286470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:58.287640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7745b05-1db2-4584-9738-bc2ba185428a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090054 Aug 06 12:56:58.288215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1319/2644] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:56:58.403736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2d7bfcbd-a098-49eb-bcca-a158ac1479e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:58.411596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2d7bfcbd-a098-49eb-bcca-a158ac1479e2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152117 Aug 06 12:56:58.412146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1326/2645] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:58 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:58.532014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-60c691c6-1d3d-4198-84c5-40da2ead1ddc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:58.532575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-60c691c6-1d3d-4198-84c5-40da2ead1ddc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:58.538420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c691c6-1d3d-4198-84c5-40da2ead1ddc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:58.538895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c691c6-1d3d-4198-84c5-40da2ead1ddc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:58.539323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c691c6-1d3d-4198-84c5-40da2ead1ddc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:58.539998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c691c6-1d3d-4198-84c5-40da2ead1ddc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:58.540478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c691c6-1d3d-4198-84c5-40da2ead1ddc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:58.540901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60c691c6-1d3d-4198-84c5-40da2ead1ddc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:58.600179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-60c691c6-1d3d-4198-84c5-40da2ead1ddc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:58.608024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-60c691c6-1d3d-4198-84c5-40da2ead1ddc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.079936 Aug 06 12:56:58.608866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1320/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:59.279051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d34b6bd5-3b7a-4ef1-9cc0-784add1237f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:59.279603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d34b6bd5-3b7a-4ef1-9cc0-784add1237f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:59.285996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d34b6bd5-3b7a-4ef1-9cc0-784add1237f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:59.286480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d34b6bd5-3b7a-4ef1-9cc0-784add1237f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:59.286915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d34b6bd5-3b7a-4ef1-9cc0-784add1237f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:59.287599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d34b6bd5-3b7a-4ef1-9cc0-784add1237f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:59.288051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d34b6bd5-3b7a-4ef1-9cc0-784add1237f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:59.288502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d34b6bd5-3b7a-4ef1-9cc0-784add1237f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:59.311098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:59.311698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:59.318220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:59.318724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:59.319149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:59.319830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:59.320273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:59.320715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:59.335617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:56:59.386317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:59.394644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:59.396119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:59.397291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b25db4cd-5d0d-4d6a-b781-d43df6970011 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090650 Aug 06 12:56:59.397851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1321/2647] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:56:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:56:59.424040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d34b6bd5-3b7a-4ef1-9cc0-784add1237f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:59.432883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d34b6bd5-3b7a-4ef1-9cc0-784add1237f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.157766 Aug 06 12:56:59.433448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1327/2648] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:56:59.433696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ec19fce1-e636-4065-b7b0-058dc2f00178 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:59.434192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ec19fce1-e636-4065-b7b0-058dc2f00178 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:59.440241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec19fce1-e636-4065-b7b0-058dc2f00178 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:59.440741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec19fce1-e636-4065-b7b0-058dc2f00178 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:59.441188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec19fce1-e636-4065-b7b0-058dc2f00178 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:59.441864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec19fce1-e636-4065-b7b0-058dc2f00178 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:59.442310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec19fce1-e636-4065-b7b0-058dc2f00178 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:59.442736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec19fce1-e636-4065-b7b0-058dc2f00178 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:59.567523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ec19fce1-e636-4065-b7b0-058dc2f00178 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:59.575591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ec19fce1-e636-4065-b7b0-058dc2f00178 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146360 Aug 06 12:56:59.576147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1322/2649] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:59 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:56:59.628707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-361ede88-c2b0-41aa-843c-aedfba96057a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:56:59.629381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-361ede88-c2b0-41aa-843c-aedfba96057a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:56:59.635188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-361ede88-c2b0-41aa-843c-aedfba96057a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:59.635669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-361ede88-c2b0-41aa-843c-aedfba96057a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:59.636101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-361ede88-c2b0-41aa-843c-aedfba96057a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:59.636809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-361ede88-c2b0-41aa-843c-aedfba96057a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:56:59.637260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-361ede88-c2b0-41aa-843c-aedfba96057a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:56:59.637678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-361ede88-c2b0-41aa-843c-aedfba96057a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:56:59.699663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-361ede88-c2b0-41aa-843c-aedfba96057a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:56:59.708795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-361ede88-c2b0-41aa-843c-aedfba96057a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083699 Aug 06 12:56:59.709359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1328/2650] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:56:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:00.422964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:00.423558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:00.429956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:00.430430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:00.430855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:00.431527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:00.432494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:00.432910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:00.459143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-99bf6b2f-6619-44c2-8a42-31a858bd300a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:00.459746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-99bf6b2f-6619-44c2-8a42-31a858bd300a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:00.466189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99bf6b2f-6619-44c2-8a42-31a858bd300a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:00.466666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99bf6b2f-6619-44c2-8a42-31a858bd300a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:00.467096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99bf6b2f-6619-44c2-8a42-31a858bd300a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:00.467778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99bf6b2f-6619-44c2-8a42-31a858bd300a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:00.468224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99bf6b2f-6619-44c2-8a42-31a858bd300a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:00.468675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99bf6b2f-6619-44c2-8a42-31a858bd300a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:00.493936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:00.504289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:00.505859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:00.507017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cfc4899c-6345-4fa8-b0cc-9affdb30a467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087933 Aug 06 12:57:00.507603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1323/2651] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:00.593693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-99bf6b2f-6619-44c2-8a42-31a858bd300a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:00.596809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61d9149f-e13e-474f-ae57-482640d2f8c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:00.597421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61d9149f-e13e-474f-ae57-482640d2f8c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:00.601712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-99bf6b2f-6619-44c2-8a42-31a858bd300a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146357 Aug 06 12:57:00.602272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1329/2652] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:00 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:00.603284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d9149f-e13e-474f-ae57-482640d2f8c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:00.603768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d9149f-e13e-474f-ae57-482640d2f8c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:00.604195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d9149f-e13e-474f-ae57-482640d2f8c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:00.604905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d9149f-e13e-474f-ae57-482640d2f8c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:00.605354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d9149f-e13e-474f-ae57-482640d2f8c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:00.605783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61d9149f-e13e-474f-ae57-482640d2f8c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:00.729982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-310892d9-8623-4fe4-9749-ace3a2f71210 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:00.730616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-310892d9-8623-4fe4-9749-ace3a2f71210 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:00.736032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61d9149f-e13e-474f-ae57-482640d2f8c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:00.736839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310892d9-8623-4fe4-9749-ace3a2f71210 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:00.737400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310892d9-8623-4fe4-9749-ace3a2f71210 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:00.737905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310892d9-8623-4fe4-9749-ace3a2f71210 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:00.738667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310892d9-8623-4fe4-9749-ace3a2f71210 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:00.739189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310892d9-8623-4fe4-9749-ace3a2f71210 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:00.739617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-310892d9-8623-4fe4-9749-ace3a2f71210 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:00.744005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61d9149f-e13e-474f-ae57-482640d2f8c6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150970 Aug 06 12:57:00.745226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1324/2653] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:00 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:00.802643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-310892d9-8623-4fe4-9749-ace3a2f71210 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:00.811162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-310892d9-8623-4fe4-9749-ace3a2f71210 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085629 Aug 06 12:57:00.811725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1330/2654] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:00 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:01.086393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:57:01.086610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:57:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:57:01.530500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:01.531075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:01.537436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:01.537914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:01.538344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:01.539022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:01.539474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:01.539897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:01.600361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:01.609368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:01.610875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:01.612050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7a033fa1-d5e1-4640-a0d5-a9e758e390e5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085410 Aug 06 12:57:01.612873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1325/2655] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:01.624685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d6fbc240-1b70-40b9-82d8-c783e0424446 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:01.625374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d6fbc240-1b70-40b9-82d8-c783e0424446 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:01.631985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6fbc240-1b70-40b9-82d8-c783e0424446 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:01.632431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6fbc240-1b70-40b9-82d8-c783e0424446 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:01.632859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6fbc240-1b70-40b9-82d8-c783e0424446 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:01.633535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6fbc240-1b70-40b9-82d8-c783e0424446 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:01.633979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6fbc240-1b70-40b9-82d8-c783e0424446 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:01.634393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6fbc240-1b70-40b9-82d8-c783e0424446 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:01.761491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d6fbc240-1b70-40b9-82d8-c783e0424446 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:01.766269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c9219c7a-af63-47b1-be67-0578d65de1f8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:01.766965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c9219c7a-af63-47b1-be67-0578d65de1f8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:01.769296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d6fbc240-1b70-40b9-82d8-c783e0424446 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148713 Aug 06 12:57:01.769857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1331/2656] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:01 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:01.772963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9219c7a-af63-47b1-be67-0578d65de1f8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:01.773440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9219c7a-af63-47b1-be67-0578d65de1f8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:01.773870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9219c7a-af63-47b1-be67-0578d65de1f8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:01.774544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9219c7a-af63-47b1-be67-0578d65de1f8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:01.774991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9219c7a-af63-47b1-be67-0578d65de1f8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:01.776035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9219c7a-af63-47b1-be67-0578d65de1f8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:01.832247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c51d481e-c0b5-4337-9792-f219ff24110e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:01.832876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c51d481e-c0b5-4337-9792-f219ff24110e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:01.839889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c51d481e-c0b5-4337-9792-f219ff24110e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:01.840394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c51d481e-c0b5-4337-9792-f219ff24110e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:01.840825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c51d481e-c0b5-4337-9792-f219ff24110e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:01.841498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c51d481e-c0b5-4337-9792-f219ff24110e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:01.841949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c51d481e-c0b5-4337-9792-f219ff24110e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:01.842356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c51d481e-c0b5-4337-9792-f219ff24110e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:01.904107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c51d481e-c0b5-4337-9792-f219ff24110e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:01.909648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c9219c7a-af63-47b1-be67-0578d65de1f8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:01.912557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c51d481e-c0b5-4337-9792-f219ff24110e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084082 Aug 06 12:57:01.913201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1332/2657] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:01 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:01.917732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c9219c7a-af63-47b1-be67-0578d65de1f8 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.155377 Aug 06 12:57:01.918278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1326/2658] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:01 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:02.634712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:02.635314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:02.641671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:02.642145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:02.642601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:02.643277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:02.643731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:02.644147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:02.704165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:02.712368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:02.714288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:02.715398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aa6a754b-2fd6-4fb7-9e0a-e41da62b1d79 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084617 Aug 06 12:57:02.715941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1333/2659] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:02 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:02.790831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5fc37272-9237-43dc-9924-1ee4b8424567 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:02.792052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5fc37272-9237-43dc-9924-1ee4b8424567 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:02.798398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fc37272-9237-43dc-9924-1ee4b8424567 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:02.798868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fc37272-9237-43dc-9924-1ee4b8424567 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:02.799293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fc37272-9237-43dc-9924-1ee4b8424567 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:02.799964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fc37272-9237-43dc-9924-1ee4b8424567 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:02.800437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fc37272-9237-43dc-9924-1ee4b8424567 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:02.800856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fc37272-9237-43dc-9924-1ee4b8424567 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:02.933125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5fc37272-9237-43dc-9924-1ee4b8424567 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:02.933531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8cdbc3f7-f0b2-4bde-80f3-0c2bdeb0c8d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:02.934143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8cdbc3f7-f0b2-4bde-80f3-0c2bdeb0c8d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:02.940110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cdbc3f7-f0b2-4bde-80f3-0c2bdeb0c8d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:02.940730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cdbc3f7-f0b2-4bde-80f3-0c2bdeb0c8d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:02.941165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cdbc3f7-f0b2-4bde-80f3-0c2bdeb0c8d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:02.941397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5fc37272-9237-43dc-9924-1ee4b8424567 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154323 Aug 06 12:57:02.941930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cdbc3f7-f0b2-4bde-80f3-0c2bdeb0c8d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:02.942074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1327/2660] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:02 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:02.942388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cdbc3f7-f0b2-4bde-80f3-0c2bdeb0c8d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:02.942880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cdbc3f7-f0b2-4bde-80f3-0c2bdeb0c8d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:02.946206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0118c124-d547-47b7-a4a8-a1d8cf3d6950 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:02.946801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0118c124-d547-47b7-a4a8-a1d8cf3d6950 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:02.953272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0118c124-d547-47b7-a4a8-a1d8cf3d6950 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:02.953747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0118c124-d547-47b7-a4a8-a1d8cf3d6950 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:02.954181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0118c124-d547-47b7-a4a8-a1d8cf3d6950 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:02.954860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0118c124-d547-47b7-a4a8-a1d8cf3d6950 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:02.955304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0118c124-d547-47b7-a4a8-a1d8cf3d6950 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:02.955721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0118c124-d547-47b7-a4a8-a1d8cf3d6950 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:03.014223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8cdbc3f7-f0b2-4bde-80f3-0c2bdeb0c8d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:03.022167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8cdbc3f7-f0b2-4bde-80f3-0c2bdeb0c8d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.092699 Aug 06 12:57:03.022727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1334/2661] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:02 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:03.085943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0118c124-d547-47b7-a4a8-a1d8cf3d6950 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:03.094388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0118c124-d547-47b7-a4a8-a1d8cf3d6950 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151523 Aug 06 12:57:03.094948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1328/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:02 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:03.737861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:03.738416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:03.745475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:03.745951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:03.746380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:03.747063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:03.747536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:03.747952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:03.808251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:03.816557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:03.818052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:03.819175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-425edbc1-55fa-4699-b34b-607dc4fc6f18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085545 Aug 06 12:57:03.819725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1335/2663] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:03 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:57:03.962908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1be4b99c-eb4f-45f1-85f4-25a6fc70e122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:03.963506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1be4b99c-eb4f-45f1-85f4-25a6fc70e122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:03.969909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1be4b99c-eb4f-45f1-85f4-25a6fc70e122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:03.970382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1be4b99c-eb4f-45f1-85f4-25a6fc70e122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:03.970810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1be4b99c-eb4f-45f1-85f4-25a6fc70e122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:03.971480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1be4b99c-eb4f-45f1-85f4-25a6fc70e122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:03.971927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1be4b99c-eb4f-45f1-85f4-25a6fc70e122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:03.972378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1be4b99c-eb4f-45f1-85f4-25a6fc70e122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:04.043682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-75ca6a10-24fa-4875-984b-d64dddb39d7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:04.044287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-75ca6a10-24fa-4875-984b-d64dddb39d7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:04.050177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75ca6a10-24fa-4875-984b-d64dddb39d7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:04.050657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75ca6a10-24fa-4875-984b-d64dddb39d7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:04.051116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75ca6a10-24fa-4875-984b-d64dddb39d7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:04.051809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75ca6a10-24fa-4875-984b-d64dddb39d7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:04.052259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75ca6a10-24fa-4875-984b-d64dddb39d7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:04.052706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75ca6a10-24fa-4875-984b-d64dddb39d7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:04.068628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:04.106422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1be4b99c-eb4f-45f1-85f4-25a6fc70e122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:04.115236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1be4b99c-eb4f-45f1-85f4-25a6fc70e122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155801 Aug 06 12:57:04.115419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1329/2664] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:03 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:04.117765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75ca6a10-24fa-4875-984b-d64dddb39d7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:04.119981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e714c54a-2b4a-4a55-95d1-083f0ab9e770 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:04.120605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e714c54a-2b4a-4a55-95d1-083f0ab9e770 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:04.126311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e714c54a-2b4a-4a55-95d1-083f0ab9e770 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:04.126833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e714c54a-2b4a-4a55-95d1-083f0ab9e770 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:04.127456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e714c54a-2b4a-4a55-95d1-083f0ab9e770 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:04.128134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e714c54a-2b4a-4a55-95d1-083f0ab9e770 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:04.128600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e714c54a-2b4a-4a55-95d1-083f0ab9e770 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:04.129022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e714c54a-2b4a-4a55-95d1-083f0ab9e770 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:04.129508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-75ca6a10-24fa-4875-984b-d64dddb39d7d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.090240 Aug 06 12:57:04.130147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1336/2665] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:04.254078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e714c54a-2b4a-4a55-95d1-083f0ab9e770 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:04.262100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e714c54a-2b4a-4a55-95d1-083f0ab9e770 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145728 Aug 06 12:57:04.262663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1330/2666] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:04 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:04.842531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:04.843159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:04.849433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:04.849906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:04.850337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:04.851016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:04.851467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:04.851895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:04.913912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:04.922252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:04.923752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:04.924909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-99d2a235-4930-4f72-9f38-e9e6d840ab07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086932 Aug 06 12:57:04.925460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1337/2667] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:05.135718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-56e1f287-06b0-430a-9062-dd0945c50b7a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:05.136295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-56e1f287-06b0-430a-9062-dd0945c50b7a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:05.142712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56e1f287-06b0-430a-9062-dd0945c50b7a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:05.143196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56e1f287-06b0-430a-9062-dd0945c50b7a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:05.144964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56e1f287-06b0-430a-9062-dd0945c50b7a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:05.144964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56e1f287-06b0-430a-9062-dd0945c50b7a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:05.144964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56e1f287-06b0-430a-9062-dd0945c50b7a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:05.145318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56e1f287-06b0-430a-9062-dd0945c50b7a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:05.150022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d7f1f535-33da-499f-bb42-837dbc49442b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:05.150640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d7f1f535-33da-499f-bb42-837dbc49442b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:05.156480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7f1f535-33da-499f-bb42-837dbc49442b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:05.156962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7f1f535-33da-499f-bb42-837dbc49442b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:05.157391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7f1f535-33da-499f-bb42-837dbc49442b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:05.158072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7f1f535-33da-499f-bb42-837dbc49442b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:05.158524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7f1f535-33da-499f-bb42-837dbc49442b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:05.158947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d7f1f535-33da-499f-bb42-837dbc49442b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:05.222121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d7f1f535-33da-499f-bb42-837dbc49442b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:05.230882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d7f1f535-33da-499f-bb42-837dbc49442b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084635 Aug 06 12:57:05.231451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1338/2668] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:05 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:05.273252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-56e1f287-06b0-430a-9062-dd0945c50b7a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:05.281225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-56e1f287-06b0-430a-9062-dd0945c50b7a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150093 Aug 06 12:57:05.282041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1331/2669] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:05.283061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3d234fa4-bdb3-40ed-a772-d12cc06c30c2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:05.283677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3d234fa4-bdb3-40ed-a772-d12cc06c30c2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:05.289704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d234fa4-bdb3-40ed-a772-d12cc06c30c2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:05.290398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d234fa4-bdb3-40ed-a772-d12cc06c30c2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:05.291359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d234fa4-bdb3-40ed-a772-d12cc06c30c2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:05.292342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d234fa4-bdb3-40ed-a772-d12cc06c30c2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:05.292902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d234fa4-bdb3-40ed-a772-d12cc06c30c2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:05.293368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d234fa4-bdb3-40ed-a772-d12cc06c30c2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:05.422137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3d234fa4-bdb3-40ed-a772-d12cc06c30c2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:05.430120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3d234fa4-bdb3-40ed-a772-d12cc06c30c2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151058 Aug 06 12:57:05.430685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1339/2670] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:05 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:05.947947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:05.948571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:05.954578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:05.955055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:05.955486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:05.956192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:05.956660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:05.957079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:06.020234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:06.029282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:06.030940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:06.032069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-964ac075-6b48-4b6f-98fb-804a2732031b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088589 Aug 06 12:57:06.032657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1332/2671] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:06.251632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-09d55687-f1b7-4c92-99f8-101eb0e1233e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:06.252269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-09d55687-f1b7-4c92-99f8-101eb0e1233e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:06.258832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09d55687-f1b7-4c92-99f8-101eb0e1233e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:06.259302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09d55687-f1b7-4c92-99f8-101eb0e1233e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:06.260210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09d55687-f1b7-4c92-99f8-101eb0e1233e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:06.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09d55687-f1b7-4c92-99f8-101eb0e1233e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:06.261346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09d55687-f1b7-4c92-99f8-101eb0e1233e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:06.261763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09d55687-f1b7-4c92-99f8-101eb0e1233e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:06.303085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c48dbcc8-9b62-48c8-b250-f0f98d01e302 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:06.304376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c48dbcc8-9b62-48c8-b250-f0f98d01e302 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:06.310857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c48dbcc8-9b62-48c8-b250-f0f98d01e302 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:06.311349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c48dbcc8-9b62-48c8-b250-f0f98d01e302 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:06.311786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c48dbcc8-9b62-48c8-b250-f0f98d01e302 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:06.312513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c48dbcc8-9b62-48c8-b250-f0f98d01e302 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:06.312971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c48dbcc8-9b62-48c8-b250-f0f98d01e302 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:06.313398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c48dbcc8-9b62-48c8-b250-f0f98d01e302 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:06.322816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-09d55687-f1b7-4c92-99f8-101eb0e1233e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:06.330850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-09d55687-f1b7-4c92-99f8-101eb0e1233e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083097 Aug 06 12:57:06.331490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1340/2672] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:06 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:06.441203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c48dbcc8-9b62-48c8-b250-f0f98d01e302 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:06.449950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c48dbcc8-9b62-48c8-b250-f0f98d01e302 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150816 Aug 06 12:57:06.450516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1333/2673] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:06.451444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fd8f9c76-2ea3-485f-a507-44f24dc70d56 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:06.452045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fd8f9c76-2ea3-485f-a507-44f24dc70d56 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:06.457931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8f9c76-2ea3-485f-a507-44f24dc70d56 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:06.458399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8f9c76-2ea3-485f-a507-44f24dc70d56 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:06.459001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8f9c76-2ea3-485f-a507-44f24dc70d56 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:06.459675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8f9c76-2ea3-485f-a507-44f24dc70d56 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:06.460120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8f9c76-2ea3-485f-a507-44f24dc70d56 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:06.460556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd8f9c76-2ea3-485f-a507-44f24dc70d56 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:06.586982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fd8f9c76-2ea3-485f-a507-44f24dc70d56 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:06.594738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fd8f9c76-2ea3-485f-a507-44f24dc70d56 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147716 Aug 06 12:57:06.595285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1341/2674] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:06 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:07.054316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:07.054919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:07.061592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:07.062067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:07.062517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:07.063194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:07.063638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:07.064054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:07.124566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:07.132735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:07.134271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:07.135379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3f4bd430-01c1-47cf-8b38-c0ca9e9271e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084956 Aug 06 12:57:07.135925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1334/2675] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:07 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:07.352039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-104913fd-d0c3-4e3d-896c-44059e1b4a8b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:07.352662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-104913fd-d0c3-4e3d-896c-44059e1b4a8b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:07.359765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-104913fd-d0c3-4e3d-896c-44059e1b4a8b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:07.360238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-104913fd-d0c3-4e3d-896c-44059e1b4a8b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:07.360690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-104913fd-d0c3-4e3d-896c-44059e1b4a8b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:07.361356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-104913fd-d0c3-4e3d-896c-44059e1b4a8b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:07.361799 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-104913fd-d0c3-4e3d-896c-44059e1b4a8b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:07.362216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-104913fd-d0c3-4e3d-896c-44059e1b4a8b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:07.422482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-104913fd-d0c3-4e3d-896c-44059e1b4a8b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:07.430171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-104913fd-d0c3-4e3d-896c-44059e1b4a8b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081922 Aug 06 12:57:07.430725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1342/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:07 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:07.470769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c4b6ad82-5f91-4747-a707-db524c49c0bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:07.471376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c4b6ad82-5f91-4747-a707-db524c49c0bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:07.477726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4b6ad82-5f91-4747-a707-db524c49c0bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:07.478206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4b6ad82-5f91-4747-a707-db524c49c0bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:07.478640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4b6ad82-5f91-4747-a707-db524c49c0bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:07.479319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4b6ad82-5f91-4747-a707-db524c49c0bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:07.479767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4b6ad82-5f91-4747-a707-db524c49c0bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:07.480190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4b6ad82-5f91-4747-a707-db524c49c0bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:07.613692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c4b6ad82-5f91-4747-a707-db524c49c0bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:07.615437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-25a39f33-eb6f-4012-bee8-0954e3fb6d12 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:07.616107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-25a39f33-eb6f-4012-bee8-0954e3fb6d12 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:07.621833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c4b6ad82-5f91-4747-a707-db524c49c0bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154795 Aug 06 12:57:07.622132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a39f33-eb6f-4012-bee8-0954e3fb6d12 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:07.622398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1335/2677] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:07 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:07.622690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a39f33-eb6f-4012-bee8-0954e3fb6d12 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:07.623127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a39f33-eb6f-4012-bee8-0954e3fb6d12 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:07.623787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a39f33-eb6f-4012-bee8-0954e3fb6d12 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:07.624232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a39f33-eb6f-4012-bee8-0954e3fb6d12 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:07.624677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25a39f33-eb6f-4012-bee8-0954e3fb6d12 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:07.752205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-25a39f33-eb6f-4012-bee8-0954e3fb6d12 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:07.760694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-25a39f33-eb6f-4012-bee8-0954e3fb6d12 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149111 Aug 06 12:57:07.761258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1343/2678] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:07 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:08.156888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:08.157493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:08.163438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:08.163918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:08.164385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:08.165069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:08.165520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:08.165943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:08.225747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:08.234849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:08.236422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:08.237554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f4eb69e2-54d1-42f6-947a-fb18743bcdcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084556 Aug 06 12:57:08.238106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1336/2679] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:08 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:08.452558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1525b879-026e-448b-8494-fd7b3d55d4b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:08.453147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1525b879-026e-448b-8494-fd7b3d55d4b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:08.460400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1525b879-026e-448b-8494-fd7b3d55d4b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:08.461084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1525b879-026e-448b-8494-fd7b3d55d4b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:08.461711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1525b879-026e-448b-8494-fd7b3d55d4b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:08.462402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1525b879-026e-448b-8494-fd7b3d55d4b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:08.462829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1525b879-026e-448b-8494-fd7b3d55d4b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:08.463243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1525b879-026e-448b-8494-fd7b3d55d4b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:08.526767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1525b879-026e-448b-8494-fd7b3d55d4b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:08.534547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1525b879-026e-448b-8494-fd7b3d55d4b6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.087625 Aug 06 12:57:08.535110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1344/2680] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:08 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:08.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-173b6c4f-d08e-49e1-a93e-fe8b5801f4f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:08.642931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-173b6c4f-d08e-49e1-a93e-fe8b5801f4f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:08.649214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-173b6c4f-d08e-49e1-a93e-fe8b5801f4f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:08.649694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-173b6c4f-d08e-49e1-a93e-fe8b5801f4f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:08.650613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-173b6c4f-d08e-49e1-a93e-fe8b5801f4f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:08.651285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-173b6c4f-d08e-49e1-a93e-fe8b5801f4f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:08.651731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-173b6c4f-d08e-49e1-a93e-fe8b5801f4f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:08.652147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-173b6c4f-d08e-49e1-a93e-fe8b5801f4f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:08.782315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e8a6a5bf-4d96-4572-9ab5-44d665adb622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:08.782925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e8a6a5bf-4d96-4572-9ab5-44d665adb622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:08.783048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-173b6c4f-d08e-49e1-a93e-fe8b5801f4f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:08.788779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a6a5bf-4d96-4572-9ab5-44d665adb622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:08.789246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a6a5bf-4d96-4572-9ab5-44d665adb622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:08.789667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a6a5bf-4d96-4572-9ab5-44d665adb622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:08.790339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a6a5bf-4d96-4572-9ab5-44d665adb622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:08.791771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-173b6c4f-d08e-49e1-a93e-fe8b5801f4f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152428 Aug 06 12:57:08.791995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a6a5bf-4d96-4572-9ab5-44d665adb622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:08.792361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1337/2681] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:08.792516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a6a5bf-4d96-4572-9ab5-44d665adb622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:08.918695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e8a6a5bf-4d96-4572-9ab5-44d665adb622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:08.926520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e8a6a5bf-4d96-4572-9ab5-44d665adb622 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148283 Aug 06 12:57:08.927071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1345/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:08 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:09.261199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:09.261718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:09.267460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:09.267932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:09.268396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:09.269072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:09.269522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:09.269936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:09.273720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:09.333121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:09.341946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:09.343419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:09.344580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9ba6b7c-3af4-48aa-a231-39b470419b9c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087886 Aug 06 12:57:09.345125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1338/2683] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:09.555352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-94928f5a-91e3-41a6-ae54-5b284b051e82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:09.555979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-94928f5a-91e3-41a6-ae54-5b284b051e82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:09.562788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94928f5a-91e3-41a6-ae54-5b284b051e82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:09.563267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94928f5a-91e3-41a6-ae54-5b284b051e82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:09.563693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94928f5a-91e3-41a6-ae54-5b284b051e82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:09.564390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94928f5a-91e3-41a6-ae54-5b284b051e82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:09.564834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94928f5a-91e3-41a6-ae54-5b284b051e82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:09.565250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94928f5a-91e3-41a6-ae54-5b284b051e82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:09.625238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-94928f5a-91e3-41a6-ae54-5b284b051e82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:09.632883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-94928f5a-91e3-41a6-ae54-5b284b051e82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081422 Aug 06 12:57:09.633431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1346/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:09 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:09.813467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7d851183-8654-44a6-a4ec-2b6327915d8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:09.814228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7d851183-8654-44a6-a4ec-2b6327915d8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:09.820275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d851183-8654-44a6-a4ec-2b6327915d8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:09.820777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d851183-8654-44a6-a4ec-2b6327915d8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:09.821205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d851183-8654-44a6-a4ec-2b6327915d8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:09.821946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d851183-8654-44a6-a4ec-2b6327915d8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:09.822396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d851183-8654-44a6-a4ec-2b6327915d8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:09.822811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d851183-8654-44a6-a4ec-2b6327915d8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:09.947081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7d851183-8654-44a6-a4ec-2b6327915d8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:09.947260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a1dbf3f3-b7ea-4d6b-8d3d-3e41b46cf5e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:09.947776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a1dbf3f3-b7ea-4d6b-8d3d-3e41b46cf5e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:09.953696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1dbf3f3-b7ea-4d6b-8d3d-3e41b46cf5e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:09.954174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1dbf3f3-b7ea-4d6b-8d3d-3e41b46cf5e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:09.954607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1dbf3f3-b7ea-4d6b-8d3d-3e41b46cf5e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:09.955008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7d851183-8654-44a6-a4ec-2b6327915d8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145416 Aug 06 12:57:09.955291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1dbf3f3-b7ea-4d6b-8d3d-3e41b46cf5e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:09.955568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1339/2685] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:09.955788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1dbf3f3-b7ea-4d6b-8d3d-3e41b46cf5e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:09.956158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1dbf3f3-b7ea-4d6b-8d3d-3e41b46cf5e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:10.085826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a1dbf3f3-b7ea-4d6b-8d3d-3e41b46cf5e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:10.094262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a1dbf3f3-b7ea-4d6b-8d3d-3e41b46cf5e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151084 Aug 06 12:57:10.094821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1347/2686] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:09 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:10.367246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:10.367766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:10.373645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:10.374114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:10.374544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:10.375217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:10.375662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:10.376078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:10.435639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:10.443781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:10.445347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:10.446466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0ff43d4d-7466-4ea7-abbb-28c6f133445e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083157 Aug 06 12:57:10.447505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1340/2687] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:10 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:10.654179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4b1618e8-0074-4302-b64f-810ec2eb03aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:10.654697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4b1618e8-0074-4302-b64f-810ec2eb03aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:10.661678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b1618e8-0074-4302-b64f-810ec2eb03aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:10.662182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b1618e8-0074-4302-b64f-810ec2eb03aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:10.662669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b1618e8-0074-4302-b64f-810ec2eb03aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:10.663326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b1618e8-0074-4302-b64f-810ec2eb03aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:10.663912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b1618e8-0074-4302-b64f-810ec2eb03aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:10.664370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b1618e8-0074-4302-b64f-810ec2eb03aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:10.734989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4b1618e8-0074-4302-b64f-810ec2eb03aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:10.742878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4b1618e8-0074-4302-b64f-810ec2eb03aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.093203 Aug 06 12:57:10.743439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1348/2688] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:10 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:10.975151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0831d266-fd5b-4777-a1c2-f0d34bb6a23e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:10.975711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0831d266-fd5b-4777-a1c2-f0d34bb6a23e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:10.982136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0831d266-fd5b-4777-a1c2-f0d34bb6a23e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:10.982615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0831d266-fd5b-4777-a1c2-f0d34bb6a23e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:10.983050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0831d266-fd5b-4777-a1c2-f0d34bb6a23e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:10.983991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0831d266-fd5b-4777-a1c2-f0d34bb6a23e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:10.984479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0831d266-fd5b-4777-a1c2-f0d34bb6a23e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:10.984909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0831d266-fd5b-4777-a1c2-f0d34bb6a23e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:11.115192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ce3de234-f003-4770-a1b7-1c31d49ac685 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:11.115797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ce3de234-f003-4770-a1b7-1c31d49ac685 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:11.119095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0831d266-fd5b-4777-a1c2-f0d34bb6a23e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:11.122320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce3de234-f003-4770-a1b7-1c31d49ac685 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:11.122798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce3de234-f003-4770-a1b7-1c31d49ac685 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:11.123223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce3de234-f003-4770-a1b7-1c31d49ac685 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:11.123897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce3de234-f003-4770-a1b7-1c31d49ac685 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:11.124360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce3de234-f003-4770-a1b7-1c31d49ac685 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:11.124974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce3de234-f003-4770-a1b7-1c31d49ac685 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:11.127518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0831d266-fd5b-4777-a1c2-f0d34bb6a23e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.156264 Aug 06 12:57:11.128162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1341/2689] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:11.250527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ce3de234-f003-4770-a1b7-1c31d49ac685 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:11.258351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ce3de234-f003-4770-a1b7-1c31d49ac685 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146976 Aug 06 12:57:11.258905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1349/2690] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:11 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:11.469280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:11.469883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:11.475748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:11.476227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:11.476689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:11.477366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:11.477814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:11.478736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:11.537679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:11.546459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:11.547951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:11.549107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d60bdf71-c4d9-4e9f-b5d6-3447ac70bfca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083761 Aug 06 12:57:11.549660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1342/2691] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:11 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:11.764901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-799a1e58-571c-4cb1-ade9-462e64fb8d76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:11.765896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-799a1e58-571c-4cb1-ade9-462e64fb8d76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:11.772350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799a1e58-571c-4cb1-ade9-462e64fb8d76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:11.772833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799a1e58-571c-4cb1-ade9-462e64fb8d76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:11.773265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799a1e58-571c-4cb1-ade9-462e64fb8d76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:11.773944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799a1e58-571c-4cb1-ade9-462e64fb8d76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:11.774394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799a1e58-571c-4cb1-ade9-462e64fb8d76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:11.774815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-799a1e58-571c-4cb1-ade9-462e64fb8d76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:11.838682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-799a1e58-571c-4cb1-ade9-462e64fb8d76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:11.846494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-799a1e58-571c-4cb1-ade9-462e64fb8d76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.087181 Aug 06 12:57:11.847053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1350/2692] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:11 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:12.149487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7d22126-ba7d-4158-9140-d017843dc086 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:12.150612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7d22126-ba7d-4158-9140-d017843dc086 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:12.157022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7d22126-ba7d-4158-9140-d017843dc086 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:12.157498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7d22126-ba7d-4158-9140-d017843dc086 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:12.157933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7d22126-ba7d-4158-9140-d017843dc086 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:12.158610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7d22126-ba7d-4158-9140-d017843dc086 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:12.159061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7d22126-ba7d-4158-9140-d017843dc086 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:12.159484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7d22126-ba7d-4158-9140-d017843dc086 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:12.279633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7648e9d6-2728-47e8-a980-a8c5c8b6b07f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:12.280243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7648e9d6-2728-47e8-a980-a8c5c8b6b07f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:12.286181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7d22126-ba7d-4158-9140-d017843dc086 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:12.286788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7648e9d6-2728-47e8-a980-a8c5c8b6b07f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:12.287269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7648e9d6-2728-47e8-a980-a8c5c8b6b07f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:12.287703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7648e9d6-2728-47e8-a980-a8c5c8b6b07f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:12.288427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7648e9d6-2728-47e8-a980-a8c5c8b6b07f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:12.288884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7648e9d6-2728-47e8-a980-a8c5c8b6b07f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:12.289308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7648e9d6-2728-47e8-a980-a8c5c8b6b07f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:12.294324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7d22126-ba7d-4158-9140-d017843dc086 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148682 Aug 06 12:57:12.294895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1343/2693] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:12.418257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7648e9d6-2728-47e8-a980-a8c5c8b6b07f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:12.426023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7648e9d6-2728-47e8-a980-a8c5c8b6b07f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150866 Aug 06 12:57:12.426571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1351/2694] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:12 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:12.571439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:12.572667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:12.578552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:12.579036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:12.579476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:12.580161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:12.580640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:12.581068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:12.644197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:12.652723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:12.654224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:12.655368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e243233-e0fe-4b2a-a598-264c90fc6e70 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087806 Aug 06 12:57:12.655926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1344/2695] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:12 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:12.868132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bd8a55da-f8b0-4e33-9616-ec59a78ce716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:12.869332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bd8a55da-f8b0-4e33-9616-ec59a78ce716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:12.875653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd8a55da-f8b0-4e33-9616-ec59a78ce716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:12.876129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd8a55da-f8b0-4e33-9616-ec59a78ce716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:12.876589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd8a55da-f8b0-4e33-9616-ec59a78ce716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:12.877266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd8a55da-f8b0-4e33-9616-ec59a78ce716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:12.877711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd8a55da-f8b0-4e33-9616-ec59a78ce716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:12.878131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd8a55da-f8b0-4e33-9616-ec59a78ce716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:12.939576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd8a55da-f8b0-4e33-9616-ec59a78ce716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:12.947453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bd8a55da-f8b0-4e33-9616-ec59a78ce716 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083120 Aug 06 12:57:12.948007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1352/2696] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:12 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:13.318501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dd88a86f-c58a-4032-99c3-7b426d308341 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:13.319134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dd88a86f-c58a-4032-99c3-7b426d308341 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:13.325613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd88a86f-c58a-4032-99c3-7b426d308341 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:13.326096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd88a86f-c58a-4032-99c3-7b426d308341 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:13.326567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd88a86f-c58a-4032-99c3-7b426d308341 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:13.327262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd88a86f-c58a-4032-99c3-7b426d308341 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:13.327946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd88a86f-c58a-4032-99c3-7b426d308341 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:13.328824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd88a86f-c58a-4032-99c3-7b426d308341 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:13.447194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a6c0a4d0-3961-41c9-a61f-778f41bf155e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:13.447925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a6c0a4d0-3961-41c9-a61f-778f41bf155e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:13.453963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6c0a4d0-3961-41c9-a61f-778f41bf155e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:13.454443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6c0a4d0-3961-41c9-a61f-778f41bf155e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:13.454866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6c0a4d0-3961-41c9-a61f-778f41bf155e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:13.455553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6c0a4d0-3961-41c9-a61f-778f41bf155e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:13.456090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6c0a4d0-3961-41c9-a61f-778f41bf155e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:13.456430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a6c0a4d0-3961-41c9-a61f-778f41bf155e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:13.458513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dd88a86f-c58a-4032-99c3-7b426d308341 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:13.459007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:13.466984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dd88a86f-c58a-4032-99c3-7b426d308341 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152336 Aug 06 12:57:13.467544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1345/2697] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:13 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:13.584737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a6c0a4d0-3961-41c9-a61f-778f41bf155e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:13.593042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a6c0a4d0-3961-41c9-a61f-778f41bf155e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149639 Aug 06 12:57:13.593600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1353/2698] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:13 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:13.677609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:13.678207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:13.684041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:13.684540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:13.684967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:13.685638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:13.686083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:13.686503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:13.746039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:13.754281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:13.755753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:13.756904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-30fcdb49-ef2d-4a32-85fe-96f6320aa4fe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083224 Aug 06 12:57:13.757457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1346/2699] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:13 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:13.968982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f9d61480-9558-4597-ac3a-fd4364e9c34c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:13.969611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f9d61480-9558-4597-ac3a-fd4364e9c34c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:13.975949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d61480-9558-4597-ac3a-fd4364e9c34c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:13.976455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d61480-9558-4597-ac3a-fd4364e9c34c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:13.976891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d61480-9558-4597-ac3a-fd4364e9c34c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:13.977568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d61480-9558-4597-ac3a-fd4364e9c34c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:13.978020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d61480-9558-4597-ac3a-fd4364e9c34c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:13.978441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d61480-9558-4597-ac3a-fd4364e9c34c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:14.041029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f9d61480-9558-4597-ac3a-fd4364e9c34c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:14.048842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f9d61480-9558-4597-ac3a-fd4364e9c34c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083933 Aug 06 12:57:14.049400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1354/2700] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:13 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:14.489477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-834432ca-a13d-4395-bdb4-fb2a38220fb9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:14.490077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-834432ca-a13d-4395-bdb4-fb2a38220fb9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:14.496968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-834432ca-a13d-4395-bdb4-fb2a38220fb9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:14.497442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-834432ca-a13d-4395-bdb4-fb2a38220fb9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:14.497867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-834432ca-a13d-4395-bdb4-fb2a38220fb9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:14.498535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-834432ca-a13d-4395-bdb4-fb2a38220fb9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:14.498981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-834432ca-a13d-4395-bdb4-fb2a38220fb9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:14.499405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-834432ca-a13d-4395-bdb4-fb2a38220fb9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:14.615260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0de64615-9b20-4950-88fe-7a778ceb2cb1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:14.615857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0de64615-9b20-4950-88fe-7a778ceb2cb1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:14.622374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de64615-9b20-4950-88fe-7a778ceb2cb1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:14.622856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de64615-9b20-4950-88fe-7a778ceb2cb1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:14.623281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de64615-9b20-4950-88fe-7a778ceb2cb1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:14.623961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de64615-9b20-4950-88fe-7a778ceb2cb1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:14.624442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de64615-9b20-4950-88fe-7a778ceb2cb1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:14.624860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0de64615-9b20-4950-88fe-7a778ceb2cb1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:14.628896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-834432ca-a13d-4395-bdb4-fb2a38220fb9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:14.637017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-834432ca-a13d-4395-bdb4-fb2a38220fb9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151339 Aug 06 12:57:14.637858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1347/2701] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:14.749136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0de64615-9b20-4950-88fe-7a778ceb2cb1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:14.756863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0de64615-9b20-4950-88fe-7a778ceb2cb1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145410 Aug 06 12:57:14.757419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1355/2702] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:14 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:14.778432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:14.779039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:14.784917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:14.785398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:14.785833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:14.786517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:14.786972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:14.787401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:14.846734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:14.855622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:14.857164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:14.858839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f00b454f-1229-4d52-8435-7e6f33d58cfd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.083726 Aug 06 12:57:14.859460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1348/2703] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:15.069473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3a40f6cd-ab72-42e9-b32b-f9a1a1a6b234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:15.070068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3a40f6cd-ab72-42e9-b32b-f9a1a1a6b234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:15.076428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a40f6cd-ab72-42e9-b32b-f9a1a1a6b234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:15.076906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a40f6cd-ab72-42e9-b32b-f9a1a1a6b234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:15.077328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a40f6cd-ab72-42e9-b32b-f9a1a1a6b234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:15.077993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a40f6cd-ab72-42e9-b32b-f9a1a1a6b234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:15.078436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a40f6cd-ab72-42e9-b32b-f9a1a1a6b234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:15.078851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a40f6cd-ab72-42e9-b32b-f9a1a1a6b234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:15.142835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3a40f6cd-ab72-42e9-b32b-f9a1a1a6b234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:15.151342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3a40f6cd-ab72-42e9-b32b-f9a1a1a6b234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085842 Aug 06 12:57:15.151896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1356/2704] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:15 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:15.657694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19c130b7-865e-4768-b470-b3895598327a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:15.658231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19c130b7-865e-4768-b470-b3895598327a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:15.664618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c130b7-865e-4768-b470-b3895598327a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:15.665096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c130b7-865e-4768-b470-b3895598327a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:15.665528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c130b7-865e-4768-b470-b3895598327a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:15.666212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c130b7-865e-4768-b470-b3895598327a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:15.666661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c130b7-865e-4768-b470-b3895598327a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:15.667080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19c130b7-865e-4768-b470-b3895598327a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:15.777840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6c7067af-ae81-44fe-8604-5faf8c21ca39 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:15.778438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6c7067af-ae81-44fe-8604-5faf8c21ca39 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:15.784450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c7067af-ae81-44fe-8604-5faf8c21ca39 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:15.784931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c7067af-ae81-44fe-8604-5faf8c21ca39 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:15.785370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c7067af-ae81-44fe-8604-5faf8c21ca39 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:15.786054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c7067af-ae81-44fe-8604-5faf8c21ca39 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:15.786501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c7067af-ae81-44fe-8604-5faf8c21ca39 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:15.786921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c7067af-ae81-44fe-8604-5faf8c21ca39 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:15.792766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-19c130b7-865e-4768-b470-b3895598327a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:15.803346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19c130b7-865e-4768-b470-b3895598327a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149352 Aug 06 12:57:15.803802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1349/2705] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:15.882025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:15.882631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:15.888901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:15.889379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:15.889812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:15.890522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:15.890975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:15.891396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:15.917023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6c7067af-ae81-44fe-8604-5faf8c21ca39 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:15.924977 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6c7067af-ae81-44fe-8604-5faf8c21ca39 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151004 Aug 06 12:57:15.925583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1357/2706] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:15 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:15.957981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:15.966715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:15.968211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:15.969376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-57e0aca2-5250-4712-85ba-80b4e62695ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.091260 Aug 06 12:57:15.969933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1350/2707] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:15 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:57:16.171447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-71478d4a-c4f7-471e-8da3-324c154002d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:16.172010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-71478d4a-c4f7-471e-8da3-324c154002d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:16.177856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71478d4a-c4f7-471e-8da3-324c154002d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:16.178331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71478d4a-c4f7-471e-8da3-324c154002d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:16.178758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71478d4a-c4f7-471e-8da3-324c154002d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:16.179465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71478d4a-c4f7-471e-8da3-324c154002d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:16.179909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71478d4a-c4f7-471e-8da3-324c154002d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:16.180343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71478d4a-c4f7-471e-8da3-324c154002d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:16.240139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-71478d4a-c4f7-471e-8da3-324c154002d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:16.248759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-71478d4a-c4f7-471e-8da3-324c154002d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081172 Aug 06 12:57:16.249321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1358/2708] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:16 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:16.824849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-40738267-f28b-41ce-a6e1-10a184b74c9f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:16.825459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-40738267-f28b-41ce-a6e1-10a184b74c9f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:16.832105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40738267-f28b-41ce-a6e1-10a184b74c9f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:16.832618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40738267-f28b-41ce-a6e1-10a184b74c9f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:16.833055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40738267-f28b-41ce-a6e1-10a184b74c9f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:16.833733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40738267-f28b-41ce-a6e1-10a184b74c9f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:16.834221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40738267-f28b-41ce-a6e1-10a184b74c9f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:16.834643 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40738267-f28b-41ce-a6e1-10a184b74c9f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:16.947150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5e26ae28-e177-448a-b950-19a1b03cd9b0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:16.947750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5e26ae28-e177-448a-b950-19a1b03cd9b0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:16.954275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e26ae28-e177-448a-b950-19a1b03cd9b0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:16.954747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e26ae28-e177-448a-b950-19a1b03cd9b0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:16.955174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e26ae28-e177-448a-b950-19a1b03cd9b0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:16.955848 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e26ae28-e177-448a-b950-19a1b03cd9b0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:16.956289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e26ae28-e177-448a-b950-19a1b03cd9b0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:16.956728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e26ae28-e177-448a-b950-19a1b03cd9b0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:16.963380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-40738267-f28b-41ce-a6e1-10a184b74c9f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:16.971281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-40738267-f28b-41ce-a6e1-10a184b74c9f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150213 Aug 06 12:57:16.972049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1351/2709] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:16.990883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:16.991498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:16.997803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:16.998296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:16.998739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:16.999444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:16.999895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:17.000572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:17.066404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:17.075414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:17.076905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:17.078042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-012e13c2-9f8f-41a6-a4f6-09ec3b2cf4f8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090977 Aug 06 12:57:17.078597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1352/2710] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:57:17.095284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5e26ae28-e177-448a-b950-19a1b03cd9b0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:17.103276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5e26ae28-e177-448a-b950-19a1b03cd9b0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.160455 Aug 06 12:57:17.103835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1359/2711] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:16 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:17.269321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-79dbc55c-0e82-4c38-8d0f-602f129494af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:17.269927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-79dbc55c-0e82-4c38-8d0f-602f129494af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:17.275888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79dbc55c-0e82-4c38-8d0f-602f129494af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:17.276403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79dbc55c-0e82-4c38-8d0f-602f129494af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:17.276839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79dbc55c-0e82-4c38-8d0f-602f129494af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:17.277523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79dbc55c-0e82-4c38-8d0f-602f129494af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:17.277972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79dbc55c-0e82-4c38-8d0f-602f129494af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:17.278396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79dbc55c-0e82-4c38-8d0f-602f129494af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:17.337796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-79dbc55c-0e82-4c38-8d0f-602f129494af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:17.345535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-79dbc55c-0e82-4c38-8d0f-602f129494af tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.080069 Aug 06 12:57:17.346092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1353/2712] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:17 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:17.992795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b4d2514a-1127-41d8-bab8-65a62748adcb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:17.993465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b4d2514a-1127-41d8-bab8-65a62748adcb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:17.999919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4d2514a-1127-41d8-bab8-65a62748adcb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:18.000433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4d2514a-1127-41d8-bab8-65a62748adcb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:18.000867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4d2514a-1127-41d8-bab8-65a62748adcb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:18.001549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4d2514a-1127-41d8-bab8-65a62748adcb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:18.001999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4d2514a-1127-41d8-bab8-65a62748adcb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:18.002419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b4d2514a-1127-41d8-bab8-65a62748adcb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:18.100887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:18.101489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:18.108766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:18.109230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:18.109669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:18.110354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:18.110803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:18.111223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:18.128763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b4d2514a-1127-41d8-bab8-65a62748adcb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:18.136601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b4d2514a-1127-41d8-bab8-65a62748adcb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147609 Aug 06 12:57:18.137168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1360/2713] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:18.141611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb8e5541-21fa-44e9-86e6-60d0eac9e7c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:18.142232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb8e5541-21fa-44e9-86e6-60d0eac9e7c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:18.147947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb8e5541-21fa-44e9-86e6-60d0eac9e7c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:18.148458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb8e5541-21fa-44e9-86e6-60d0eac9e7c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:18.148883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb8e5541-21fa-44e9-86e6-60d0eac9e7c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:18.150053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb8e5541-21fa-44e9-86e6-60d0eac9e7c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:18.150505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb8e5541-21fa-44e9-86e6-60d0eac9e7c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:18.150922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb8e5541-21fa-44e9-86e6-60d0eac9e7c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:18.179093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:18.181345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:18.189135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:18.190627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:18.191782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d726991-665e-4c52-a7a4-e09147e78e12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.094787 Aug 06 12:57:18.192370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1354/2714] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:57:18.278854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bb8e5541-21fa-44e9-86e6-60d0eac9e7c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:18.286787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb8e5541-21fa-44e9-86e6-60d0eac9e7c5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148650 Aug 06 12:57:18.287350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1361/2715] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:18 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:18.365397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2bfe02f6-508d-40c4-a38b-222a3e16f2be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:18.365992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2bfe02f6-508d-40c4-a38b-222a3e16f2be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:18.371741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bfe02f6-508d-40c4-a38b-222a3e16f2be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:18.372212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bfe02f6-508d-40c4-a38b-222a3e16f2be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:18.372670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bfe02f6-508d-40c4-a38b-222a3e16f2be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:18.373385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bfe02f6-508d-40c4-a38b-222a3e16f2be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:18.373832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bfe02f6-508d-40c4-a38b-222a3e16f2be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:18.374245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bfe02f6-508d-40c4-a38b-222a3e16f2be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:18.433239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2bfe02f6-508d-40c4-a38b-222a3e16f2be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:18.440969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2bfe02f6-508d-40c4-a38b-222a3e16f2be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.079563 Aug 06 12:57:18.441530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1355/2716] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:18 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:19.158216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-db6601b1-6fd6-4470-b3c5-d71a1686f8b5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:19.158743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-db6601b1-6fd6-4470-b3c5-d71a1686f8b5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:19.165701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db6601b1-6fd6-4470-b3c5-d71a1686f8b5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:19.166176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db6601b1-6fd6-4470-b3c5-d71a1686f8b5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:19.166606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db6601b1-6fd6-4470-b3c5-d71a1686f8b5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:19.167278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db6601b1-6fd6-4470-b3c5-d71a1686f8b5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:19.167724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db6601b1-6fd6-4470-b3c5-d71a1686f8b5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:19.168148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db6601b1-6fd6-4470-b3c5-d71a1686f8b5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:19.216659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:19.217282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:19.223335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:19.223928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:19.224395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:19.225072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:19.225517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:19.225936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:19.287951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:19.297217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:19.298556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:19.299485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-db6601b1-6fd6-4470-b3c5-d71a1686f8b5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:19.299684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-05b54475-5782-4446-952f-08e17296a0d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087075 Aug 06 12:57:19.300236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1356/2717] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:57:19.308076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-db6601b1-6fd6-4470-b3c5-d71a1686f8b5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153726 Aug 06 12:57:19.308864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1362/2718] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:19.309006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-741dcf46-3045-4452-a1a5-32ca1a8364de tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:19.309673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-741dcf46-3045-4452-a1a5-32ca1a8364de tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:19.315705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-741dcf46-3045-4452-a1a5-32ca1a8364de tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:19.316178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-741dcf46-3045-4452-a1a5-32ca1a8364de tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:19.316670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-741dcf46-3045-4452-a1a5-32ca1a8364de tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:19.317353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-741dcf46-3045-4452-a1a5-32ca1a8364de tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:19.317808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-741dcf46-3045-4452-a1a5-32ca1a8364de tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:19.318228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-741dcf46-3045-4452-a1a5-32ca1a8364de tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:19.445777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-741dcf46-3045-4452-a1a5-32ca1a8364de tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:19.453701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-741dcf46-3045-4452-a1a5-32ca1a8364de tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149121 Aug 06 12:57:19.454262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1357/2719] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:19 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:19.463192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98a1ae04-44a5-422d-8fa8-12b24df87aeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:19.463924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-98a1ae04-44a5-422d-8fa8-12b24df87aeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:19.469903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98a1ae04-44a5-422d-8fa8-12b24df87aeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:19.470378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98a1ae04-44a5-422d-8fa8-12b24df87aeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:19.470805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98a1ae04-44a5-422d-8fa8-12b24df87aeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:19.471478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98a1ae04-44a5-422d-8fa8-12b24df87aeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:19.471924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98a1ae04-44a5-422d-8fa8-12b24df87aeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:19.472366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98a1ae04-44a5-422d-8fa8-12b24df87aeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:19.532052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98a1ae04-44a5-422d-8fa8-12b24df87aeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:19.539678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98a1ae04-44a5-422d-8fa8-12b24df87aeb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.080861 Aug 06 12:57:19.540810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1363/2720] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:19 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:20.322868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:20.323468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:20.328981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e92702d5-e1ca-449e-a3a3-63fb3f28c458 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:20.329587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e92702d5-e1ca-449e-a3a3-63fb3f28c458 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:20.329944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:20.330429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:20.330864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:20.331559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:20.331996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:20.332446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:20.335935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e92702d5-e1ca-449e-a3a3-63fb3f28c458 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:20.336435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e92702d5-e1ca-449e-a3a3-63fb3f28c458 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:20.336869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e92702d5-e1ca-449e-a3a3-63fb3f28c458 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:20.337553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e92702d5-e1ca-449e-a3a3-63fb3f28c458 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:20.338004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e92702d5-e1ca-449e-a3a3-63fb3f28c458 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:20.338423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e92702d5-e1ca-449e-a3a3-63fb3f28c458 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:20.395168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:20.403554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:20.405074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:20.406213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-77d0e8f5-05ad-4643-90e5-0bde1f7e490a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087843 Aug 06 12:57:20.406772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1358/2721] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:20.475088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-728b5784-a0e3-4681-99e4-38bd5179bf88 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:20.475385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e92702d5-e1ca-449e-a3a3-63fb3f28c458 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:20.475729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-728b5784-a0e3-4681-99e4-38bd5179bf88 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:20.481896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-728b5784-a0e3-4681-99e4-38bd5179bf88 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:20.482377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-728b5784-a0e3-4681-99e4-38bd5179bf88 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:20.482806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-728b5784-a0e3-4681-99e4-38bd5179bf88 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:20.483634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e92702d5-e1ca-449e-a3a3-63fb3f28c458 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.158245 Aug 06 12:57:20.483759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-728b5784-a0e3-4681-99e4-38bd5179bf88 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:20.484176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-728b5784-a0e3-4681-99e4-38bd5179bf88 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:20.484291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1364/2722] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:20.484623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-728b5784-a0e3-4681-99e4-38bd5179bf88 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:20.561262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8487a372-7d97-4f23-862b-37fa6b905921 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:20.561893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8487a372-7d97-4f23-862b-37fa6b905921 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:20.567797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8487a372-7d97-4f23-862b-37fa6b905921 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:20.568277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8487a372-7d97-4f23-862b-37fa6b905921 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:20.568731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8487a372-7d97-4f23-862b-37fa6b905921 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:20.569405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8487a372-7d97-4f23-862b-37fa6b905921 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:20.569849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8487a372-7d97-4f23-862b-37fa6b905921 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:20.570255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8487a372-7d97-4f23-862b-37fa6b905921 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:20.611671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-728b5784-a0e3-4681-99e4-38bd5179bf88 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:20.620221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-728b5784-a0e3-4681-99e4-38bd5179bf88 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148901 Aug 06 12:57:20.620808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1359/2723] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:20 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:20.632186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8487a372-7d97-4f23-862b-37fa6b905921 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:20.640109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8487a372-7d97-4f23-862b-37fa6b905921 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082744 Aug 06 12:57:20.640701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1365/2724] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:20 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:21.428254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:21.428885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:21.435213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:21.435686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:21.436113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:21.436815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:21.437260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:21.437678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:21.502333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:21.505581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a7c0910b-55ee-40ed-9a95-0e220d0fa3fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:21.506328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a7c0910b-55ee-40ed-9a95-0e220d0fa3fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:21.511249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:21.512745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:21.513286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7c0910b-55ee-40ed-9a95-0e220d0fa3fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:21.513768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7c0910b-55ee-40ed-9a95-0e220d0fa3fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:21.513884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-766bc194-78fb-4144-8071-6320bb72cb95 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089561 Aug 06 12:57:21.514202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7c0910b-55ee-40ed-9a95-0e220d0fa3fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:21.514400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1360/2725] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:21 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:21.514886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7c0910b-55ee-40ed-9a95-0e220d0fa3fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:21.515463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7c0910b-55ee-40ed-9a95-0e220d0fa3fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:21.515894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7c0910b-55ee-40ed-9a95-0e220d0fa3fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:21.640008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a7c0910b-55ee-40ed-9a95-0e220d0fa3fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:21.641240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ce80d5ec-b841-478f-b066-b1a8ae697506 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:21.641846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ce80d5ec-b841-478f-b066-b1a8ae697506 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:21.647876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce80d5ec-b841-478f-b066-b1a8ae697506 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:21.648056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a7c0910b-55ee-40ed-9a95-0e220d0fa3fa tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146202 Aug 06 12:57:21.648373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce80d5ec-b841-478f-b066-b1a8ae697506 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:21.648742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1366/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:21 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:21.648951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce80d5ec-b841-478f-b066-b1a8ae697506 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:21.650026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce80d5ec-b841-478f-b066-b1a8ae697506 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:21.650492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce80d5ec-b841-478f-b066-b1a8ae697506 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:21.650906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce80d5ec-b841-478f-b066-b1a8ae697506 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:21.667840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0820b9ca-b80b-474b-a9da-924bc30500e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:21.668597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0820b9ca-b80b-474b-a9da-924bc30500e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:21.674710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0820b9ca-b80b-474b-a9da-924bc30500e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:21.675189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0820b9ca-b80b-474b-a9da-924bc30500e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:21.675618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0820b9ca-b80b-474b-a9da-924bc30500e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:21.676330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0820b9ca-b80b-474b-a9da-924bc30500e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:21.676780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0820b9ca-b80b-474b-a9da-924bc30500e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:21.677200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0820b9ca-b80b-474b-a9da-924bc30500e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:21.741855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0820b9ca-b80b-474b-a9da-924bc30500e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:21.750642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0820b9ca-b80b-474b-a9da-924bc30500e4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.086867 Aug 06 12:57:21.751207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1367/2727] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:21 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:21.780841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ce80d5ec-b841-478f-b066-b1a8ae697506 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:21.788653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ce80d5ec-b841-478f-b066-b1a8ae697506 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151568 Aug 06 12:57:21.789201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1361/2728] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:21 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:22.536829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:22.537451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:22.544401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:22.544875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:22.545302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:22.545972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:22.546414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:22.546826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:22.607411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:22.616124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:22.617668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:22.618821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3bfe1ee5-d956-4c84-b707-91d030fc6452 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085864 Aug 06 12:57:22.619370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1368/2729] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:22.670139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4b47ff45-a871-4a96-8552-fb8b4ced5042 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:22.670737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4b47ff45-a871-4a96-8552-fb8b4ced5042 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:22.673043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:22.678187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b47ff45-a871-4a96-8552-fb8b4ced5042 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:22.678662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b47ff45-a871-4a96-8552-fb8b4ced5042 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:22.679091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b47ff45-a871-4a96-8552-fb8b4ced5042 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:22.679763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b47ff45-a871-4a96-8552-fb8b4ced5042 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:22.680207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b47ff45-a871-4a96-8552-fb8b4ced5042 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:22.680647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b47ff45-a871-4a96-8552-fb8b4ced5042 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:22.770743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b67781c6-147b-463a-9a2e-2ccb659d3c52 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:22.771337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b67781c6-147b-463a-9a2e-2ccb659d3c52 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:22.777579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67781c6-147b-463a-9a2e-2ccb659d3c52 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:22.778047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67781c6-147b-463a-9a2e-2ccb659d3c52 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:22.778476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67781c6-147b-463a-9a2e-2ccb659d3c52 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:22.779150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67781c6-147b-463a-9a2e-2ccb659d3c52 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:22.779593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67781c6-147b-463a-9a2e-2ccb659d3c52 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:22.780007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67781c6-147b-463a-9a2e-2ccb659d3c52 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:22.808040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4b47ff45-a871-4a96-8552-fb8b4ced5042 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:22.816176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4b47ff45-a871-4a96-8552-fb8b4ced5042 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149751 Aug 06 12:57:22.816770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1362/2730] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:22 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:22.821220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ea14345a-d151-442e-9861-d092f98d0b3e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:22.821807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ea14345a-d151-442e-9861-d092f98d0b3e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:22.827665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea14345a-d151-442e-9861-d092f98d0b3e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:22.828149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea14345a-d151-442e-9861-d092f98d0b3e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:22.828607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea14345a-d151-442e-9861-d092f98d0b3e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:22.829299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea14345a-d151-442e-9861-d092f98d0b3e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:22.829777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea14345a-d151-442e-9861-d092f98d0b3e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:22.830196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea14345a-d151-442e-9861-d092f98d0b3e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:22.841120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b67781c6-147b-463a-9a2e-2ccb659d3c52 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:22.843318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:22.850191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b67781c6-147b-463a-9a2e-2ccb659d3c52 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083133 Aug 06 12:57:22.850931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1369/2731] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:22 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:22.958843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ea14345a-d151-442e-9861-d092f98d0b3e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:22.967141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ea14345a-d151-442e-9861-d092f98d0b3e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149417 Aug 06 12:57:22.967733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1363/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:22 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:23.641307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:23.641826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:23.648598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:23.649087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:23.649521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:23.650205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:23.650656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:23.651086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:23.711157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:23.719368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:23.720877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:23.721997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bc4b9855-bd3b-43cc-93f3-7fd77f811136 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084832 Aug 06 12:57:23.722557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1370/2733] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:23.837918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d91f918a-7414-491d-96ea-66f03f519bd8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:23.838510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d91f918a-7414-491d-96ea-66f03f519bd8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:23.844850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d91f918a-7414-491d-96ea-66f03f519bd8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:23.845324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d91f918a-7414-491d-96ea-66f03f519bd8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:23.845751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d91f918a-7414-491d-96ea-66f03f519bd8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:23.846423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d91f918a-7414-491d-96ea-66f03f519bd8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:23.846867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d91f918a-7414-491d-96ea-66f03f519bd8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:23.847280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d91f918a-7414-491d-96ea-66f03f519bd8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:23.871406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e11fc166-3aae-4966-a849-5d8162dd6a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:23.872018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e11fc166-3aae-4966-a849-5d8162dd6a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:23.877753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11fc166-3aae-4966-a849-5d8162dd6a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:23.878218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11fc166-3aae-4966-a849-5d8162dd6a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:23.878645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11fc166-3aae-4966-a849-5d8162dd6a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:23.879319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11fc166-3aae-4966-a849-5d8162dd6a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:23.879761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11fc166-3aae-4966-a849-5d8162dd6a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:23.880174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11fc166-3aae-4966-a849-5d8162dd6a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:23.940998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e11fc166-3aae-4966-a849-5d8162dd6a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:23.948946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e11fc166-3aae-4966-a849-5d8162dd6a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081898 Aug 06 12:57:23.949801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1371/2734] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:23.975959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d91f918a-7414-491d-96ea-66f03f519bd8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:23.984834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d91f918a-7414-491d-96ea-66f03f519bd8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150765 Aug 06 12:57:23.985392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1364/2735] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:23 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:23.987833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-06d6f5f7-55a9-4bfb-852b-eb190799a66f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:23.988505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-06d6f5f7-55a9-4bfb-852b-eb190799a66f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:23.990330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:23.997596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06d6f5f7-55a9-4bfb-852b-eb190799a66f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:23.998083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06d6f5f7-55a9-4bfb-852b-eb190799a66f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:23.998523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06d6f5f7-55a9-4bfb-852b-eb190799a66f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:23.999217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06d6f5f7-55a9-4bfb-852b-eb190799a66f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:23.999666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06d6f5f7-55a9-4bfb-852b-eb190799a66f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:24.000655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-06d6f5f7-55a9-4bfb-852b-eb190799a66f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:24.134891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-06d6f5f7-55a9-4bfb-852b-eb190799a66f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:24.142693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-06d6f5f7-55a9-4bfb-852b-eb190799a66f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.158727 Aug 06 12:57:24.143254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1372/2736] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:23 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:24.745301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:24.745897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:24.751820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:24.752293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:24.752746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:24.753415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:24.753861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:24.754279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:24.813344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:24.822319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:24.823809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:24.824998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd630416-c168-42d7-b4c7-a791f3955930 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084021 Aug 06 12:57:24.825589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1365/2737] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:24.968652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-10c00b77-fabe-4531-9eee-2e6f58826b84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:24.969257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-10c00b77-fabe-4531-9eee-2e6f58826b84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:24.975520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10c00b77-fabe-4531-9eee-2e6f58826b84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:24.975994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10c00b77-fabe-4531-9eee-2e6f58826b84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:24.976450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10c00b77-fabe-4531-9eee-2e6f58826b84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:24.977123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10c00b77-fabe-4531-9eee-2e6f58826b84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:24.977585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10c00b77-fabe-4531-9eee-2e6f58826b84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:24.978008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10c00b77-fabe-4531-9eee-2e6f58826b84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:25.006493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-094414a8-fb06-45e3-b47d-571f655af231 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:25.007142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-094414a8-fb06-45e3-b47d-571f655af231 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:25.014256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-094414a8-fb06-45e3-b47d-571f655af231 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:25.014735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-094414a8-fb06-45e3-b47d-571f655af231 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:25.015169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-094414a8-fb06-45e3-b47d-571f655af231 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:25.015857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-094414a8-fb06-45e3-b47d-571f655af231 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:25.016321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-094414a8-fb06-45e3-b47d-571f655af231 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:25.016752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-094414a8-fb06-45e3-b47d-571f655af231 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:25.041956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10c00b77-fabe-4531-9eee-2e6f58826b84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:25.049970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-10c00b77-fabe-4531-9eee-2e6f58826b84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085098 Aug 06 12:57:25.050538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1373/2738] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:25.148535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-094414a8-fb06-45e3-b47d-571f655af231 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:25.156371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-094414a8-fb06-45e3-b47d-571f655af231 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153790 Aug 06 12:57:25.156957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1366/2739] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:25 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:25.164401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-baead656-fd70-40ec-b14a-317619fe5040 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:25.165502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-baead656-fd70-40ec-b14a-317619fe5040 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:25.171386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-baead656-fd70-40ec-b14a-317619fe5040 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:25.171849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-baead656-fd70-40ec-b14a-317619fe5040 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:25.172281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-baead656-fd70-40ec-b14a-317619fe5040 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:25.172980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-baead656-fd70-40ec-b14a-317619fe5040 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:25.173427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-baead656-fd70-40ec-b14a-317619fe5040 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:25.173851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-baead656-fd70-40ec-b14a-317619fe5040 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:25.302110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-baead656-fd70-40ec-b14a-317619fe5040 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:25.310875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-baead656-fd70-40ec-b14a-317619fe5040 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150386 Aug 06 12:57:25.311465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1374/2740] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:25 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:25.848635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:25.849372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:25.856121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:25.856629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:25.857068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:25.857755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:25.858461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:25.858896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:25.917984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:25.926299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:25.927800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:25.928961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa763c65-8440-4039-9c02-a8cf6a823636 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084460 Aug 06 12:57:25.929512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1367/2741] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:26.071646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-efeeaaea-4dfa-474d-ae61-10ddadf723aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:26.072255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-efeeaaea-4dfa-474d-ae61-10ddadf723aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:26.078634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efeeaaea-4dfa-474d-ae61-10ddadf723aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:26.079118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efeeaaea-4dfa-474d-ae61-10ddadf723aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:26.079554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efeeaaea-4dfa-474d-ae61-10ddadf723aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:26.080241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efeeaaea-4dfa-474d-ae61-10ddadf723aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:26.080943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efeeaaea-4dfa-474d-ae61-10ddadf723aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:26.081371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efeeaaea-4dfa-474d-ae61-10ddadf723aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:26.142335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-efeeaaea-4dfa-474d-ae61-10ddadf723aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:26.150897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-efeeaaea-4dfa-474d-ae61-10ddadf723aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083588 Aug 06 12:57:26.151457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1375/2742] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:26.177903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7540f2a2-5371-4f5a-9b95-57c76a3980e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:26.178599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7540f2a2-5371-4f5a-9b95-57c76a3980e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:26.184955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7540f2a2-5371-4f5a-9b95-57c76a3980e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:26.185430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7540f2a2-5371-4f5a-9b95-57c76a3980e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:26.185870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7540f2a2-5371-4f5a-9b95-57c76a3980e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:26.186549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7540f2a2-5371-4f5a-9b95-57c76a3980e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:26.187001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7540f2a2-5371-4f5a-9b95-57c76a3980e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:26.187422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7540f2a2-5371-4f5a-9b95-57c76a3980e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:26.316012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7540f2a2-5371-4f5a-9b95-57c76a3980e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:26.324611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7540f2a2-5371-4f5a-9b95-57c76a3980e7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150487 Aug 06 12:57:26.325178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1368/2743] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:26 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:26.331857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27309c56-bebe-41c8-acc9-9c97303fef7b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:26.332485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-27309c56-bebe-41c8-acc9-9c97303fef7b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:26.338630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27309c56-bebe-41c8-acc9-9c97303fef7b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:26.339115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27309c56-bebe-41c8-acc9-9c97303fef7b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:26.339547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27309c56-bebe-41c8-acc9-9c97303fef7b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:26.340237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27309c56-bebe-41c8-acc9-9c97303fef7b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:26.340727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27309c56-bebe-41c8-acc9-9c97303fef7b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:26.341152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27309c56-bebe-41c8-acc9-9c97303fef7b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:26.470126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-27309c56-bebe-41c8-acc9-9c97303fef7b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:26.477897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-27309c56-bebe-41c8-acc9-9c97303fef7b tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149776 Aug 06 12:57:26.478454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1376/2744] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:26 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:26.955075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:26.955678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:26.962142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:26.962621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:26.963052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:26.963732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:26.964180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:26.964627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:27.031455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:27.040615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:27.042137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:27.043283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd2a13aa-ce2e-4f6a-8fc9-9a3a42cfe028 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.092108 Aug 06 12:57:27.043879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1369/2745] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:27.171856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d8ba86f3-7e54-4d32-98e0-cdb30c4c8525 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:27.172508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d8ba86f3-7e54-4d32-98e0-cdb30c4c8525 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:27.178967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8ba86f3-7e54-4d32-98e0-cdb30c4c8525 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:27.179447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8ba86f3-7e54-4d32-98e0-cdb30c4c8525 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:27.179885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8ba86f3-7e54-4d32-98e0-cdb30c4c8525 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:27.180595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8ba86f3-7e54-4d32-98e0-cdb30c4c8525 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:27.181046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8ba86f3-7e54-4d32-98e0-cdb30c4c8525 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:27.181468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8ba86f3-7e54-4d32-98e0-cdb30c4c8525 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:27.246685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d8ba86f3-7e54-4d32-98e0-cdb30c4c8525 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:27.254575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d8ba86f3-7e54-4d32-98e0-cdb30c4c8525 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.086557 Aug 06 12:57:27.255139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1377/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:27 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:27.345983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8a14754-71aa-4ee4-a95c-26f6f4495b04 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:27.346581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8a14754-71aa-4ee4-a95c-26f6f4495b04 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:27.353705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8a14754-71aa-4ee4-a95c-26f6f4495b04 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:27.354189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8a14754-71aa-4ee4-a95c-26f6f4495b04 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:27.354626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8a14754-71aa-4ee4-a95c-26f6f4495b04 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:27.355313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8a14754-71aa-4ee4-a95c-26f6f4495b04 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:27.355768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8a14754-71aa-4ee4-a95c-26f6f4495b04 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:27.356193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8a14754-71aa-4ee4-a95c-26f6f4495b04 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:27.482390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8a14754-71aa-4ee4-a95c-26f6f4495b04 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:27.490494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8a14754-71aa-4ee4-a95c-26f6f4495b04 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148373 Aug 06 12:57:27.491062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1370/2747] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:27 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:27.498876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d1451ae6-209e-4547-b61d-84cf458aeccc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:27.499459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d1451ae6-209e-4547-b61d-84cf458aeccc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:27.505342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1451ae6-209e-4547-b61d-84cf458aeccc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:27.505814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1451ae6-209e-4547-b61d-84cf458aeccc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:27.506241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1451ae6-209e-4547-b61d-84cf458aeccc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:27.506910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1451ae6-209e-4547-b61d-84cf458aeccc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:27.507357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1451ae6-209e-4547-b61d-84cf458aeccc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:27.507771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1451ae6-209e-4547-b61d-84cf458aeccc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:27.638541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d1451ae6-209e-4547-b61d-84cf458aeccc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:27.647053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d1451ae6-209e-4547-b61d-84cf458aeccc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152020 Aug 06 12:57:27.647662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1378/2748] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:27 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:28.065555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:28.066161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:28.072735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:28.073211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:28.073644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:28.074324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:28.074770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:28.075190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:28.089482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:28.135936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:28.144159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:28.145670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:28.146804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-123a7f87-01fc-44cc-919c-e060490b6f7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085173 Aug 06 12:57:28.147351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1371/2749] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:28.275019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c886917a-b1ae-4d58-b9f3-c0fa5164d1cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:28.275557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c886917a-b1ae-4d58-b9f3-c0fa5164d1cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:28.281829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c886917a-b1ae-4d58-b9f3-c0fa5164d1cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:28.282302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c886917a-b1ae-4d58-b9f3-c0fa5164d1cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:28.282724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c886917a-b1ae-4d58-b9f3-c0fa5164d1cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:28.283391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c886917a-b1ae-4d58-b9f3-c0fa5164d1cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:28.283834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c886917a-b1ae-4d58-b9f3-c0fa5164d1cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:28.284248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c886917a-b1ae-4d58-b9f3-c0fa5164d1cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:28.343940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c886917a-b1ae-4d58-b9f3-c0fa5164d1cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:28.351655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c886917a-b1ae-4d58-b9f3-c0fa5164d1cf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.080629 Aug 06 12:57:28.352763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1379/2750] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:28 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:28.511511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a6ef926d-4625-4352-a777-1c60a8590792 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:28.512116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a6ef926d-4625-4352-a777-1c60a8590792 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:28.518492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6ef926d-4625-4352-a777-1c60a8590792 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:28.518969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6ef926d-4625-4352-a777-1c60a8590792 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:28.519400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6ef926d-4625-4352-a777-1c60a8590792 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:28.520085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6ef926d-4625-4352-a777-1c60a8590792 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:28.520562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6ef926d-4625-4352-a777-1c60a8590792 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:28.520984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6ef926d-4625-4352-a777-1c60a8590792 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:28.648946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a6ef926d-4625-4352-a777-1c60a8590792 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:28.657395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a6ef926d-4625-4352-a777-1c60a8590792 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149665 Aug 06 12:57:28.657965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1372/2751] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:28 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:28.669004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fe779097-9ce0-4496-8455-160e09b0816e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:28.669630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fe779097-9ce0-4496-8455-160e09b0816e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:28.675354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe779097-9ce0-4496-8455-160e09b0816e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:28.675823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe779097-9ce0-4496-8455-160e09b0816e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:28.676248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe779097-9ce0-4496-8455-160e09b0816e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:28.676939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe779097-9ce0-4496-8455-160e09b0816e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:28.677383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe779097-9ce0-4496-8455-160e09b0816e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:28.677796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fe779097-9ce0-4496-8455-160e09b0816e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:28.805604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fe779097-9ce0-4496-8455-160e09b0816e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:28.813478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fe779097-9ce0-4496-8455-160e09b0816e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148905 Aug 06 12:57:28.814026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1380/2752] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:28 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:29.169016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:29.169615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:29.176759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:29.177126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:29.177607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:29.178302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:29.178838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:29.179329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:29.240595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:29.249378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:29.250867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:29.251993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-29abdce5-f337-42e2-a7ea-a41ea7e27467 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086825 Aug 06 12:57:29.252590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1373/2753] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:29.373483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-edbfb124-f5a9-43fc-8575-0e96151cd3d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:29.374086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-edbfb124-f5a9-43fc-8575-0e96151cd3d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:29.380432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbfb124-f5a9-43fc-8575-0e96151cd3d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:29.380910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbfb124-f5a9-43fc-8575-0e96151cd3d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:29.381338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbfb124-f5a9-43fc-8575-0e96151cd3d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:29.382009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbfb124-f5a9-43fc-8575-0e96151cd3d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:29.382455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbfb124-f5a9-43fc-8575-0e96151cd3d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:29.382872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edbfb124-f5a9-43fc-8575-0e96151cd3d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:29.443731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-edbfb124-f5a9-43fc-8575-0e96151cd3d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:29.452471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-edbfb124-f5a9-43fc-8575-0e96151cd3d6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082750 Aug 06 12:57:29.453034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1381/2754] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:29 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:29.679259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2e1af608-6248-40f7-9816-423d7f521392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:29.679867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2e1af608-6248-40f7-9816-423d7f521392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:29.686901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e1af608-6248-40f7-9816-423d7f521392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:29.687377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e1af608-6248-40f7-9816-423d7f521392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:29.687810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e1af608-6248-40f7-9816-423d7f521392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:29.688518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e1af608-6248-40f7-9816-423d7f521392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:29.688971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e1af608-6248-40f7-9816-423d7f521392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:29.689393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e1af608-6248-40f7-9816-423d7f521392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:29.812685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2e1af608-6248-40f7-9816-423d7f521392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:29.820465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2e1af608-6248-40f7-9816-423d7f521392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.144943 Aug 06 12:57:29.821033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1374/2755] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:29 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:29.834373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dae957e1-ea1b-4a50-b213-f4941c1b2b15 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:29.835024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dae957e1-ea1b-4a50-b213-f4941c1b2b15 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:29.840947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae957e1-ea1b-4a50-b213-f4941c1b2b15 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:29.841417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae957e1-ea1b-4a50-b213-f4941c1b2b15 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:29.841838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae957e1-ea1b-4a50-b213-f4941c1b2b15 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:29.842505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae957e1-ea1b-4a50-b213-f4941c1b2b15 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:29.842944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae957e1-ea1b-4a50-b213-f4941c1b2b15 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:29.843356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae957e1-ea1b-4a50-b213-f4941c1b2b15 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:29.969321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dae957e1-ea1b-4a50-b213-f4941c1b2b15 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:29.977104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dae957e1-ea1b-4a50-b213-f4941c1b2b15 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146481 Aug 06 12:57:29.978320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1382/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:29 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:30.275919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:30.276490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:30.282455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:30.282937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:30.283374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:30.284050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:30.284596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:30.285021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:30.348975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:30.357810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:30.359570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:30.360741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f2310b54-9b92-4368-b42b-08f932c13a7f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089731 Aug 06 12:57:30.361296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1375/2757] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:30.472656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-791d781e-71e3-4257-ac25-fc110c9e3a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:30.473279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-791d781e-71e3-4257-ac25-fc110c9e3a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:30.479622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-791d781e-71e3-4257-ac25-fc110c9e3a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:30.480094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-791d781e-71e3-4257-ac25-fc110c9e3a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:30.480551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-791d781e-71e3-4257-ac25-fc110c9e3a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:30.481220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-791d781e-71e3-4257-ac25-fc110c9e3a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:30.481689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-791d781e-71e3-4257-ac25-fc110c9e3a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:30.482103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-791d781e-71e3-4257-ac25-fc110c9e3a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:30.542351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-791d781e-71e3-4257-ac25-fc110c9e3a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:30.550073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-791d781e-71e3-4257-ac25-fc110c9e3a0f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081175 Aug 06 12:57:30.550642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1383/2758] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:30 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:30.840830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-737f4766-9e3d-418d-bf14-d2282c70beed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:30.841382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-737f4766-9e3d-418d-bf14-d2282c70beed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:30.847573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737f4766-9e3d-418d-bf14-d2282c70beed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:30.848043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737f4766-9e3d-418d-bf14-d2282c70beed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:30.848505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737f4766-9e3d-418d-bf14-d2282c70beed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:30.849174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737f4766-9e3d-418d-bf14-d2282c70beed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:30.849612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737f4766-9e3d-418d-bf14-d2282c70beed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:30.850030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737f4766-9e3d-418d-bf14-d2282c70beed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:30.974075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-737f4766-9e3d-418d-bf14-d2282c70beed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:30.982287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-737f4766-9e3d-418d-bf14-d2282c70beed tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145373 Aug 06 12:57:30.982851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1376/2759] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:30 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:30.999425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f3aa4fe5-7991-41e0-a66f-21d5929c2dac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:31.000028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f3aa4fe5-7991-41e0-a66f-21d5929c2dac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:31.006116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4fe5-7991-41e0-a66f-21d5929c2dac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:31.006597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4fe5-7991-41e0-a66f-21d5929c2dac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:31.007030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4fe5-7991-41e0-a66f-21d5929c2dac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:31.007711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4fe5-7991-41e0-a66f-21d5929c2dac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:31.008157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4fe5-7991-41e0-a66f-21d5929c2dac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:31.009277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3aa4fe5-7991-41e0-a66f-21d5929c2dac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:31.137815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f3aa4fe5-7991-41e0-a66f-21d5929c2dac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:31.145645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f3aa4fe5-7991-41e0-a66f-21d5929c2dac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150117 Aug 06 12:57:31.146209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1384/2760] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:30 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:31.383046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:31.383681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:31.389629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:31.390049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:31.390481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:31.391163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:31.391610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:31.392030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:31.451834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:31.460509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:31.462492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:31.463978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-273067bb-70cb-4a1c-a3fa-124ecc8f6558 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084558 Aug 06 12:57:31.464566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1377/2761] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:31.570434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-84bb4a16-420b-4840-9152-09b8c59ab141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:31.571071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-84bb4a16-420b-4840-9152-09b8c59ab141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:31.577655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84bb4a16-420b-4840-9152-09b8c59ab141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:31.578137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84bb4a16-420b-4840-9152-09b8c59ab141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:31.578574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84bb4a16-420b-4840-9152-09b8c59ab141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:31.579254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84bb4a16-420b-4840-9152-09b8c59ab141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:31.579708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84bb4a16-420b-4840-9152-09b8c59ab141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:31.580129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84bb4a16-420b-4840-9152-09b8c59ab141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:31.643554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-84bb4a16-420b-4840-9152-09b8c59ab141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:31.651903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-84bb4a16-420b-4840-9152-09b8c59ab141 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085269 Aug 06 12:57:31.652482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1385/2762] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:31 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:32.003538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-908c7531-170b-429a-81dc-549f0525060a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:32.004145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-908c7531-170b-429a-81dc-549f0525060a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:32.011122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-908c7531-170b-429a-81dc-549f0525060a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:32.011600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-908c7531-170b-429a-81dc-549f0525060a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:32.012024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-908c7531-170b-429a-81dc-549f0525060a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:32.012718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-908c7531-170b-429a-81dc-549f0525060a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:32.013167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-908c7531-170b-429a-81dc-549f0525060a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:32.013588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-908c7531-170b-429a-81dc-549f0525060a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:32.141025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-908c7531-170b-429a-81dc-549f0525060a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:32.148731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-908c7531-170b-429a-81dc-549f0525060a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148990 Aug 06 12:57:32.149900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1378/2763] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:31 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:32.165694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-897c3562-b6c2-42b1-be36-97f81381d311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:32.166326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-897c3562-b6c2-42b1-be36-97f81381d311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:32.172200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-897c3562-b6c2-42b1-be36-97f81381d311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:32.172700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-897c3562-b6c2-42b1-be36-97f81381d311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:32.173128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-897c3562-b6c2-42b1-be36-97f81381d311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:32.173799 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-897c3562-b6c2-42b1-be36-97f81381d311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:32.174244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-897c3562-b6c2-42b1-be36-97f81381d311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:32.174660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-897c3562-b6c2-42b1-be36-97f81381d311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:32.189112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:32.300568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-897c3562-b6c2-42b1-be36-97f81381d311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:32.308958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-897c3562-b6c2-42b1-be36-97f81381d311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147127 Aug 06 12:57:32.309512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1386/2764] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:32 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:32.486611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:32.487208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:32.493857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:32.494593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:32.495242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:32.496048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:32.496521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:32.496940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:32.556201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:32.564342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:32.565820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:32.566936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8b2c817-be97-4fb2-b9e3-ebe6955ae1c1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084446 Aug 06 12:57:32.567488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1379/2765] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:32 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:32.672503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-483999a8-fe60-49cf-91ea-4ee67473d4fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:32.673110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-483999a8-fe60-49cf-91ea-4ee67473d4fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:32.679513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483999a8-fe60-49cf-91ea-4ee67473d4fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:32.679990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483999a8-fe60-49cf-91ea-4ee67473d4fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:32.680477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483999a8-fe60-49cf-91ea-4ee67473d4fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:32.681151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483999a8-fe60-49cf-91ea-4ee67473d4fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:32.681601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483999a8-fe60-49cf-91ea-4ee67473d4fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:32.682021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-483999a8-fe60-49cf-91ea-4ee67473d4fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:32.938698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-483999a8-fe60-49cf-91ea-4ee67473d4fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:32.946776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-483999a8-fe60-49cf-91ea-4ee67473d4fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.278101 Aug 06 12:57:32.947339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1387/2766] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:33.171119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2bcb3ebd-4bcc-4929-be20-a64e7e59f8af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:33.171722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2bcb3ebd-4bcc-4929-be20-a64e7e59f8af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:33.177665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bcb3ebd-4bcc-4929-be20-a64e7e59f8af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:33.178140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bcb3ebd-4bcc-4929-be20-a64e7e59f8af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:33.178570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bcb3ebd-4bcc-4929-be20-a64e7e59f8af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:33.179250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bcb3ebd-4bcc-4929-be20-a64e7e59f8af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:33.179695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bcb3ebd-4bcc-4929-be20-a64e7e59f8af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:33.180117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bcb3ebd-4bcc-4929-be20-a64e7e59f8af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:33.304503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2bcb3ebd-4bcc-4929-be20-a64e7e59f8af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:33.312345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2bcb3ebd-4bcc-4929-be20-a64e7e59f8af tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145251 Aug 06 12:57:33.312902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1380/2767] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:33 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:33.331059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ccfcdc1d-6e31-4b78-9d67-f0348f6fd51a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:33.331721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ccfcdc1d-6e31-4b78-9d67-f0348f6fd51a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:33.337994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccfcdc1d-6e31-4b78-9d67-f0348f6fd51a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:33.338466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccfcdc1d-6e31-4b78-9d67-f0348f6fd51a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:33.338896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccfcdc1d-6e31-4b78-9d67-f0348f6fd51a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:33.339573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccfcdc1d-6e31-4b78-9d67-f0348f6fd51a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:33.340021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccfcdc1d-6e31-4b78-9d67-f0348f6fd51a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:33.340473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ccfcdc1d-6e31-4b78-9d67-f0348f6fd51a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:33.464995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ccfcdc1d-6e31-4b78-9d67-f0348f6fd51a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:33.472807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ccfcdc1d-6e31-4b78-9d67-f0348f6fd51a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145590 Aug 06 12:57:33.473367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1388/2768] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:33 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:33.590320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:33.590914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:33.596631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:33.597104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:33.597531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:33.598196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:33.598638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:33.599051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:33.661946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:33.670337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:33.671796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:33.672935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-45069a05-c699-4c8a-aa9f-2e7686680fcd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087065 Aug 06 12:57:33.673479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1381/2769] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:33.966934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d709edba-b059-4c5a-a4f4-01d38e69a46c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:33.967540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d709edba-b059-4c5a-a4f4-01d38e69a46c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:33.973938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d709edba-b059-4c5a-a4f4-01d38e69a46c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:33.974416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d709edba-b059-4c5a-a4f4-01d38e69a46c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:33.974852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d709edba-b059-4c5a-a4f4-01d38e69a46c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:33.975532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d709edba-b059-4c5a-a4f4-01d38e69a46c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:33.975984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d709edba-b059-4c5a-a4f4-01d38e69a46c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:33.976435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d709edba-b059-4c5a-a4f4-01d38e69a46c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:34.039431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d709edba-b059-4c5a-a4f4-01d38e69a46c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:34.047576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d709edba-b059-4c5a-a4f4-01d38e69a46c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084440 Aug 06 12:57:34.048360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1389/2770] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:34.333432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-717a3dd2-b7a5-4756-a74d-6752d96424fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:34.334049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-717a3dd2-b7a5-4756-a74d-6752d96424fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:34.340434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-717a3dd2-b7a5-4756-a74d-6752d96424fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:34.340922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-717a3dd2-b7a5-4756-a74d-6752d96424fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:34.341356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-717a3dd2-b7a5-4756-a74d-6752d96424fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:34.342044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-717a3dd2-b7a5-4756-a74d-6752d96424fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:34.342501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-717a3dd2-b7a5-4756-a74d-6752d96424fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:34.342927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-717a3dd2-b7a5-4756-a74d-6752d96424fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:34.494525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f298b2a7-e46c-4dc2-8bc6-7e82d55306e5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:34.495163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f298b2a7-e46c-4dc2-8bc6-7e82d55306e5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:34.501028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f298b2a7-e46c-4dc2-8bc6-7e82d55306e5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:34.501508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f298b2a7-e46c-4dc2-8bc6-7e82d55306e5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:34.501941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f298b2a7-e46c-4dc2-8bc6-7e82d55306e5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:34.502627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f298b2a7-e46c-4dc2-8bc6-7e82d55306e5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:34.503075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f298b2a7-e46c-4dc2-8bc6-7e82d55306e5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:34.503524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f298b2a7-e46c-4dc2-8bc6-7e82d55306e5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:34.544638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-717a3dd2-b7a5-4756-a74d-6752d96424fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:34.552705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-717a3dd2-b7a5-4756-a74d-6752d96424fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.222994 Aug 06 12:57:34.553620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1382/2771] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:34 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:34.632630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f298b2a7-e46c-4dc2-8bc6-7e82d55306e5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:34.640444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f298b2a7-e46c-4dc2-8bc6-7e82d55306e5 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149713 Aug 06 12:57:34.641012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1390/2772] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:34 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:34.694992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:34.695529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:34.701482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:34.701962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:34.702395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:34.703075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:34.703526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:34.703947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:34.764350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:34.772500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:34.774485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:34.775611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4afbd63f-7d54-42da-ae62-240d763fad6d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084575 Aug 06 12:57:34.776173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1383/2773] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:35.068863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c0a7f3cf-d73f-412d-87e2-e56545d3ad59 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:35.069466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c0a7f3cf-d73f-412d-87e2-e56545d3ad59 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:35.076603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0a7f3cf-d73f-412d-87e2-e56545d3ad59 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:35.077080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0a7f3cf-d73f-412d-87e2-e56545d3ad59 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:35.077551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0a7f3cf-d73f-412d-87e2-e56545d3ad59 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:35.078224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0a7f3cf-d73f-412d-87e2-e56545d3ad59 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:35.078666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0a7f3cf-d73f-412d-87e2-e56545d3ad59 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:35.079082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0a7f3cf-d73f-412d-87e2-e56545d3ad59 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:35.139156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c0a7f3cf-d73f-412d-87e2-e56545d3ad59 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:35.146903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c0a7f3cf-d73f-412d-87e2-e56545d3ad59 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081866 Aug 06 12:57:35.147454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1391/2774] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:35 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:35.574741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c24bf1cd-eb71-4da3-91c6-e84c31bc1116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:35.575364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c24bf1cd-eb71-4da3-91c6-e84c31bc1116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:35.582682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c24bf1cd-eb71-4da3-91c6-e84c31bc1116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:35.583171 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c24bf1cd-eb71-4da3-91c6-e84c31bc1116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:35.583607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c24bf1cd-eb71-4da3-91c6-e84c31bc1116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:35.584293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c24bf1cd-eb71-4da3-91c6-e84c31bc1116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:35.584772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c24bf1cd-eb71-4da3-91c6-e84c31bc1116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:35.585198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c24bf1cd-eb71-4da3-91c6-e84c31bc1116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:35.662556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a2b90bd4-fec5-44fa-a2b2-dddf9478a35f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:35.663080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a2b90bd4-fec5-44fa-a2b2-dddf9478a35f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:35.669538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2b90bd4-fec5-44fa-a2b2-dddf9478a35f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:35.670018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2b90bd4-fec5-44fa-a2b2-dddf9478a35f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:35.670482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2b90bd4-fec5-44fa-a2b2-dddf9478a35f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:35.671178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2b90bd4-fec5-44fa-a2b2-dddf9478a35f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:35.671628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2b90bd4-fec5-44fa-a2b2-dddf9478a35f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:35.672065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2b90bd4-fec5-44fa-a2b2-dddf9478a35f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:35.721499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c24bf1cd-eb71-4da3-91c6-e84c31bc1116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:35.729995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c24bf1cd-eb71-4da3-91c6-e84c31bc1116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.159505 Aug 06 12:57:35.730559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1384/2775] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:35 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:35.798456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:35.799158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:35.800518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2b90bd4-fec5-44fa-a2b2-dddf9478a35f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:35.805817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:35.806299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:35.806733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:35.807424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:35.807874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:35.808294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:35.808903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a2b90bd4-fec5-44fa-a2b2-dddf9478a35f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150287 Aug 06 12:57:35.809466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1392/2776] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:35 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:35.869076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:35.878413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:35.880594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:35.881742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7281b90e-df46-456a-9064-a6647010c5bd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087180 Aug 06 12:57:35.882305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1385/2777] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:57:36.168689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bcab4826-7130-4a7a-aa76-d62bacad6363 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:36.169291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bcab4826-7130-4a7a-aa76-d62bacad6363 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:36.175548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcab4826-7130-4a7a-aa76-d62bacad6363 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:36.176021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcab4826-7130-4a7a-aa76-d62bacad6363 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:36.176493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcab4826-7130-4a7a-aa76-d62bacad6363 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:36.177168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcab4826-7130-4a7a-aa76-d62bacad6363 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:36.177623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcab4826-7130-4a7a-aa76-d62bacad6363 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:36.178041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcab4826-7130-4a7a-aa76-d62bacad6363 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:36.242937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bcab4826-7130-4a7a-aa76-d62bacad6363 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:36.250817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bcab4826-7130-4a7a-aa76-d62bacad6363 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.086541 Aug 06 12:57:36.251311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1393/2778] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:36 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:36.752034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bc401395-ad9a-41fe-978e-04b6e7580f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:36.752650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bc401395-ad9a-41fe-978e-04b6e7580f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:36.759708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc401395-ad9a-41fe-978e-04b6e7580f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:36.760180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc401395-ad9a-41fe-978e-04b6e7580f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:36.760639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc401395-ad9a-41fe-978e-04b6e7580f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:36.761314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc401395-ad9a-41fe-978e-04b6e7580f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:36.761758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc401395-ad9a-41fe-978e-04b6e7580f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:36.762173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc401395-ad9a-41fe-978e-04b6e7580f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:36.830682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1cfdfb59-f3e4-4d6c-8d58-d39ecc6b421d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:36.831306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1cfdfb59-f3e4-4d6c-8d58-d39ecc6b421d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:36.837162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1cfdfb59-f3e4-4d6c-8d58-d39ecc6b421d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:36.837634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1cfdfb59-f3e4-4d6c-8d58-d39ecc6b421d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:36.838058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1cfdfb59-f3e4-4d6c-8d58-d39ecc6b421d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:36.838732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1cfdfb59-f3e4-4d6c-8d58-d39ecc6b421d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:36.839200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1cfdfb59-f3e4-4d6c-8d58-d39ecc6b421d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:36.839615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1cfdfb59-f3e4-4d6c-8d58-d39ecc6b421d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:36.896097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bc401395-ad9a-41fe-978e-04b6e7580f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:36.904433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bc401395-ad9a-41fe-978e-04b6e7580f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.156178 Aug 06 12:57:36.905001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1386/2779] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:36 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:36.909416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:36.910249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:36.917658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:36.918144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:36.918570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:36.919343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:36.919876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:36.921096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:36.975775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1cfdfb59-f3e4-4d6c-8d58-d39ecc6b421d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:36.984700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1cfdfb59-f3e4-4d6c-8d58-d39ecc6b421d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.158009 Aug 06 12:57:36.985276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1394/2780] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:36 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:36.986006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:36.997359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:36.999454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:37.000986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-839ae0b0-0cf8-43ed-9050-e724e3e383c8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.094712 Aug 06 12:57:37.007230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1387/2781] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:37.271049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1b6ffed1-4da7-45f0-9865-5d91841bff71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:37.271585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1b6ffed1-4da7-45f0-9865-5d91841bff71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:37.277928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b6ffed1-4da7-45f0-9865-5d91841bff71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:37.278407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b6ffed1-4da7-45f0-9865-5d91841bff71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:37.278836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b6ffed1-4da7-45f0-9865-5d91841bff71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:37.279514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b6ffed1-4da7-45f0-9865-5d91841bff71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:37.279960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b6ffed1-4da7-45f0-9865-5d91841bff71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:37.280409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b6ffed1-4da7-45f0-9865-5d91841bff71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:37.340140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1b6ffed1-4da7-45f0-9865-5d91841bff71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:37.347858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1b6ffed1-4da7-45f0-9865-5d91841bff71 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.080723 Aug 06 12:57:37.348449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1395/2782] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:37.930349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6a59ff92-f76d-4a2d-884a-383e95f0ff3a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:37.930977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6a59ff92-f76d-4a2d-884a-383e95f0ff3a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:37.937356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a59ff92-f76d-4a2d-884a-383e95f0ff3a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:37.937828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a59ff92-f76d-4a2d-884a-383e95f0ff3a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:37.938256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a59ff92-f76d-4a2d-884a-383e95f0ff3a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:37.938928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a59ff92-f76d-4a2d-884a-383e95f0ff3a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:37.939376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a59ff92-f76d-4a2d-884a-383e95f0ff3a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:37.939795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a59ff92-f76d-4a2d-884a-383e95f0ff3a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:37.942303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:38.006736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ee1c22c4-177c-4fe6-9498-e2e7463dba2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:38.007416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ee1c22c4-177c-4fe6-9498-e2e7463dba2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:38.013812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee1c22c4-177c-4fe6-9498-e2e7463dba2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:38.014289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee1c22c4-177c-4fe6-9498-e2e7463dba2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:38.014722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee1c22c4-177c-4fe6-9498-e2e7463dba2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:38.015398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee1c22c4-177c-4fe6-9498-e2e7463dba2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:38.015842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee1c22c4-177c-4fe6-9498-e2e7463dba2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:38.016255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee1c22c4-177c-4fe6-9498-e2e7463dba2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:38.072079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6a59ff92-f76d-4a2d-884a-383e95f0ff3a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:38.080040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6a59ff92-f76d-4a2d-884a-383e95f0ff3a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153498 Aug 06 12:57:38.080653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1388/2783] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:37 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:38.085322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:38.085919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:38.093876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:38.094357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:38.094786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:38.096829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:38.096829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:38.096829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:38.151758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ee1c22c4-177c-4fe6-9498-e2e7463dba2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:38.159757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ee1c22c4-177c-4fe6-9498-e2e7463dba2a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.156794 Aug 06 12:57:38.160345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1396/2784] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:38 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:38.170017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:38.178544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:38.180051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:38.181255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f95cb1ae-317d-42ff-b696-fbecd1605a45 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.099650 Aug 06 12:57:38.181756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1389/2785] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:38.368750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eaf3abba-63ae-4af7-b9eb-ba613c93fd82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:38.369352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eaf3abba-63ae-4af7-b9eb-ba613c93fd82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:38.375675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf3abba-63ae-4af7-b9eb-ba613c93fd82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:38.376143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf3abba-63ae-4af7-b9eb-ba613c93fd82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:38.376619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf3abba-63ae-4af7-b9eb-ba613c93fd82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:38.377286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf3abba-63ae-4af7-b9eb-ba613c93fd82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:38.377730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf3abba-63ae-4af7-b9eb-ba613c93fd82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:38.378144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaf3abba-63ae-4af7-b9eb-ba613c93fd82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:38.437689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eaf3abba-63ae-4af7-b9eb-ba613c93fd82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:38.446131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eaf3abba-63ae-4af7-b9eb-ba613c93fd82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081277 Aug 06 12:57:38.446691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1397/2786] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:39.102502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-469ab616-ab28-47c0-8d0b-b9c2ce847304 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:39.103222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-469ab616-ab28-47c0-8d0b-b9c2ce847304 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:39.109778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-469ab616-ab28-47c0-8d0b-b9c2ce847304 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:39.110250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-469ab616-ab28-47c0-8d0b-b9c2ce847304 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:39.110674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-469ab616-ab28-47c0-8d0b-b9c2ce847304 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:39.111344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-469ab616-ab28-47c0-8d0b-b9c2ce847304 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:39.111790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-469ab616-ab28-47c0-8d0b-b9c2ce847304 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:39.112206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-469ab616-ab28-47c0-8d0b-b9c2ce847304 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:39.181174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-58f7a242-e4d7-488d-b38c-563385eaa46f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:39.181852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-58f7a242-e4d7-488d-b38c-563385eaa46f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:39.189424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f7a242-e4d7-488d-b38c-563385eaa46f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:39.189899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f7a242-e4d7-488d-b38c-563385eaa46f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:39.190327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f7a242-e4d7-488d-b38c-563385eaa46f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:39.191011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f7a242-e4d7-488d-b38c-563385eaa46f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:39.191458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f7a242-e4d7-488d-b38c-563385eaa46f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:39.191876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58f7a242-e4d7-488d-b38c-563385eaa46f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:39.245655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-469ab616-ab28-47c0-8d0b-b9c2ce847304 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:39.253790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-469ab616-ab28-47c0-8d0b-b9c2ce847304 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155657 Aug 06 12:57:39.254296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1390/2787] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:39 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:39.258663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:39.259293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:39.264876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:39.265348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:39.265784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:39.266474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:39.266927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:39.267349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:39.328072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:39.331043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-58f7a242-e4d7-488d-b38c-563385eaa46f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:39.337142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:39.338688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:39.339514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-58f7a242-e4d7-488d-b38c-563385eaa46f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.162313 Aug 06 12:57:39.339820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f590b494-4bc6-4068-b41a-b9c44f634d7a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084618 Aug 06 12:57:39.340094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1398/2788] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:39 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:39.340388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1391/2789] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:39.466627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-acb44737-036a-4aad-85fa-e08f9469f4dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:39.467226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-acb44737-036a-4aad-85fa-e08f9469f4dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:39.473622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acb44737-036a-4aad-85fa-e08f9469f4dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:39.474093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acb44737-036a-4aad-85fa-e08f9469f4dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:39.474517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acb44737-036a-4aad-85fa-e08f9469f4dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:39.475187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acb44737-036a-4aad-85fa-e08f9469f4dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:39.475634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acb44737-036a-4aad-85fa-e08f9469f4dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:39.476052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acb44737-036a-4aad-85fa-e08f9469f4dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:39.544636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-acb44737-036a-4aad-85fa-e08f9469f4dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:39.552510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-acb44737-036a-4aad-85fa-e08f9469f4dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.089644 Aug 06 12:57:39.553069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1399/2790] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:39 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:40.275642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4fe5803e-2480-46c2-bc68-54c014654f7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:40.276172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4fe5803e-2480-46c2-bc68-54c014654f7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:40.282709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fe5803e-2480-46c2-bc68-54c014654f7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:40.283191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fe5803e-2480-46c2-bc68-54c014654f7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:40.283624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fe5803e-2480-46c2-bc68-54c014654f7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:40.284324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fe5803e-2480-46c2-bc68-54c014654f7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:40.284782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fe5803e-2480-46c2-bc68-54c014654f7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:40.285206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fe5803e-2480-46c2-bc68-54c014654f7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:40.361404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7539e051-2ce7-4175-a8ee-78b3e486fbfc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:40.362037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7539e051-2ce7-4175-a8ee-78b3e486fbfc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:40.368081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7539e051-2ce7-4175-a8ee-78b3e486fbfc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:40.368584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7539e051-2ce7-4175-a8ee-78b3e486fbfc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:40.369010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7539e051-2ce7-4175-a8ee-78b3e486fbfc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:40.369686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7539e051-2ce7-4175-a8ee-78b3e486fbfc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:40.370131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7539e051-2ce7-4175-a8ee-78b3e486fbfc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:40.370549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7539e051-2ce7-4175-a8ee-78b3e486fbfc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:40.414330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4fe5803e-2480-46c2-bc68-54c014654f7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:40.422778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4fe5803e-2480-46c2-bc68-54c014654f7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151401 Aug 06 12:57:40.423840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1392/2791] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:40 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:40.429984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:40.430603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:40.436616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:40.437105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:40.437544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:40.438233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:40.438690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:40.439122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:40.504135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:40.511470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7539e051-2ce7-4175-a8ee-78b3e486fbfc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:40.513046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:40.514525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:40.515654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a2948165-d002-4119-8dcc-3b6bfca1fd89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090636 Aug 06 12:57:40.516209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1393/2792] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:40.519516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7539e051-2ce7-4175-a8ee-78b3e486fbfc tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.162371 Aug 06 12:57:40.520196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1400/2793] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:40 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:40.573796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f3f5803c-50cc-466e-8a68-5c4c666f0fc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:40.574389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f3f5803c-50cc-466e-8a68-5c4c666f0fc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:40.580133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f5803c-50cc-466e-8a68-5c4c666f0fc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:40.580631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f5803c-50cc-466e-8a68-5c4c666f0fc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:40.581060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f5803c-50cc-466e-8a68-5c4c666f0fc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:40.581731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f5803c-50cc-466e-8a68-5c4c666f0fc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:40.582175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f5803c-50cc-466e-8a68-5c4c666f0fc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:40.582591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3f5803c-50cc-466e-8a68-5c4c666f0fc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:40.642579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f3f5803c-50cc-466e-8a68-5c4c666f0fc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:40.650487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f3f5803c-50cc-466e-8a68-5c4c666f0fc4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.080915 Aug 06 12:57:40.651037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1394/2794] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:40 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:41.444738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-66696b35-ffd9-4d34-b6ce-df80b034ec7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:41.445355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-66696b35-ffd9-4d34-b6ce-df80b034ec7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:41.451471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66696b35-ffd9-4d34-b6ce-df80b034ec7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:41.451973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66696b35-ffd9-4d34-b6ce-df80b034ec7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:41.452438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66696b35-ffd9-4d34-b6ce-df80b034ec7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:41.453118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66696b35-ffd9-4d34-b6ce-df80b034ec7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:41.453564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66696b35-ffd9-4d34-b6ce-df80b034ec7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:41.453982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66696b35-ffd9-4d34-b6ce-df80b034ec7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:41.538105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:41.538714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:41.545876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:41.546357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:41.546794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:41.547479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:41.547930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:41.548389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:41.585560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-66696b35-ffd9-4d34-b6ce-df80b034ec7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:41.594062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-66696b35-ffd9-4d34-b6ce-df80b034ec7c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153083 Aug 06 12:57:41.594638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1401/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:41 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:41.599151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d81e614c-5455-42f4-aba7-dacaf4c07e13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:41.599741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d81e614c-5455-42f4-aba7-dacaf4c07e13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:41.606049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81e614c-5455-42f4-aba7-dacaf4c07e13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:41.606528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81e614c-5455-42f4-aba7-dacaf4c07e13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:41.607368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81e614c-5455-42f4-aba7-dacaf4c07e13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:41.607620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81e614c-5455-42f4-aba7-dacaf4c07e13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:41.608341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81e614c-5455-42f4-aba7-dacaf4c07e13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:41.608755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d81e614c-5455-42f4-aba7-dacaf4c07e13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:41.610730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:41.619004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:41.620513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:41.621646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e3d97259-2f0e-4913-829e-0255107ed7fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087708 Aug 06 12:57:41.622383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1395/2796] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:57:41.671139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-12737863-21e7-4075-9f90-2d23cb4984f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:41.671668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-12737863-21e7-4075-9f90-2d23cb4984f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:41.677552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12737863-21e7-4075-9f90-2d23cb4984f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:41.678031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12737863-21e7-4075-9f90-2d23cb4984f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:41.678466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12737863-21e7-4075-9f90-2d23cb4984f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:41.679147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12737863-21e7-4075-9f90-2d23cb4984f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:41.679599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12737863-21e7-4075-9f90-2d23cb4984f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:41.680018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12737863-21e7-4075-9f90-2d23cb4984f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:41.741176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d81e614c-5455-42f4-aba7-dacaf4c07e13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:41.742096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-12737863-21e7-4075-9f90-2d23cb4984f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:41.749280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d81e614c-5455-42f4-aba7-dacaf4c07e13 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153650 Aug 06 12:57:41.749961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1402/2797] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:41 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:41.752773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-12737863-21e7-4075-9f90-2d23cb4984f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085507 Aug 06 12:57:41.754053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1396/2798] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:41 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:42.615335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f0ee00f9-d291-4e0c-bb98-33ec5b763932 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:42.615962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f0ee00f9-d291-4e0c-bb98-33ec5b763932 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:42.622990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ee00f9-d291-4e0c-bb98-33ec5b763932 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:42.623474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ee00f9-d291-4e0c-bb98-33ec5b763932 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:42.623962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ee00f9-d291-4e0c-bb98-33ec5b763932 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:42.624670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ee00f9-d291-4e0c-bb98-33ec5b763932 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:42.625120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ee00f9-d291-4e0c-bb98-33ec5b763932 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:42.625540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0ee00f9-d291-4e0c-bb98-33ec5b763932 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:42.628089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:42.644393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:42.645016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:42.652462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:42.652937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:42.653363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:42.654042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:42.654486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:42.654901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:42.721787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:42.733952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:42.736459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:42.738226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b44f24d5-9bb8-49ae-926c-03101ad1f226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.097480 Aug 06 12:57:42.739060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1397/2799] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:42 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:57:42.765834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0ee00f9-d291-4e0c-bb98-33ec5b763932 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:42.770882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-92a402c6-05a6-4c3c-adbc-1d9ce46d1eac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:42.771494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-92a402c6-05a6-4c3c-adbc-1d9ce46d1eac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:42.774418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f0ee00f9-d291-4e0c-bb98-33ec5b763932 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.162888 Aug 06 12:57:42.774987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1403/2800] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:42 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:42.778043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a402c6-05a6-4c3c-adbc-1d9ce46d1eac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:42.778524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a402c6-05a6-4c3c-adbc-1d9ce46d1eac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:42.778956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a402c6-05a6-4c3c-adbc-1d9ce46d1eac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:42.779382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27dffc10-20b3-480d-b9d9-2295a4de357a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:42.779633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a402c6-05a6-4c3c-adbc-1d9ce46d1eac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:42.779984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-27dffc10-20b3-480d-b9d9-2295a4de357a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:42.780104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a402c6-05a6-4c3c-adbc-1d9ce46d1eac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:42.780524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a402c6-05a6-4c3c-adbc-1d9ce46d1eac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:42.785587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dffc10-20b3-480d-b9d9-2295a4de357a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:42.786062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dffc10-20b3-480d-b9d9-2295a4de357a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:42.786522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dffc10-20b3-480d-b9d9-2295a4de357a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:42.787204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dffc10-20b3-480d-b9d9-2295a4de357a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:42.787654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dffc10-20b3-480d-b9d9-2295a4de357a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:42.788080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dffc10-20b3-480d-b9d9-2295a4de357a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:42.851253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-27dffc10-20b3-480d-b9d9-2295a4de357a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:42.860242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-27dffc10-20b3-480d-b9d9-2295a4de357a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084300 Aug 06 12:57:42.860837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1404/2801] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:42 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:42.906575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-92a402c6-05a6-4c3c-adbc-1d9ce46d1eac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:42.915063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-92a402c6-05a6-4c3c-adbc-1d9ce46d1eac tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147255 Aug 06 12:57:42.915622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1398/2802] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:42 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:43.762343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:43.762867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:43.769304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:43.769770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:43.770205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:43.770882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:43.771340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:43.771762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:43.795726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f8deb556-43be-4e76-9d49-1862c25706b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:43.796362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f8deb556-43be-4e76-9d49-1862c25706b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:43.802726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8deb556-43be-4e76-9d49-1862c25706b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:43.803209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8deb556-43be-4e76-9d49-1862c25706b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:43.803644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8deb556-43be-4e76-9d49-1862c25706b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:43.804348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8deb556-43be-4e76-9d49-1862c25706b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:43.804802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8deb556-43be-4e76-9d49-1862c25706b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:43.805226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8deb556-43be-4e76-9d49-1862c25706b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:43.832588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:43.841475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:43.842968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:43.844202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-387daf37-6bcf-49fb-af82-440232399d5a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085761 Aug 06 12:57:43.844679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1405/2803] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:43.880409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5a55e86c-fa27-4084-8619-43d38a0d5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:43.881037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5a55e86c-fa27-4084-8619-43d38a0d5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:43.887461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a55e86c-fa27-4084-8619-43d38a0d5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:43.887945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a55e86c-fa27-4084-8619-43d38a0d5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:43.888401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a55e86c-fa27-4084-8619-43d38a0d5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:43.889091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a55e86c-fa27-4084-8619-43d38a0d5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:43.889530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a55e86c-fa27-4084-8619-43d38a0d5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:43.889945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a55e86c-fa27-4084-8619-43d38a0d5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:43.939020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f8deb556-43be-4e76-9d49-1862c25706b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:43.947421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f8deb556-43be-4e76-9d49-1862c25706b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155688 Aug 06 12:57:43.947985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1399/2804] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:43 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:43.953584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b584fcff-1b05-4bd9-a09f-57cbde453e81 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:43.953584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b584fcff-1b05-4bd9-a09f-57cbde453e81 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:43.958998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b584fcff-1b05-4bd9-a09f-57cbde453e81 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:43.959163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5a55e86c-fa27-4084-8619-43d38a0d5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:43.959479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b584fcff-1b05-4bd9-a09f-57cbde453e81 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:43.959903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b584fcff-1b05-4bd9-a09f-57cbde453e81 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:43.960602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b584fcff-1b05-4bd9-a09f-57cbde453e81 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:43.961617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b584fcff-1b05-4bd9-a09f-57cbde453e81 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:43.962034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b584fcff-1b05-4bd9-a09f-57cbde453e81 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:43.973579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5a55e86c-fa27-4084-8619-43d38a0d5925 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.096947 Aug 06 12:57:43.974153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1406/2805] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:44.088849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b584fcff-1b05-4bd9-a09f-57cbde453e81 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:44.096679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b584fcff-1b05-4bd9-a09f-57cbde453e81 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147712 Aug 06 12:57:44.097245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1400/2806] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:43 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:44.868383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:44.868969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:44.874808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:44.875286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:44.875718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:44.876421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:44.876877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:44.877297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:44.937476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:44.945837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:44.947326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:44.948469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b514b7cb-d793-4173-819e-2d2535840fc8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085180 Aug 06 12:57:44.949025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1407/2807] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:44.977364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6f77c2e4-480d-4a31-ba13-92977ae2d067 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:44.977961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6f77c2e4-480d-4a31-ba13-92977ae2d067 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:44.984570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f77c2e4-480d-4a31-ba13-92977ae2d067 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:44.985039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f77c2e4-480d-4a31-ba13-92977ae2d067 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:44.985464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f77c2e4-480d-4a31-ba13-92977ae2d067 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:44.986135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f77c2e4-480d-4a31-ba13-92977ae2d067 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:44.986580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f77c2e4-480d-4a31-ba13-92977ae2d067 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:44.987020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f77c2e4-480d-4a31-ba13-92977ae2d067 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:44.994505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98c15f17-5c40-4281-8201-9368091b0791 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:44.995109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-98c15f17-5c40-4281-8201-9368091b0791 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:45.001220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98c15f17-5c40-4281-8201-9368091b0791 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:45.001700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98c15f17-5c40-4281-8201-9368091b0791 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:45.002132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98c15f17-5c40-4281-8201-9368091b0791 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:45.002871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98c15f17-5c40-4281-8201-9368091b0791 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:45.003325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98c15f17-5c40-4281-8201-9368091b0791 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:45.003744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98c15f17-5c40-4281-8201-9368091b0791 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:45.066927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98c15f17-5c40-4281-8201-9368091b0791 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:45.075115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98c15f17-5c40-4281-8201-9368091b0791 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084796 Aug 06 12:57:45.075692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1408/2808] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:45.115090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6f77c2e4-480d-4a31-ba13-92977ae2d067 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:45.117747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0c40dc45-13af-4b9b-99ee-a262143412f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:45.118605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0c40dc45-13af-4b9b-99ee-a262143412f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:45.123289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6f77c2e4-480d-4a31-ba13-92977ae2d067 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150298 Aug 06 12:57:45.123854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1401/2809] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:44 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:45.124245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c40dc45-13af-4b9b-99ee-a262143412f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:45.124824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c40dc45-13af-4b9b-99ee-a262143412f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:45.125258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c40dc45-13af-4b9b-99ee-a262143412f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:45.125939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c40dc45-13af-4b9b-99ee-a262143412f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:45.126393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c40dc45-13af-4b9b-99ee-a262143412f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:45.126813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c40dc45-13af-4b9b-99ee-a262143412f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:45.253587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0c40dc45-13af-4b9b-99ee-a262143412f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:45.261387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0c40dc45-13af-4b9b-99ee-a262143412f3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147389 Aug 06 12:57:45.261938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1409/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:45 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:45.971008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:45.971619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:45.978278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:45.978853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:45.979181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:45.979863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:45.980332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:45.980761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:46.045027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:46.053587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:46.055153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:46.056342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-58a82e11-701e-45a7-9fb6-208bd5fb2727 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089229 Aug 06 12:57:46.056906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1402/2811] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:46.096552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a835344-5f1b-4df3-b14e-acba096867ab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:46.097157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6a835344-5f1b-4df3-b14e-acba096867ab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:46.103823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a835344-5f1b-4df3-b14e-acba096867ab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:46.104313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a835344-5f1b-4df3-b14e-acba096867ab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:46.104757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a835344-5f1b-4df3-b14e-acba096867ab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:46.105434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a835344-5f1b-4df3-b14e-acba096867ab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:46.105883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a835344-5f1b-4df3-b14e-acba096867ab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:46.106306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a835344-5f1b-4df3-b14e-acba096867ab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:46.144150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ab2d4a43-fe2d-4ad4-9e3d-b997d4b18f06 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:46.144785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ab2d4a43-fe2d-4ad4-9e3d-b997d4b18f06 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:46.151474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2d4a43-fe2d-4ad4-9e3d-b997d4b18f06 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:46.151952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2d4a43-fe2d-4ad4-9e3d-b997d4b18f06 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:46.152402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2d4a43-fe2d-4ad4-9e3d-b997d4b18f06 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:46.153084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2d4a43-fe2d-4ad4-9e3d-b997d4b18f06 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:46.153529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2d4a43-fe2d-4ad4-9e3d-b997d4b18f06 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:46.153945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2d4a43-fe2d-4ad4-9e3d-b997d4b18f06 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:46.167343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6a835344-5f1b-4df3-b14e-acba096867ab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:46.175233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6a835344-5f1b-4df3-b14e-acba096867ab tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082518 Aug 06 12:57:46.175790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1410/2812] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:46.278451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ab2d4a43-fe2d-4ad4-9e3d-b997d4b18f06 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:46.282812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f9faaf84-ea27-438f-95f0-a6c049db45a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:46.283409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f9faaf84-ea27-438f-95f0-a6c049db45a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:46.286307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ab2d4a43-fe2d-4ad4-9e3d-b997d4b18f06 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145884 Aug 06 12:57:46.286871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1403/2813] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:46 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:46.289284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9faaf84-ea27-438f-95f0-a6c049db45a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:46.289752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9faaf84-ea27-438f-95f0-a6c049db45a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:46.290811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9faaf84-ea27-438f-95f0-a6c049db45a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:46.291496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9faaf84-ea27-438f-95f0-a6c049db45a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:46.291940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9faaf84-ea27-438f-95f0-a6c049db45a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:46.292380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9faaf84-ea27-438f-95f0-a6c049db45a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:46.420294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f9faaf84-ea27-438f-95f0-a6c049db45a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:46.428046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f9faaf84-ea27-438f-95f0-a6c049db45a0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148968 Aug 06 12:57:46.428639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1411/2814] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:46 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:47.078514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:47.079120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:47.085446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:47.085924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:47.086358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:47.087104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:47.087556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:47.087977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:47.149598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:47.151755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:47.159442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:47.160981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:47.162119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7caf0bfa-288c-4844-b848-55815dafd084 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087474 Aug 06 12:57:47.162677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1404/2815] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:47.195939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1e38903b-c603-42e5-b064-87be81b2ec2c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:47.196564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1e38903b-c603-42e5-b064-87be81b2ec2c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:47.203038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e38903b-c603-42e5-b064-87be81b2ec2c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:47.203518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e38903b-c603-42e5-b064-87be81b2ec2c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:47.203947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e38903b-c603-42e5-b064-87be81b2ec2c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:47.204660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e38903b-c603-42e5-b064-87be81b2ec2c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:47.205109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e38903b-c603-42e5-b064-87be81b2ec2c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:47.205536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e38903b-c603-42e5-b064-87be81b2ec2c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:47.307034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-937bd1d9-2b7a-4960-844d-6572959f2a3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:47.307639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-937bd1d9-2b7a-4960-844d-6572959f2a3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:47.313650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-937bd1d9-2b7a-4960-844d-6572959f2a3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:47.314140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-937bd1d9-2b7a-4960-844d-6572959f2a3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:47.314573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-937bd1d9-2b7a-4960-844d-6572959f2a3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:47.315262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-937bd1d9-2b7a-4960-844d-6572959f2a3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:47.315745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-937bd1d9-2b7a-4960-844d-6572959f2a3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:47.316167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-937bd1d9-2b7a-4960-844d-6572959f2a3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:47.332913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e38903b-c603-42e5-b064-87be81b2ec2c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:47.341167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1e38903b-c603-42e5-b064-87be81b2ec2c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.149004 Aug 06 12:57:47.341729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1412/2816] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:47.447466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-937bd1d9-2b7a-4960-844d-6572959f2a3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:47.449287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-57d3381b-906f-45d6-8fca-3b7a3951bfda tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:47.449894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-57d3381b-906f-45d6-8fca-3b7a3951bfda tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:47.455476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-937bd1d9-2b7a-4960-844d-6572959f2a3f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152220 Aug 06 12:57:47.455640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57d3381b-906f-45d6-8fca-3b7a3951bfda tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:47.456040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1405/2817] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:47 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:47.456187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57d3381b-906f-45d6-8fca-3b7a3951bfda tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:47.456543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57d3381b-906f-45d6-8fca-3b7a3951bfda tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:47.457222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57d3381b-906f-45d6-8fca-3b7a3951bfda tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:47.457667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57d3381b-906f-45d6-8fca-3b7a3951bfda tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:47.458086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-57d3381b-906f-45d6-8fca-3b7a3951bfda tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:47.582008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-57d3381b-906f-45d6-8fca-3b7a3951bfda tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:47.590369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-57d3381b-906f-45d6-8fca-3b7a3951bfda tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145231 Aug 06 12:57:47.590920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1413/2818] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:47 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:48.185367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:48.185974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:48.192402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:48.192883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:48.193320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:48.194001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:48.194453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:48.194878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:48.301388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:48.310212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:48.311702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:48.312852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-88d91675-6a59-47ad-b519-85ec9e6db35c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.131367 Aug 06 12:57:48.313411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1406/2819] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:48.363055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5a1f47b3-0296-4b43-83d5-6dd8bca8e478 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:48.363650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5a1f47b3-0296-4b43-83d5-6dd8bca8e478 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:48.370600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1f47b3-0296-4b43-83d5-6dd8bca8e478 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:48.371072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1f47b3-0296-4b43-83d5-6dd8bca8e478 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:48.371492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1f47b3-0296-4b43-83d5-6dd8bca8e478 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:48.372291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1f47b3-0296-4b43-83d5-6dd8bca8e478 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:48.372797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1f47b3-0296-4b43-83d5-6dd8bca8e478 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:48.373231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1f47b3-0296-4b43-83d5-6dd8bca8e478 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:48.433597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5a1f47b3-0296-4b43-83d5-6dd8bca8e478 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:48.441342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5a1f47b3-0296-4b43-83d5-6dd8bca8e478 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082066 Aug 06 12:57:48.441927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1414/2820] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:48.477385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-97f6bfc3-bd9c-4e3d-95dc-3269645b0767 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:48.477987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-97f6bfc3-bd9c-4e3d-95dc-3269645b0767 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:48.484075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97f6bfc3-bd9c-4e3d-95dc-3269645b0767 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:48.484579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97f6bfc3-bd9c-4e3d-95dc-3269645b0767 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:48.485015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97f6bfc3-bd9c-4e3d-95dc-3269645b0767 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:48.485693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97f6bfc3-bd9c-4e3d-95dc-3269645b0767 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:48.486143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97f6bfc3-bd9c-4e3d-95dc-3269645b0767 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:48.486563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97f6bfc3-bd9c-4e3d-95dc-3269645b0767 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:48.612123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e514a36b-687d-48e3-9c43-6b955e404543 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:48.612750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e514a36b-687d-48e3-9c43-6b955e404543 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:48.613131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-97f6bfc3-bd9c-4e3d-95dc-3269645b0767 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:48.619255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e514a36b-687d-48e3-9c43-6b955e404543 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:48.619734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e514a36b-687d-48e3-9c43-6b955e404543 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:48.620166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e514a36b-687d-48e3-9c43-6b955e404543 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:48.620956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e514a36b-687d-48e3-9c43-6b955e404543 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:48.621402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e514a36b-687d-48e3-9c43-6b955e404543 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:48.621546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-97f6bfc3-bd9c-4e3d-95dc-3269645b0767 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148281 Aug 06 12:57:48.621824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e514a36b-687d-48e3-9c43-6b955e404543 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:48.621958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1407/2821] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:48 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:48.751425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e514a36b-687d-48e3-9c43-6b955e404543 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:48.759424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e514a36b-687d-48e3-9c43-6b955e404543 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151475 Aug 06 12:57:48.759984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1415/2822] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:48 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:49.336616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:49.337217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:49.343528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:49.343998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:49.344482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:49.345153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:49.345597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:49.346015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:49.408732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:49.417035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:49.418604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:49.419721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5891dda-014b-4319-a783-d94bc97195fb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087636 Aug 06 12:57:49.420266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1408/2823] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:49 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:49.462267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b02f7242-10f9-45ea-8205-e8840838776c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:49.462876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b02f7242-10f9-45ea-8205-e8840838776c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:49.469215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b02f7242-10f9-45ea-8205-e8840838776c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:49.469693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b02f7242-10f9-45ea-8205-e8840838776c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:49.470124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b02f7242-10f9-45ea-8205-e8840838776c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:49.470805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b02f7242-10f9-45ea-8205-e8840838776c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:49.471253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b02f7242-10f9-45ea-8205-e8840838776c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:49.471675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b02f7242-10f9-45ea-8205-e8840838776c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:49.532451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b02f7242-10f9-45ea-8205-e8840838776c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:49.540251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b02f7242-10f9-45ea-8205-e8840838776c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082403 Aug 06 12:57:49.540853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1416/2824] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:49 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:49.642308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4b364e5d-0c72-40f8-8324-6c5690bcaddf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:49.642844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4b364e5d-0c72-40f8-8324-6c5690bcaddf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:49.648623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b364e5d-0c72-40f8-8324-6c5690bcaddf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:49.649099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b364e5d-0c72-40f8-8324-6c5690bcaddf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:49.649527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b364e5d-0c72-40f8-8324-6c5690bcaddf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:49.650200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b364e5d-0c72-40f8-8324-6c5690bcaddf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:49.650648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b364e5d-0c72-40f8-8324-6c5690bcaddf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:49.651066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b364e5d-0c72-40f8-8324-6c5690bcaddf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:49.780765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7e8dd10f-22b4-4b87-825f-7b7c55b1e9b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:49.781374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7e8dd10f-22b4-4b87-825f-7b7c55b1e9b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:49.787594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e8dd10f-22b4-4b87-825f-7b7c55b1e9b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:49.788081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e8dd10f-22b4-4b87-825f-7b7c55b1e9b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:49.788542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e8dd10f-22b4-4b87-825f-7b7c55b1e9b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:49.789243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e8dd10f-22b4-4b87-825f-7b7c55b1e9b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:49.789695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e8dd10f-22b4-4b87-825f-7b7c55b1e9b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:49.790119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7e8dd10f-22b4-4b87-825f-7b7c55b1e9b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:49.929093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7e8dd10f-22b4-4b87-825f-7b7c55b1e9b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:49.938035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7e8dd10f-22b4-4b87-825f-7b7c55b1e9b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.161273 Aug 06 12:57:49.938621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1417/2825] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:49 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:50.028800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4b364e5d-0c72-40f8-8324-6c5690bcaddf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:50.036538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4b364e5d-0c72-40f8-8324-6c5690bcaddf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.398082 Aug 06 12:57:50.037103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1409/2826] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:49 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:50.442602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:50.443194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:50.449099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:50.449569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:50.450013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:50.450678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:50.451118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:50.451527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:50.512786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:50.521031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:50.522509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:50.524114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1eb07ea7-f2ad-46cc-9a23-5a38018d19d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085412 Aug 06 12:57:50.524685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1418/2827] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:50 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:50.560844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c3b4ffe6-8f7c-45d5-b120-e7e481757adb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:50.561450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c3b4ffe6-8f7c-45d5-b120-e7e481757adb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:50.567898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3b4ffe6-8f7c-45d5-b120-e7e481757adb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:50.568408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3b4ffe6-8f7c-45d5-b120-e7e481757adb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:50.568845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3b4ffe6-8f7c-45d5-b120-e7e481757adb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:50.569525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3b4ffe6-8f7c-45d5-b120-e7e481757adb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:50.569978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3b4ffe6-8f7c-45d5-b120-e7e481757adb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:50.570418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3b4ffe6-8f7c-45d5-b120-e7e481757adb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:50.630687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c3b4ffe6-8f7c-45d5-b120-e7e481757adb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:50.638986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c3b4ffe6-8f7c-45d5-b120-e7e481757adb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081888 Aug 06 12:57:50.639552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1410/2828] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:50 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:50.958898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a42eeaa5-4686-491d-b122-2f52b08017a1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:50.959507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a42eeaa5-4686-491d-b122-2f52b08017a1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:50.966151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a42eeaa5-4686-491d-b122-2f52b08017a1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:50.966630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a42eeaa5-4686-491d-b122-2f52b08017a1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:50.967066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a42eeaa5-4686-491d-b122-2f52b08017a1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:50.967747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a42eeaa5-4686-491d-b122-2f52b08017a1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:50.968198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a42eeaa5-4686-491d-b122-2f52b08017a1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:50.968649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a42eeaa5-4686-491d-b122-2f52b08017a1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:51.059900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2f05fab1-c816-4df6-a8c3-cb9417b2baf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:51.060695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2f05fab1-c816-4df6-a8c3-cb9417b2baf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:51.066613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f05fab1-c816-4df6-a8c3-cb9417b2baf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:51.067175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f05fab1-c816-4df6-a8c3-cb9417b2baf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:51.067709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f05fab1-c816-4df6-a8c3-cb9417b2baf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:51.068503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f05fab1-c816-4df6-a8c3-cb9417b2baf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:51.069032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f05fab1-c816-4df6-a8c3-cb9417b2baf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:51.069533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f05fab1-c816-4df6-a8c3-cb9417b2baf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:51.094840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a42eeaa5-4686-491d-b122-2f52b08017a1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:51.097177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:51.104288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a42eeaa5-4686-491d-b122-2f52b08017a1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149167 Aug 06 12:57:51.105061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1419/2829] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:50 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:51.198256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2f05fab1-c816-4df6-a8c3-cb9417b2baf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:51.206074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2f05fab1-c816-4df6-a8c3-cb9417b2baf7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150019 Aug 06 12:57:51.206634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1411/2830] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:51 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:51.546228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:51.546858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:51.553151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:51.553627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:51.554082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:51.555379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:51.555823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:51.556240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:51.615704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:51.624564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:51.626045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:51.627168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6e1f0086-b07a-4ece-a979-25d946941b29 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085030 Aug 06 12:57:51.627722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1420/2831] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:51 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:51.661043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a512678b-4b30-4c64-bbc4-2961f97cc032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:51.661590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a512678b-4b30-4c64-bbc4-2961f97cc032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:51.664421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:51.669774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a512678b-4b30-4c64-bbc4-2961f97cc032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:51.670263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a512678b-4b30-4c64-bbc4-2961f97cc032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:51.670701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a512678b-4b30-4c64-bbc4-2961f97cc032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:51.671521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a512678b-4b30-4c64-bbc4-2961f97cc032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:51.672060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a512678b-4b30-4c64-bbc4-2961f97cc032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:51.672592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a512678b-4b30-4c64-bbc4-2961f97cc032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:51.734253 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a512678b-4b30-4c64-bbc4-2961f97cc032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:51.742192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a512678b-4b30-4c64-bbc4-2961f97cc032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.086387 Aug 06 12:57:51.742761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1412/2832] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:51 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:52.126387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-073761d4-8f83-4346-a477-f63c26105a17 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:52.126992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-073761d4-8f83-4346-a477-f63c26105a17 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:52.133388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-073761d4-8f83-4346-a477-f63c26105a17 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:52.133859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-073761d4-8f83-4346-a477-f63c26105a17 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:52.134283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-073761d4-8f83-4346-a477-f63c26105a17 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:52.134980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-073761d4-8f83-4346-a477-f63c26105a17 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:52.135422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-073761d4-8f83-4346-a477-f63c26105a17 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:52.135845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-073761d4-8f83-4346-a477-f63c26105a17 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:52.227035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-800cc70d-21d4-481c-8cda-6d211d0ba637 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:52.227761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-800cc70d-21d4-481c-8cda-6d211d0ba637 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:52.233978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-800cc70d-21d4-481c-8cda-6d211d0ba637 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:52.234539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-800cc70d-21d4-481c-8cda-6d211d0ba637 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:52.234987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-800cc70d-21d4-481c-8cda-6d211d0ba637 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:52.235678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-800cc70d-21d4-481c-8cda-6d211d0ba637 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:52.236134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-800cc70d-21d4-481c-8cda-6d211d0ba637 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:52.236593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-800cc70d-21d4-481c-8cda-6d211d0ba637 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:52.265423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-073761d4-8f83-4346-a477-f63c26105a17 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:52.273904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-073761d4-8f83-4346-a477-f63c26105a17 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150719 Aug 06 12:57:52.274467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1421/2833] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:52 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:52.361904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-800cc70d-21d4-481c-8cda-6d211d0ba637 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:52.369744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-800cc70d-21d4-481c-8cda-6d211d0ba637 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146588 Aug 06 12:57:52.370303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1413/2834] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:52 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:52.649115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:52.649819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:52.652070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:52.657638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:52.658110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:52.658536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:52.659203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:52.659646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:52.660058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:52.719955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:52.728112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:52.729624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:52.730733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98fe3df6-7d79-4d94-9f7c-6563391cd13f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085530 Aug 06 12:57:52.731280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1422/2835] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:52 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:52.763514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-36899bd7-351c-450a-b447-ef05bfdfce1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:52.764113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-36899bd7-351c-450a-b447-ef05bfdfce1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:52.770434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36899bd7-351c-450a-b447-ef05bfdfce1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:52.770906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36899bd7-351c-450a-b447-ef05bfdfce1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:52.771332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36899bd7-351c-450a-b447-ef05bfdfce1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:52.772004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36899bd7-351c-450a-b447-ef05bfdfce1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:52.772540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36899bd7-351c-450a-b447-ef05bfdfce1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:52.772961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36899bd7-351c-450a-b447-ef05bfdfce1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:52.835714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-36899bd7-351c-450a-b447-ef05bfdfce1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:52.843524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-36899bd7-351c-450a-b447-ef05bfdfce1a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083853 Aug 06 12:57:52.844079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1414/2836] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:52 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:53.296270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-707ba10c-3d84-48ce-829c-ccc8e4862360 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:53.296899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-707ba10c-3d84-48ce-829c-ccc8e4862360 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:53.302712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-707ba10c-3d84-48ce-829c-ccc8e4862360 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:53.303184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-707ba10c-3d84-48ce-829c-ccc8e4862360 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:53.303607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-707ba10c-3d84-48ce-829c-ccc8e4862360 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:53.304347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-707ba10c-3d84-48ce-829c-ccc8e4862360 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:53.304796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-707ba10c-3d84-48ce-829c-ccc8e4862360 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:53.305208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-707ba10c-3d84-48ce-829c-ccc8e4862360 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:53.390939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-01faffb8-72e3-4b34-b8db-4da88e374f70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:53.391623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-01faffb8-72e3-4b34-b8db-4da88e374f70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:53.397563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01faffb8-72e3-4b34-b8db-4da88e374f70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:53.398639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01faffb8-72e3-4b34-b8db-4da88e374f70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:53.399130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01faffb8-72e3-4b34-b8db-4da88e374f70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:53.399813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01faffb8-72e3-4b34-b8db-4da88e374f70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:53.400258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01faffb8-72e3-4b34-b8db-4da88e374f70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:53.400705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01faffb8-72e3-4b34-b8db-4da88e374f70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:53.436462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-707ba10c-3d84-48ce-829c-ccc8e4862360 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:53.444247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-707ba10c-3d84-48ce-829c-ccc8e4862360 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153033 Aug 06 12:57:53.444873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1423/2837] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:53 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:53.532479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-01faffb8-72e3-4b34-b8db-4da88e374f70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:53.541044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-01faffb8-72e3-4b34-b8db-4da88e374f70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153890 Aug 06 12:57:53.541605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1415/2838] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:53 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:53.753837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:53.754355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:53.761084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:53.761551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:53.761974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:53.762670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:53.763112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:53.763525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:53.825625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:53.834109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:53.836270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:53.837424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-34fd85c4-c0dd-4898-9417-0683edea156d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087533 Aug 06 12:57:53.837981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1424/2839] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:53 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:53.864569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ec5f69e3-23d5-46fe-8dc7-102b6f0dbfe3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:53.865175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ec5f69e3-23d5-46fe-8dc7-102b6f0dbfe3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:53.871588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5f69e3-23d5-46fe-8dc7-102b6f0dbfe3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:53.872060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5f69e3-23d5-46fe-8dc7-102b6f0dbfe3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:53.872523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5f69e3-23d5-46fe-8dc7-102b6f0dbfe3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:53.873198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5f69e3-23d5-46fe-8dc7-102b6f0dbfe3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:53.873648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5f69e3-23d5-46fe-8dc7-102b6f0dbfe3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:53.874067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5f69e3-23d5-46fe-8dc7-102b6f0dbfe3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:53.933805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ec5f69e3-23d5-46fe-8dc7-102b6f0dbfe3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:53.941619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ec5f69e3-23d5-46fe-8dc7-102b6f0dbfe3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.080807 Aug 06 12:57:53.942177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1416/2840] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:53 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:54.465728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4629e7f9-50c9-4a87-bf19-c5bd93f5ed4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:54.466322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4629e7f9-50c9-4a87-bf19-c5bd93f5ed4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:54.472254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4629e7f9-50c9-4a87-bf19-c5bd93f5ed4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:54.472749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4629e7f9-50c9-4a87-bf19-c5bd93f5ed4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:54.473172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4629e7f9-50c9-4a87-bf19-c5bd93f5ed4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:54.473836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4629e7f9-50c9-4a87-bf19-c5bd93f5ed4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:54.474279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4629e7f9-50c9-4a87-bf19-c5bd93f5ed4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:54.474692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4629e7f9-50c9-4a87-bf19-c5bd93f5ed4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:54.562064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-052971cd-428f-402c-bcfc-82dfec5c6df7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:54.562674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-052971cd-428f-402c-bcfc-82dfec5c6df7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:54.568543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-052971cd-428f-402c-bcfc-82dfec5c6df7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:54.569029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-052971cd-428f-402c-bcfc-82dfec5c6df7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:54.569465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-052971cd-428f-402c-bcfc-82dfec5c6df7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:54.570154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-052971cd-428f-402c-bcfc-82dfec5c6df7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:54.570613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-052971cd-428f-402c-bcfc-82dfec5c6df7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:54.571039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-052971cd-428f-402c-bcfc-82dfec5c6df7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:54.601690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4629e7f9-50c9-4a87-bf19-c5bd93f5ed4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:54.609935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4629e7f9-50c9-4a87-bf19-c5bd93f5ed4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148014 Aug 06 12:57:54.610586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1425/2841] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:54 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:54.698375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-052971cd-428f-402c-bcfc-82dfec5c6df7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:54.706297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-052971cd-428f-402c-bcfc-82dfec5c6df7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148070 Aug 06 12:57:54.706861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1417/2842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:54 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:54.859909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:54.860285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:54.866289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:54.866796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:54.867310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:54.868001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:54.868482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:54.868897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:54.929400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:54.937685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:54.939175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:54.940321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9785b20f-9593-44b8-9f5e-f9181f43a46f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085119 Aug 06 12:57:54.940874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1426/2843] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:54 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:54.962762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8b6f43b5-4137-4bc9-8e05-932533446232 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:54.963350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8b6f43b5-4137-4bc9-8e05-932533446232 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:54.969681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b6f43b5-4137-4bc9-8e05-932533446232 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:54.970157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b6f43b5-4137-4bc9-8e05-932533446232 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:54.970587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b6f43b5-4137-4bc9-8e05-932533446232 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:54.971265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b6f43b5-4137-4bc9-8e05-932533446232 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:54.971714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b6f43b5-4137-4bc9-8e05-932533446232 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:54.972137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b6f43b5-4137-4bc9-8e05-932533446232 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:55.033011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b6f43b5-4137-4bc9-8e05-932533446232 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:55.041453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8b6f43b5-4137-4bc9-8e05-932533446232 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082982 Aug 06 12:57:55.042035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1418/2844] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:54 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:55.631116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-be31be18-ff48-4718-891b-1e5bdd348d6e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:55.631721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-be31be18-ff48-4718-891b-1e5bdd348d6e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:55.638244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be31be18-ff48-4718-891b-1e5bdd348d6e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:55.638721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be31be18-ff48-4718-891b-1e5bdd348d6e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:55.639151 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be31be18-ff48-4718-891b-1e5bdd348d6e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:55.639825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be31be18-ff48-4718-891b-1e5bdd348d6e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:55.640272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be31be18-ff48-4718-891b-1e5bdd348d6e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:55.640716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be31be18-ff48-4718-891b-1e5bdd348d6e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:55.728070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5f0e8f9-ec37-49a1-ad21-9fcac2fe392e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:55.728784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5f0e8f9-ec37-49a1-ad21-9fcac2fe392e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:55.735113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f0e8f9-ec37-49a1-ad21-9fcac2fe392e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:55.735697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f0e8f9-ec37-49a1-ad21-9fcac2fe392e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:55.736207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f0e8f9-ec37-49a1-ad21-9fcac2fe392e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:55.736991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f0e8f9-ec37-49a1-ad21-9fcac2fe392e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:55.737521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f0e8f9-ec37-49a1-ad21-9fcac2fe392e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:55.738014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f0e8f9-ec37-49a1-ad21-9fcac2fe392e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:55.789840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-be31be18-ff48-4718-891b-1e5bdd348d6e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:55.797833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-be31be18-ff48-4718-891b-1e5bdd348d6e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.170534 Aug 06 12:57:55.798391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1427/2845] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:55 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:55.867476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5f0e8f9-ec37-49a1-ad21-9fcac2fe392e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:55.875273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5f0e8f9-ec37-49a1-ad21-9fcac2fe392e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151208 Aug 06 12:57:55.875824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1419/2846] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:55 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:55.962410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:55.963008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:55.969428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:55.969932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:55.970362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:55.971039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:55.971481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:55.971895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:56.035510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:56.044262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:56.045758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:56.046863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-be8342b3-1e63-4182-a067-365102ba0076 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088332 Aug 06 12:57:56.047431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1428/2847] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:55 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:57:56.061223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-839a61f8-644b-4c38-aa76-f204e6941faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:56.061842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-839a61f8-644b-4c38-aa76-f204e6941faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:56.068869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839a61f8-644b-4c38-aa76-f204e6941faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:56.069349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839a61f8-644b-4c38-aa76-f204e6941faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:56.069784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839a61f8-644b-4c38-aa76-f204e6941faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:56.070466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839a61f8-644b-4c38-aa76-f204e6941faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:56.070919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839a61f8-644b-4c38-aa76-f204e6941faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:56.071344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-839a61f8-644b-4c38-aa76-f204e6941faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:56.134429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-839a61f8-644b-4c38-aa76-f204e6941faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:56.142200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-839a61f8-644b-4c38-aa76-f204e6941faf tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084824 Aug 06 12:57:56.142759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1420/2848] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:56 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:56.820319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fb985880-d941-4321-8288-079f8f5aa9e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:56.820917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fb985880-d941-4321-8288-079f8f5aa9e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:56.826855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb985880-d941-4321-8288-079f8f5aa9e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:56.827326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb985880-d941-4321-8288-079f8f5aa9e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:56.827748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb985880-d941-4321-8288-079f8f5aa9e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:56.828449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb985880-d941-4321-8288-079f8f5aa9e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:56.828895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb985880-d941-4321-8288-079f8f5aa9e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:56.829308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fb985880-d941-4321-8288-079f8f5aa9e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:56.896261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1ad02915-105b-43f4-abbb-1c673263a0dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:56.896922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1ad02915-105b-43f4-abbb-1c673263a0dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:56.903335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ad02915-105b-43f4-abbb-1c673263a0dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:56.903816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ad02915-105b-43f4-abbb-1c673263a0dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:56.904254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ad02915-105b-43f4-abbb-1c673263a0dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:56.905449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ad02915-105b-43f4-abbb-1c673263a0dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:56.905449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ad02915-105b-43f4-abbb-1c673263a0dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:56.905809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ad02915-105b-43f4-abbb-1c673263a0dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:56.920329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:57:56.960376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fb985880-d941-4321-8288-079f8f5aa9e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:56.969585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fb985880-d941-4321-8288-079f8f5aa9e1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153389 Aug 06 12:57:56.970661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1429/2849] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:56 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:57.034099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1ad02915-105b-43f4-abbb-1c673263a0dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:57.042611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1ad02915-105b-43f4-abbb-1c673263a0dd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150239 Aug 06 12:57:57.043170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1421/2850] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:56 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:57.073017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:57.073550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:57.079518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:57.079999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:57.080466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:57.081147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:57.081593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:57.082013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:57.143338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:57.152142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:57.153668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:57.154792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e8dfb9e6-bf76-4fc0-b649-bb733f444e0d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085711 Aug 06 12:57:57.155341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1430/2851] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:57 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:57.162850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f36acdee-04e7-4020-856f-beed402367d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:57.164056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f36acdee-04e7-4020-856f-beed402367d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:57.170541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f36acdee-04e7-4020-856f-beed402367d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:57.171013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f36acdee-04e7-4020-856f-beed402367d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:57.171441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f36acdee-04e7-4020-856f-beed402367d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:57.172123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f36acdee-04e7-4020-856f-beed402367d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:57.172616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f36acdee-04e7-4020-856f-beed402367d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:57.173036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f36acdee-04e7-4020-856f-beed402367d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:57.235704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f36acdee-04e7-4020-856f-beed402367d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:57.243814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f36acdee-04e7-4020-856f-beed402367d3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084817 Aug 06 12:57:57.244397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1422/2852] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:57 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:57.990651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b67afa29-679a-4f0e-8ccd-c36b5100fe26 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:57.991274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b67afa29-679a-4f0e-8ccd-c36b5100fe26 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:57.998232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67afa29-679a-4f0e-8ccd-c36b5100fe26 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:57.998714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67afa29-679a-4f0e-8ccd-c36b5100fe26 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:57.999141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67afa29-679a-4f0e-8ccd-c36b5100fe26 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:57.999837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67afa29-679a-4f0e-8ccd-c36b5100fe26 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:58.000785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67afa29-679a-4f0e-8ccd-c36b5100fe26 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:58.000785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b67afa29-679a-4f0e-8ccd-c36b5100fe26 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:58.063768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-10c224c8-7720-4606-bc3e-2861c9dc3ebf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:58.064518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-10c224c8-7720-4606-bc3e-2861c9dc3ebf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:58.072672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10c224c8-7720-4606-bc3e-2861c9dc3ebf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:58.073151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10c224c8-7720-4606-bc3e-2861c9dc3ebf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:58.073609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10c224c8-7720-4606-bc3e-2861c9dc3ebf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:58.074295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10c224c8-7720-4606-bc3e-2861c9dc3ebf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:58.074933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10c224c8-7720-4606-bc3e-2861c9dc3ebf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:58.075584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10c224c8-7720-4606-bc3e-2861c9dc3ebf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:58.137408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b67afa29-679a-4f0e-8ccd-c36b5100fe26 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:58.145202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b67afa29-679a-4f0e-8ccd-c36b5100fe26 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.158394 Aug 06 12:57:58.145759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1431/2853] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:57 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:58.177298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:58.177902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:58.184344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:58.184887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:58.185316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:58.186025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:58.186471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:58.186897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:58.205263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-10c224c8-7720-4606-bc3e-2861c9dc3ebf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:58.213066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-10c224c8-7720-4606-bc3e-2861c9dc3ebf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153572 Aug 06 12:57:58.213623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1423/2854] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:58 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:58.248983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:58.257330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:58.258824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:58.260043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5c331602-ca6b-4fb8-814a-02fa44eae830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086581 Aug 06 12:57:58.260789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1432/2855] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:58 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:57:58.264200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-67611284-b301-4a5f-b20a-33b118a16d5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:58.264856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-67611284-b301-4a5f-b20a-33b118a16d5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:58.271115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67611284-b301-4a5f-b20a-33b118a16d5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:58.271593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67611284-b301-4a5f-b20a-33b118a16d5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:58.272024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67611284-b301-4a5f-b20a-33b118a16d5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:58.272750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67611284-b301-4a5f-b20a-33b118a16d5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:58.273203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67611284-b301-4a5f-b20a-33b118a16d5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:58.273622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67611284-b301-4a5f-b20a-33b118a16d5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:58.333229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-67611284-b301-4a5f-b20a-33b118a16d5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:58.342862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-67611284-b301-4a5f-b20a-33b118a16d5d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.080625 Aug 06 12:57:58.343444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1424/2856] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:58 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:59.166038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a8cf3bb-2a00-416f-8287-f1cd13dae3e0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:59.166640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a8cf3bb-2a00-416f-8287-f1cd13dae3e0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:59.173004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8cf3bb-2a00-416f-8287-f1cd13dae3e0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:59.173481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8cf3bb-2a00-416f-8287-f1cd13dae3e0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:59.173914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8cf3bb-2a00-416f-8287-f1cd13dae3e0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:59.174597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8cf3bb-2a00-416f-8287-f1cd13dae3e0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:59.175159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8cf3bb-2a00-416f-8287-f1cd13dae3e0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:59.175459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a8cf3bb-2a00-416f-8287-f1cd13dae3e0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:59.234890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5394a727-0eda-447a-b1e0-fc3b392d3e7d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:59.235529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5394a727-0eda-447a-b1e0-fc3b392d3e7d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:59.242549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5394a727-0eda-447a-b1e0-fc3b392d3e7d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:59.242921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5394a727-0eda-447a-b1e0-fc3b392d3e7d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:59.243291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5394a727-0eda-447a-b1e0-fc3b392d3e7d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:59.243901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5394a727-0eda-447a-b1e0-fc3b392d3e7d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:59.244384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5394a727-0eda-447a-b1e0-fc3b392d3e7d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:59.244811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5394a727-0eda-447a-b1e0-fc3b392d3e7d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:59.308907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a8cf3bb-2a00-416f-8287-f1cd13dae3e0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:59.316770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a8cf3bb-2a00-416f-8287-f1cd13dae3e0 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154522 Aug 06 12:57:59.317328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1433/2857] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:59 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:57:59.322462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:59.325751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:59.331638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:59.332113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:59.332597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:59.333281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:59.333946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:59.334370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:59.374282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5394a727-0eda-447a-b1e0-fc3b392d3e7d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:59.382910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5394a727-0eda-447a-b1e0-fc3b392d3e7d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151423 Aug 06 12:57:59.383489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1425/2858] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:57:59.387914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-26451e8a-2320-4218-87e5-1decf3f2f6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:57:59.388542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-26451e8a-2320-4218-87e5-1decf3f2f6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:57:59.394327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26451e8a-2320-4218-87e5-1decf3f2f6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:59.394811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26451e8a-2320-4218-87e5-1decf3f2f6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:59.395244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26451e8a-2320-4218-87e5-1decf3f2f6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:59.395928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26451e8a-2320-4218-87e5-1decf3f2f6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:57:59.396410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26451e8a-2320-4218-87e5-1decf3f2f6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:57:59.396830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26451e8a-2320-4218-87e5-1decf3f2f6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:57:59.397579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:59.406060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:59.407584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:59.408752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f34342af-b968-48da-9e71-9938ceabf77c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090514 Aug 06 12:57:59.409507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1434/2859] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:57:59 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:57:59.467386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-26451e8a-2320-4218-87e5-1decf3f2f6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:57:59.475166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-26451e8a-2320-4218-87e5-1decf3f2f6e5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.090738 Aug 06 12:57:59.475757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1426/2860] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:57:59 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:00.338792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c40ca33c-73c1-4628-8bbc-3ec8072da6a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:00.339401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c40ca33c-73c1-4628-8bbc-3ec8072da6a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:00.345827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c40ca33c-73c1-4628-8bbc-3ec8072da6a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:00.346298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c40ca33c-73c1-4628-8bbc-3ec8072da6a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:00.346726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c40ca33c-73c1-4628-8bbc-3ec8072da6a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:00.347427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c40ca33c-73c1-4628-8bbc-3ec8072da6a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:00.347874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c40ca33c-73c1-4628-8bbc-3ec8072da6a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:00.348290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c40ca33c-73c1-4628-8bbc-3ec8072da6a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:00.404398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-644e758b-db9c-4dcb-838c-1b78de61cae4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:00.404976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-644e758b-db9c-4dcb-838c-1b78de61cae4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:00.411255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-644e758b-db9c-4dcb-838c-1b78de61cae4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:00.411741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-644e758b-db9c-4dcb-838c-1b78de61cae4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:00.412178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-644e758b-db9c-4dcb-838c-1b78de61cae4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:00.412887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-644e758b-db9c-4dcb-838c-1b78de61cae4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:00.413375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-644e758b-db9c-4dcb-838c-1b78de61cae4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:00.413797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-644e758b-db9c-4dcb-838c-1b78de61cae4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:00.480677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c40ca33c-73c1-4628-8bbc-3ec8072da6a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:00.488871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c40ca33c-73c1-4628-8bbc-3ec8072da6a3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.154423 Aug 06 12:58:00.489646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1435/2861] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:00 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:00.494239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:00.494841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:00.501105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:00.501590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:00.502026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:00.502728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:00.503168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:00.503593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:00.518759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:00.543762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-644e758b-db9c-4dcb-838c-1b78de61cae4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:00.551817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-644e758b-db9c-4dcb-838c-1b78de61cae4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151235 Aug 06 12:58:00.552410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1427/2862] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:00 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:00.556843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-68492306-1791-4405-b2cd-d35e42e7ab4e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:00.557453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-68492306-1791-4405-b2cd-d35e42e7ab4e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:00.563111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68492306-1791-4405-b2cd-d35e42e7ab4e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:00.563598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68492306-1791-4405-b2cd-d35e42e7ab4e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:00.564037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68492306-1791-4405-b2cd-d35e42e7ab4e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:00.564757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68492306-1791-4405-b2cd-d35e42e7ab4e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:00.565217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68492306-1791-4405-b2cd-d35e42e7ab4e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:00.565651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68492306-1791-4405-b2cd-d35e42e7ab4e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:00.566443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:00.575424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:00.577035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:00.578259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c8184e67-245f-49f1-ac3c-693f20e21eca tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087787 Aug 06 12:58:00.578873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1436/2863] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:00 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:00.626062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-68492306-1791-4405-b2cd-d35e42e7ab4e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:00.634516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-68492306-1791-4405-b2cd-d35e42e7ab4e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081171 Aug 06 12:58:00.635087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1428/2864] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:00 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:01.510117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e74746ac-36dc-42dc-af60-d71406d3d993 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:01.510717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e74746ac-36dc-42dc-af60-d71406d3d993 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:01.517087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e74746ac-36dc-42dc-af60-d71406d3d993 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:01.517567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e74746ac-36dc-42dc-af60-d71406d3d993 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:01.517998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e74746ac-36dc-42dc-af60-d71406d3d993 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:01.518675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e74746ac-36dc-42dc-af60-d71406d3d993 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:01.519122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e74746ac-36dc-42dc-af60-d71406d3d993 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:01.519540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e74746ac-36dc-42dc-af60-d71406d3d993 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:01.573097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-09727788-0c37-4a8e-897f-90e83940c4b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:01.573711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-09727788-0c37-4a8e-897f-90e83940c4b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:01.580153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09727788-0c37-4a8e-897f-90e83940c4b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:01.580663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09727788-0c37-4a8e-897f-90e83940c4b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:01.581094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09727788-0c37-4a8e-897f-90e83940c4b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:01.581780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09727788-0c37-4a8e-897f-90e83940c4b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:01.582229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09727788-0c37-4a8e-897f-90e83940c4b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:01.582646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09727788-0c37-4a8e-897f-90e83940c4b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:01.657029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e74746ac-36dc-42dc-af60-d71406d3d993 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:01.666057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e74746ac-36dc-42dc-af60-d71406d3d993 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.159722 Aug 06 12:58:01.666778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1437/2865] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:01 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:01.671293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:01.671886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:01.678308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:01.678826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:01.679256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:01.679939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:01.680411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:01.680835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:01.718393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09727788-0c37-4a8e-897f-90e83940c4b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:01.726917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-09727788-0c37-4a8e-897f-90e83940c4b3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.157578 Aug 06 12:58:01.727495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1429/2866] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:01 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:01.731916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3330ab23-aabe-43b7-8764-863a177d9d19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:01.732552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3330ab23-aabe-43b7-8764-863a177d9d19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:01.738459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3330ab23-aabe-43b7-8764-863a177d9d19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:01.738933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3330ab23-aabe-43b7-8764-863a177d9d19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:01.739367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3330ab23-aabe-43b7-8764-863a177d9d19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:01.741482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3330ab23-aabe-43b7-8764-863a177d9d19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:01.741955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3330ab23-aabe-43b7-8764-863a177d9d19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:01.742384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3330ab23-aabe-43b7-8764-863a177d9d19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:01.742495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:01.750746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:01.752272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:01.753417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d0a7d301-f13c-49ac-89cd-2f162c9834eb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085710 Aug 06 12:58:01.753973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1438/2867] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:01 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:01.802531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3330ab23-aabe-43b7-8764-863a177d9d19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:01.810252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3330ab23-aabe-43b7-8764-863a177d9d19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081825 Aug 06 12:58:01.810805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1430/2868] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:01 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:02.686678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a929b19-5bb9-49e8-b385-69e44c6a3189 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:02.687289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6a929b19-5bb9-49e8-b385-69e44c6a3189 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:02.693725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a929b19-5bb9-49e8-b385-69e44c6a3189 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:02.694202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a929b19-5bb9-49e8-b385-69e44c6a3189 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:02.694638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a929b19-5bb9-49e8-b385-69e44c6a3189 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:02.695316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a929b19-5bb9-49e8-b385-69e44c6a3189 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:02.695796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a929b19-5bb9-49e8-b385-69e44c6a3189 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:02.696223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a929b19-5bb9-49e8-b385-69e44c6a3189 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:02.748644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-92315268-a654-4214-b30a-a5160ba7c10c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:02.749346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-92315268-a654-4214-b30a-a5160ba7c10c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:02.755726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92315268-a654-4214-b30a-a5160ba7c10c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:02.756200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92315268-a654-4214-b30a-a5160ba7c10c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:02.756658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92315268-a654-4214-b30a-a5160ba7c10c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:02.757365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92315268-a654-4214-b30a-a5160ba7c10c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:02.758223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92315268-a654-4214-b30a-a5160ba7c10c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:02.758888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92315268-a654-4214-b30a-a5160ba7c10c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:02.828493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6a929b19-5bb9-49e8-b385-69e44c6a3189 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:02.836379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6a929b19-5bb9-49e8-b385-69e44c6a3189 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153523 Aug 06 12:58:02.836947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1439/2869] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:02 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:02.841359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:02.841954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:02.847900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:02.848585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:02.849027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:02.849737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:02.850186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:02.851148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:02.889645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-92315268-a654-4214-b30a-a5160ba7c10c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:02.897857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-92315268-a654-4214-b30a-a5160ba7c10c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153018 Aug 06 12:58:02.898428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1431/2870] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:02 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:02.902773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fe34a100-0ee7-46a1-8f20-115d7be268ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:02.903563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fe34a100-0ee7-46a1-8f20-115d7be268ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:02.909239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe34a100-0ee7-46a1-8f20-115d7be268ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:02.909712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe34a100-0ee7-46a1-8f20-115d7be268ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:02.910138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe34a100-0ee7-46a1-8f20-115d7be268ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:02.910814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe34a100-0ee7-46a1-8f20-115d7be268ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:02.911258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe34a100-0ee7-46a1-8f20-115d7be268ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:02.911675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe34a100-0ee7-46a1-8f20-115d7be268ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:02.916278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:02.924677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:02.926530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:02.927669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d6bcb2bd-6413-4c3e-92b0-092553c0b5c9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089818 Aug 06 12:58:02.928222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1440/2871] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:02 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:02.977228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fe34a100-0ee7-46a1-8f20-115d7be268ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:02.985425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fe34a100-0ee7-46a1-8f20-115d7be268ba tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.086064 Aug 06 12:58:02.985989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1432/2872] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:02 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:03.857683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3e288b1c-d4eb-41a7-ad73-580585e1e074 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:03.858566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e288b1c-d4eb-41a7-ad73-580585e1e074 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:03.864948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e288b1c-d4eb-41a7-ad73-580585e1e074 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:03.865418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e288b1c-d4eb-41a7-ad73-580585e1e074 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:03.865851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e288b1c-d4eb-41a7-ad73-580585e1e074 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:03.866503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e288b1c-d4eb-41a7-ad73-580585e1e074 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:03.866943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e288b1c-d4eb-41a7-ad73-580585e1e074 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:03.867353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e288b1c-d4eb-41a7-ad73-580585e1e074 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:03.921040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2d29d4be-569c-452b-9042-0737292b3e8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:03.921676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2d29d4be-569c-452b-9042-0737292b3e8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:03.928354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d29d4be-569c-452b-9042-0737292b3e8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:03.928849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d29d4be-569c-452b-9042-0737292b3e8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:03.929284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d29d4be-569c-452b-9042-0737292b3e8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:03.929974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d29d4be-569c-452b-9042-0737292b3e8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:03.930433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d29d4be-569c-452b-9042-0737292b3e8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:03.930861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d29d4be-569c-452b-9042-0737292b3e8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:04.002684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3e288b1c-d4eb-41a7-ad73-580585e1e074 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:04.010875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3e288b1c-d4eb-41a7-ad73-580585e1e074 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.156951 Aug 06 12:58:04.011604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1441/2873] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:03 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:04.016040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:04.016661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:04.022910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:04.023395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:04.023891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:04.024599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:04.025046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:04.025466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:04.072156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2d29d4be-569c-452b-9042-0737292b3e8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:04.080546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2d29d4be-569c-452b-9042-0737292b3e8f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.163336 Aug 06 12:58:04.081120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1433/2874] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:03 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:04.086043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7c3f8caa-99df-4743-b531-c25adecbb427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:04.086645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7c3f8caa-99df-4743-b531-c25adecbb427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:04.086968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:04.092644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c3f8caa-99df-4743-b531-c25adecbb427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:04.093057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c3f8caa-99df-4743-b531-c25adecbb427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:04.093664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c3f8caa-99df-4743-b531-c25adecbb427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:04.094365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c3f8caa-99df-4743-b531-c25adecbb427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:04.094822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c3f8caa-99df-4743-b531-c25adecbb427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:04.095249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c3f8caa-99df-4743-b531-c25adecbb427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:04.095367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:04.096905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:04.098037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5abbf851-6c56-4a47-9041-cb66d073c41e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085516 Aug 06 12:58:04.098589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1442/2875] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:04 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:04.156625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7c3f8caa-99df-4743-b531-c25adecbb427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:04.164516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7c3f8caa-99df-4743-b531-c25adecbb427 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082430 Aug 06 12:58:04.165067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1434/2876] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:04 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:05.032573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c24bba34-c784-4c35-a6df-d977117c9858 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:05.033182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c24bba34-c784-4c35-a6df-d977117c9858 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:05.039563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c24bba34-c784-4c35-a6df-d977117c9858 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:05.040041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c24bba34-c784-4c35-a6df-d977117c9858 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:05.040504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c24bba34-c784-4c35-a6df-d977117c9858 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:05.041216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c24bba34-c784-4c35-a6df-d977117c9858 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:05.041662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c24bba34-c784-4c35-a6df-d977117c9858 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:05.042080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c24bba34-c784-4c35-a6df-d977117c9858 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:05.102277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0f844237-1997-44a0-85f0-12f1f6d4cc01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:05.102995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0f844237-1997-44a0-85f0-12f1f6d4cc01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:05.109750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f844237-1997-44a0-85f0-12f1f6d4cc01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:05.110321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f844237-1997-44a0-85f0-12f1f6d4cc01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:05.110816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f844237-1997-44a0-85f0-12f1f6d4cc01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:05.111562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f844237-1997-44a0-85f0-12f1f6d4cc01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:05.112086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f844237-1997-44a0-85f0-12f1f6d4cc01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:05.112532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f844237-1997-44a0-85f0-12f1f6d4cc01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:05.169158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c24bba34-c784-4c35-a6df-d977117c9858 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:05.177013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c24bba34-c784-4c35-a6df-d977117c9858 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148227 Aug 06 12:58:05.177579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1443/2877] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:05 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:05.182228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:05.182823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:05.188426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:05.188971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:05.189403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:05.190082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:05.190983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:05.190983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:05.245912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0f844237-1997-44a0-85f0-12f1f6d4cc01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:05.251961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:05.254257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0f844237-1997-44a0-85f0-12f1f6d4cc01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155904 Aug 06 12:58:05.254909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1435/2878] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:05.259982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8b3b4328-614b-4590-873d-6b509a920de5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:05.260673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8b3b4328-614b-4590-873d-6b509a920de5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:05.261259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:05.262757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:05.263883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-952c7274-d3d1-42c0-938f-cfd6e5380024 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085400 Aug 06 12:58:05.265099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1444/2879] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:05 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:05.266612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b3b4328-614b-4590-873d-6b509a920de5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:05.267158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b3b4328-614b-4590-873d-6b509a920de5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:05.267648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b3b4328-614b-4590-873d-6b509a920de5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:05.268432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b3b4328-614b-4590-873d-6b509a920de5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:05.268943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b3b4328-614b-4590-873d-6b509a920de5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:05.269363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b3b4328-614b-4590-873d-6b509a920de5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:05.330723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b3b4328-614b-4590-873d-6b509a920de5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:05.338613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8b3b4328-614b-4590-873d-6b509a920de5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082715 Aug 06 12:58:05.339166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1436/2880] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:05 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:06.198565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-13655001-ce53-4f3d-8314-f6167663fbbf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:06.199173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-13655001-ce53-4f3d-8314-f6167663fbbf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:06.205611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13655001-ce53-4f3d-8314-f6167663fbbf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:06.206090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13655001-ce53-4f3d-8314-f6167663fbbf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:06.206520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13655001-ce53-4f3d-8314-f6167663fbbf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:06.207191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13655001-ce53-4f3d-8314-f6167663fbbf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:06.207637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13655001-ce53-4f3d-8314-f6167663fbbf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:06.208063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13655001-ce53-4f3d-8314-f6167663fbbf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:06.276198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1af1f937-b45b-4b3b-820f-084686e24aa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:06.276830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1af1f937-b45b-4b3b-820f-084686e24aa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:06.283294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1af1f937-b45b-4b3b-820f-084686e24aa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:06.283774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1af1f937-b45b-4b3b-820f-084686e24aa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:06.284204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1af1f937-b45b-4b3b-820f-084686e24aa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:06.284916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1af1f937-b45b-4b3b-820f-084686e24aa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:06.285369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1af1f937-b45b-4b3b-820f-084686e24aa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:06.285790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1af1f937-b45b-4b3b-820f-084686e24aa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:06.338586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-13655001-ce53-4f3d-8314-f6167663fbbf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:06.346608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-13655001-ce53-4f3d-8314-f6167663fbbf tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151867 Aug 06 12:58:06.347211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1445/2881] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:06 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:06.353790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:06.353790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:06.359631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:06.360205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:06.360767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:06.361520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:06.361969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:06.362421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:06.414923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1af1f937-b45b-4b3b-820f-084686e24aa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:06.422967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1af1f937-b45b-4b3b-820f-084686e24aa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151195 Aug 06 12:58:06.423541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1437/2882] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:06.424123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:06.427912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e0e00829-ed4f-49ed-83d4-a5a22dec9648 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:06.428691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e0e00829-ed4f-49ed-83d4-a5a22dec9648 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:06.432942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:06.434425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:06.434576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0e00829-ed4f-49ed-83d4-a5a22dec9648 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:06.434991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0e00829-ed4f-49ed-83d4-a5a22dec9648 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:06.435423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0e00829-ed4f-49ed-83d4-a5a22dec9648 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:06.435556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7d875e66-04dc-42dc-8a06-69f14361cf12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087439 Aug 06 12:58:06.436230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1446/2883] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:06 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:06.436366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0e00829-ed4f-49ed-83d4-a5a22dec9648 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:06.436571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0e00829-ed4f-49ed-83d4-a5a22dec9648 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:06.436992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0e00829-ed4f-49ed-83d4-a5a22dec9648 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:06.440945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:06.500777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e0e00829-ed4f-49ed-83d4-a5a22dec9648 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:06.509134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e0e00829-ed4f-49ed-83d4-a5a22dec9648 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084659 Aug 06 12:58:06.509690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1438/2884] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:06 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:07.368779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-322dfecc-dcc0-48d2-95fd-97cbadc8f4ba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:07.369373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-322dfecc-dcc0-48d2-95fd-97cbadc8f4ba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:07.376122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-322dfecc-dcc0-48d2-95fd-97cbadc8f4ba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:07.376628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-322dfecc-dcc0-48d2-95fd-97cbadc8f4ba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:07.377056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-322dfecc-dcc0-48d2-95fd-97cbadc8f4ba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:07.377726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-322dfecc-dcc0-48d2-95fd-97cbadc8f4ba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:07.378169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-322dfecc-dcc0-48d2-95fd-97cbadc8f4ba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:07.378586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-322dfecc-dcc0-48d2-95fd-97cbadc8f4ba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:07.444597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-79374535-11bd-4d12-b50e-94c628f1f26d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:07.445296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-79374535-11bd-4d12-b50e-94c628f1f26d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:07.451573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79374535-11bd-4d12-b50e-94c628f1f26d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:07.452049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79374535-11bd-4d12-b50e-94c628f1f26d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:07.452511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79374535-11bd-4d12-b50e-94c628f1f26d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:07.453379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79374535-11bd-4d12-b50e-94c628f1f26d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:07.453638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79374535-11bd-4d12-b50e-94c628f1f26d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:07.454055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-79374535-11bd-4d12-b50e-94c628f1f26d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:07.510530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-322dfecc-dcc0-48d2-95fd-97cbadc8f4ba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:07.518528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-322dfecc-dcc0-48d2-95fd-97cbadc8f4ba tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153582 Aug 06 12:58:07.519093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1447/2885] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:07 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:07.523634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:07.524373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:07.530300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:07.530786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:07.531219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:07.531911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:07.532462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:07.532978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:07.591692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-79374535-11bd-4d12-b50e-94c628f1f26d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:07.599883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-79374535-11bd-4d12-b50e-94c628f1f26d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.159546 Aug 06 12:58:07.600065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:07.600637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1439/2886] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:07 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:07.605188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e9ea925f-15de-4dfa-af6e-24e30de2e0e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:07.605860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e9ea925f-15de-4dfa-af6e-24e30de2e0e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:07.611458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:07.612021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9ea925f-15de-4dfa-af6e-24e30de2e0e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:07.612769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9ea925f-15de-4dfa-af6e-24e30de2e0e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:07.613241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:07.613375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9ea925f-15de-4dfa-af6e-24e30de2e0e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:07.614012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9ea925f-15de-4dfa-af6e-24e30de2e0e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:07.614362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-adab28bf-8af5-4208-afcf-d51c0c1d5b85 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.094368 Aug 06 12:58:07.614479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9ea925f-15de-4dfa-af6e-24e30de2e0e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:07.614876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9ea925f-15de-4dfa-af6e-24e30de2e0e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:07.614989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1448/2887] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:07 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:07.823728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e9ea925f-15de-4dfa-af6e-24e30de2e0e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:07.831504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e9ea925f-15de-4dfa-af6e-24e30de2e0e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.229866 Aug 06 12:58:07.832059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1440/2888] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:07 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:08.540118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-26760784-29fe-4358-a84e-61eac4e6ace1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:08.540723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-26760784-29fe-4358-a84e-61eac4e6ace1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:08.547031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26760784-29fe-4358-a84e-61eac4e6ace1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:08.547503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26760784-29fe-4358-a84e-61eac4e6ace1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:08.547921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26760784-29fe-4358-a84e-61eac4e6ace1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:08.548616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26760784-29fe-4358-a84e-61eac4e6ace1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:08.549056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26760784-29fe-4358-a84e-61eac4e6ace1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:08.549468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26760784-29fe-4358-a84e-61eac4e6ace1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:08.621551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bef54da8-7b2f-405b-9129-33901f3d89ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:08.622142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bef54da8-7b2f-405b-9129-33901f3d89ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:08.628515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef54da8-7b2f-405b-9129-33901f3d89ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:08.628993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef54da8-7b2f-405b-9129-33901f3d89ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:08.629426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef54da8-7b2f-405b-9129-33901f3d89ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:08.630102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef54da8-7b2f-405b-9129-33901f3d89ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:08.630578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef54da8-7b2f-405b-9129-33901f3d89ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:08.631003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bef54da8-7b2f-405b-9129-33901f3d89ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:08.675655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-26760784-29fe-4358-a84e-61eac4e6ace1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:08.683494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-26760784-29fe-4358-a84e-61eac4e6ace1 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147783 Aug 06 12:58:08.684053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1449/2889] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:08 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:08.688784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:08.689170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:08.695383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:08.695871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:08.696284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:08.696990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:08.697449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:08.697864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:08.759852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:08.765990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bef54da8-7b2f-405b-9129-33901f3d89ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:08.768257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:08.769769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:08.770902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8d173b1a-56ce-4410-a084-59eea72cc11a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085909 Aug 06 12:58:08.771562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1450/2890] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:08 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:08.774381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bef54da8-7b2f-405b-9129-33901f3d89ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.156594 Aug 06 12:58:08.774920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1441/2891] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:08.852275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-259128e7-ac1f-4b3e-8071-4381d12bc954 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:08.852841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-259128e7-ac1f-4b3e-8071-4381d12bc954 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:08.859031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-259128e7-ac1f-4b3e-8071-4381d12bc954 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:08.859513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-259128e7-ac1f-4b3e-8071-4381d12bc954 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:08.859979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-259128e7-ac1f-4b3e-8071-4381d12bc954 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:08.860695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-259128e7-ac1f-4b3e-8071-4381d12bc954 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:08.861148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-259128e7-ac1f-4b3e-8071-4381d12bc954 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:08.861572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-259128e7-ac1f-4b3e-8071-4381d12bc954 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:08.924773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-259128e7-ac1f-4b3e-8071-4381d12bc954 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:08.932695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-259128e7-ac1f-4b3e-8071-4381d12bc954 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084322 Aug 06 12:58:08.933255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1451/2892] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:08 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:09.705083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c7a1cfc2-d5f9-435a-9334-c7491a6c503d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:09.705717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c7a1cfc2-d5f9-435a-9334-c7491a6c503d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:09.712617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7a1cfc2-d5f9-435a-9334-c7491a6c503d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:09.713097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7a1cfc2-d5f9-435a-9334-c7491a6c503d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:09.713531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7a1cfc2-d5f9-435a-9334-c7491a6c503d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:09.714212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7a1cfc2-d5f9-435a-9334-c7491a6c503d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:09.714664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7a1cfc2-d5f9-435a-9334-c7491a6c503d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:09.715087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7a1cfc2-d5f9-435a-9334-c7491a6c503d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:09.795199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f491ee9d-de90-45f1-a3aa-6c605dff97eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:09.795812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f491ee9d-de90-45f1-a3aa-6c605dff97eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:09.802035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f491ee9d-de90-45f1-a3aa-6c605dff97eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:09.802514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f491ee9d-de90-45f1-a3aa-6c605dff97eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:09.802945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f491ee9d-de90-45f1-a3aa-6c605dff97eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:09.803631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f491ee9d-de90-45f1-a3aa-6c605dff97eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:09.804077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f491ee9d-de90-45f1-a3aa-6c605dff97eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:09.804531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f491ee9d-de90-45f1-a3aa-6c605dff97eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:09.840110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7a1cfc2-d5f9-435a-9334-c7491a6c503d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:09.848131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c7a1cfc2-d5f9-435a-9334-c7491a6c503d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146861 Aug 06 12:58:09.848719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1442/2893] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:09 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:09.853832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:09.854431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:09.860322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:09.860886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:09.861325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:09.862012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:09.862461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:09.862886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:09.924068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:09.932552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:09.933762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f491ee9d-de90-45f1-a3aa-6c605dff97eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:09.934102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:09.935248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-29713468-4240-4f81-b98a-9ede823402da tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085619 Aug 06 12:58:09.935800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1443/2894] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:09 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:09.941627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f491ee9d-de90-45f1-a3aa-6c605dff97eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150422 Aug 06 12:58:09.942406 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1452/2895] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:09.953546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6e0bd7cf-b5d0-4c8d-864d-dee5fca6acda tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:09.954255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6e0bd7cf-b5d0-4c8d-864d-dee5fca6acda tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:09.960776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e0bd7cf-b5d0-4c8d-864d-dee5fca6acda tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:09.961202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e0bd7cf-b5d0-4c8d-864d-dee5fca6acda tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:09.961640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e0bd7cf-b5d0-4c8d-864d-dee5fca6acda tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:09.962335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e0bd7cf-b5d0-4c8d-864d-dee5fca6acda tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:09.962787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e0bd7cf-b5d0-4c8d-864d-dee5fca6acda tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:09.963211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e0bd7cf-b5d0-4c8d-864d-dee5fca6acda tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:10.027647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6e0bd7cf-b5d0-4c8d-864d-dee5fca6acda tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:10.035693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6e0bd7cf-b5d0-4c8d-864d-dee5fca6acda tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.086004 Aug 06 12:58:10.036257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1444/2896] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:09 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:10.871543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f258d38f-7936-4e1e-8623-fc5c1d6e0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:10.872177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f258d38f-7936-4e1e-8623-fc5c1d6e0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:10.878937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f258d38f-7936-4e1e-8623-fc5c1d6e0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:10.879422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f258d38f-7936-4e1e-8623-fc5c1d6e0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:10.879856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f258d38f-7936-4e1e-8623-fc5c1d6e0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:10.880566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f258d38f-7936-4e1e-8623-fc5c1d6e0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:10.881016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f258d38f-7936-4e1e-8623-fc5c1d6e0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:10.881440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f258d38f-7936-4e1e-8623-fc5c1d6e0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:10.885278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:10.957021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:10.957626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:10.964183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:10.964697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:10.965132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:10.965823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:10.966274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:10.966694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:11.012595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f258d38f-7936-4e1e-8623-fc5c1d6e0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:11.020649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f258d38f-7936-4e1e-8623-fc5c1d6e0d2e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152938 Aug 06 12:58:11.021213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1453/2897] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:10 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:11.029669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:11.037415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-69b132a7-be1d-41f2-9b34-c018e6b42816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:11.038545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-69b132a7-be1d-41f2-9b34-c018e6b42816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:11.038685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:11.040223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:11.041419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9ce9fb0-fe92-49f7-b16f-b9429d47b5db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088230 Aug 06 12:58:11.041969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1445/2898] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:10 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:11.044245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69b132a7-be1d-41f2-9b34-c018e6b42816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:11.044743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69b132a7-be1d-41f2-9b34-c018e6b42816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:11.045169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69b132a7-be1d-41f2-9b34-c018e6b42816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:11.045841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69b132a7-be1d-41f2-9b34-c018e6b42816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:11.046286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69b132a7-be1d-41f2-9b34-c018e6b42816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:11.046703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69b132a7-be1d-41f2-9b34-c018e6b42816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:11.057321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f46b2590-2dc1-4963-9db0-778b6bd42b00 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:11.058153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f46b2590-2dc1-4963-9db0-778b6bd42b00 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:11.066721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46b2590-2dc1-4963-9db0-778b6bd42b00 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:11.067441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46b2590-2dc1-4963-9db0-778b6bd42b00 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:11.068085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46b2590-2dc1-4963-9db0-778b6bd42b00 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:11.069151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46b2590-2dc1-4963-9db0-778b6bd42b00 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:11.069826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46b2590-2dc1-4963-9db0-778b6bd42b00 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:11.070453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46b2590-2dc1-4963-9db0-778b6bd42b00 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:11.142957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f46b2590-2dc1-4963-9db0-778b6bd42b00 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:11.151357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f46b2590-2dc1-4963-9db0-778b6bd42b00 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.098362 Aug 06 12:58:11.151944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1446/2899] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:11 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:11.187930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-69b132a7-be1d-41f2-9b34-c018e6b42816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:11.196236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-69b132a7-be1d-41f2-9b34-c018e6b42816 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.162439 Aug 06 12:58:11.196815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1454/2900] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:12.041554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0348c35a-88dc-4cc5-aefa-b0d33e57d5b3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:12.042158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0348c35a-88dc-4cc5-aefa-b0d33e57d5b3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:12.048543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0348c35a-88dc-4cc5-aefa-b0d33e57d5b3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:12.049024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0348c35a-88dc-4cc5-aefa-b0d33e57d5b3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:12.049459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0348c35a-88dc-4cc5-aefa-b0d33e57d5b3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:12.050173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0348c35a-88dc-4cc5-aefa-b0d33e57d5b3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:12.050622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0348c35a-88dc-4cc5-aefa-b0d33e57d5b3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:12.051046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0348c35a-88dc-4cc5-aefa-b0d33e57d5b3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:12.064146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:12.064781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:12.071968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:12.072486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:12.072952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:12.073704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:12.074161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:12.074583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:12.136900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:12.145266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:12.146754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:12.147907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-862bd437-9a80-4bb9-aeab-bb6c74c8da40 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087674 Aug 06 12:58:12.148482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1455/2901] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:12 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:58:12.172604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f8d06ae7-91ba-4afc-8787-40f0a6268927 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:12.173240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f8d06ae7-91ba-4afc-8787-40f0a6268927 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:12.179604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8d06ae7-91ba-4afc-8787-40f0a6268927 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:12.180089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8d06ae7-91ba-4afc-8787-40f0a6268927 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:12.180647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8d06ae7-91ba-4afc-8787-40f0a6268927 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:12.181233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8d06ae7-91ba-4afc-8787-40f0a6268927 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:12.181693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8d06ae7-91ba-4afc-8787-40f0a6268927 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:12.182119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8d06ae7-91ba-4afc-8787-40f0a6268927 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:12.183059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0348c35a-88dc-4cc5-aefa-b0d33e57d5b3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:12.191077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0348c35a-88dc-4cc5-aefa-b0d33e57d5b3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153510 Aug 06 12:58:12.191643 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1447/2902] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:12 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:12.217831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f69a46a3-2b44-4bb6-abe9-20ffe898c8d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:12.218459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f69a46a3-2b44-4bb6-abe9-20ffe898c8d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:12.224538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f69a46a3-2b44-4bb6-abe9-20ffe898c8d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:12.225055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f69a46a3-2b44-4bb6-abe9-20ffe898c8d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:12.225522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f69a46a3-2b44-4bb6-abe9-20ffe898c8d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:12.226244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f69a46a3-2b44-4bb6-abe9-20ffe898c8d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:12.226694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f69a46a3-2b44-4bb6-abe9-20ffe898c8d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:12.227114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f69a46a3-2b44-4bb6-abe9-20ffe898c8d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:12.245701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f8d06ae7-91ba-4afc-8787-40f0a6268927 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:12.253626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f8d06ae7-91ba-4afc-8787-40f0a6268927 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084671 Aug 06 12:58:12.254124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1456/2903] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:12 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:12.359758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f69a46a3-2b44-4bb6-abe9-20ffe898c8d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:12.368191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f69a46a3-2b44-4bb6-abe9-20ffe898c8d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154123 Aug 06 12:58:12.369121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1448/2904] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:13.170208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:13.170805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:13.177160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:13.177631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:13.178056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:13.178720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:13.179161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:13.179572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:13.213424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-060ac1c6-8927-4d32-b1e7-aedc8902961e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:13.214033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-060ac1c6-8927-4d32-b1e7-aedc8902961e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:13.221599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-060ac1c6-8927-4d32-b1e7-aedc8902961e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:13.222086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-060ac1c6-8927-4d32-b1e7-aedc8902961e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:13.222525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-060ac1c6-8927-4d32-b1e7-aedc8902961e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:13.223224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-060ac1c6-8927-4d32-b1e7-aedc8902961e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:13.224034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-060ac1c6-8927-4d32-b1e7-aedc8902961e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:13.224497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-060ac1c6-8927-4d32-b1e7-aedc8902961e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:13.244619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:13.253024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:13.254440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:13.255568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1e7d5b7c-7e1c-40f1-8925-a5fd6b71a7b7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089241 Aug 06 12:58:13.257050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1457/2905] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:13 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:13.275948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cfa56e17-9afa-4a01-a2f2-78518c7be68a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:13.276712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cfa56e17-9afa-4a01-a2f2-78518c7be68a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:13.282713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfa56e17-9afa-4a01-a2f2-78518c7be68a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:13.283188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfa56e17-9afa-4a01-a2f2-78518c7be68a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:13.283621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfa56e17-9afa-4a01-a2f2-78518c7be68a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:13.284323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfa56e17-9afa-4a01-a2f2-78518c7be68a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:13.285332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfa56e17-9afa-4a01-a2f2-78518c7be68a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:13.285332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfa56e17-9afa-4a01-a2f2-78518c7be68a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:13.347152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cfa56e17-9afa-4a01-a2f2-78518c7be68a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:13.355251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cfa56e17-9afa-4a01-a2f2-78518c7be68a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083672 Aug 06 12:58:13.355815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1458/2906] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:13 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:13.374958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-060ac1c6-8927-4d32-b1e7-aedc8902961e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:13.383714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-060ac1c6-8927-4d32-b1e7-aedc8902961e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.174788 Aug 06 12:58:13.384280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1449/2907] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:13 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:13.389912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a049be1-19cd-41d4-9d07-1b908be488c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:13.390543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0a049be1-19cd-41d4-9d07-1b908be488c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:13.396417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a049be1-19cd-41d4-9d07-1b908be488c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:13.396895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a049be1-19cd-41d4-9d07-1b908be488c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:13.397880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a049be1-19cd-41d4-9d07-1b908be488c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:13.398555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a049be1-19cd-41d4-9d07-1b908be488c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:13.399004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a049be1-19cd-41d4-9d07-1b908be488c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:13.399425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a049be1-19cd-41d4-9d07-1b908be488c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:13.523216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0a049be1-19cd-41d4-9d07-1b908be488c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:13.531008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0a049be1-19cd-41d4-9d07-1b908be488c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145034 Aug 06 12:58:13.531568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1459/2908] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:13 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:14.279239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:14.279804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:14.286239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:14.286725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:14.287161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:14.288522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:14.288980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:14.289405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:14.358395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:14.366723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:14.368213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:14.369414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a7ceaaf0-7f9b-4d06-aeb6-0d196aa4e1e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.094163 Aug 06 12:58:14.369972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1450/2909] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:14 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:14.376089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cfc1f1bf-596a-4ae0-abe3-59eb68ec7c38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:14.376711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cfc1f1bf-596a-4ae0-abe3-59eb68ec7c38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:14.382987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc1f1bf-596a-4ae0-abe3-59eb68ec7c38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:14.383451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc1f1bf-596a-4ae0-abe3-59eb68ec7c38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:14.383877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc1f1bf-596a-4ae0-abe3-59eb68ec7c38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:14.384556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc1f1bf-596a-4ae0-abe3-59eb68ec7c38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:14.384998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc1f1bf-596a-4ae0-abe3-59eb68ec7c38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:14.385412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfc1f1bf-596a-4ae0-abe3-59eb68ec7c38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:14.404893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8f7821a-17e8-4a73-9290-9194489bd29a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:14.405506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8f7821a-17e8-4a73-9290-9194489bd29a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:14.411354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8f7821a-17e8-4a73-9290-9194489bd29a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:14.411839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8f7821a-17e8-4a73-9290-9194489bd29a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:14.412274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8f7821a-17e8-4a73-9290-9194489bd29a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:14.413531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8f7821a-17e8-4a73-9290-9194489bd29a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:14.413989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8f7821a-17e8-4a73-9290-9194489bd29a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:14.414413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8f7821a-17e8-4a73-9290-9194489bd29a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:14.448845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cfc1f1bf-596a-4ae0-abe3-59eb68ec7c38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:14.457069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cfc1f1bf-596a-4ae0-abe3-59eb68ec7c38 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084710 Aug 06 12:58:14.457645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1460/2910] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:14 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:14.540679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a8f7821a-17e8-4a73-9290-9194489bd29a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:14.548580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8f7821a-17e8-4a73-9290-9194489bd29a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147384 Aug 06 12:58:14.549128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1451/2911] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:14 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:14.552162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-da361383-20c4-46db-bb56-23f84fe3e6bd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:14.552800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-da361383-20c4-46db-bb56-23f84fe3e6bd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:14.558718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da361383-20c4-46db-bb56-23f84fe3e6bd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:14.559196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da361383-20c4-46db-bb56-23f84fe3e6bd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:14.559627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da361383-20c4-46db-bb56-23f84fe3e6bd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:14.560328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da361383-20c4-46db-bb56-23f84fe3e6bd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:14.560773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da361383-20c4-46db-bb56-23f84fe3e6bd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:14.561198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da361383-20c4-46db-bb56-23f84fe3e6bd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:14.695392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-da361383-20c4-46db-bb56-23f84fe3e6bd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:14.703302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-da361383-20c4-46db-bb56-23f84fe3e6bd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154911 Aug 06 12:58:14.703866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1461/2912] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:15.391605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:15.392214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:15.398609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:15.399090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:15.399529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:15.400216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:15.400698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:15.401122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:15.463502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:15.471768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:15.473299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:15.474443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ce4c9a29-4be2-4571-b7fc-d38f37b54234 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086796 Aug 06 12:58:15.475642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1452/2913] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:15 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:15.478149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-263b0716-8a3d-4809-a7db-1f8d361df7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:15.478756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-263b0716-8a3d-4809-a7db-1f8d361df7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:15.485576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-263b0716-8a3d-4809-a7db-1f8d361df7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:15.486053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-263b0716-8a3d-4809-a7db-1f8d361df7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:15.486483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-263b0716-8a3d-4809-a7db-1f8d361df7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:15.487163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-263b0716-8a3d-4809-a7db-1f8d361df7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:15.487613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-263b0716-8a3d-4809-a7db-1f8d361df7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:15.488030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-263b0716-8a3d-4809-a7db-1f8d361df7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:15.547747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-263b0716-8a3d-4809-a7db-1f8d361df7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:15.556162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-263b0716-8a3d-4809-a7db-1f8d361df7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082536 Aug 06 12:58:15.556738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1462/2914] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:15 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:15.569247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c341af63-bfbe-4d61-a05e-5ec9c05fbeb2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:15.569849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c341af63-bfbe-4d61-a05e-5ec9c05fbeb2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:15.575689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c341af63-bfbe-4d61-a05e-5ec9c05fbeb2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:15.576163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c341af63-bfbe-4d61-a05e-5ec9c05fbeb2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:15.576631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c341af63-bfbe-4d61-a05e-5ec9c05fbeb2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:15.577312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c341af63-bfbe-4d61-a05e-5ec9c05fbeb2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:15.577761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c341af63-bfbe-4d61-a05e-5ec9c05fbeb2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:15.578182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c341af63-bfbe-4d61-a05e-5ec9c05fbeb2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:15.705023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c341af63-bfbe-4d61-a05e-5ec9c05fbeb2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:15.713345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c341af63-bfbe-4d61-a05e-5ec9c05fbeb2 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147833 Aug 06 12:58:15.713899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1453/2915] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:15 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:15.724861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cb513347-3805-492d-8242-084792c023ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:15.726065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cb513347-3805-492d-8242-084792c023ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:15.731793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb513347-3805-492d-8242-084792c023ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:15.732265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb513347-3805-492d-8242-084792c023ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:15.732970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb513347-3805-492d-8242-084792c023ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:15.733639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb513347-3805-492d-8242-084792c023ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:15.734083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb513347-3805-492d-8242-084792c023ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:15.734532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb513347-3805-492d-8242-084792c023ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:15.863734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cb513347-3805-492d-8242-084792c023ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:15.871574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cb513347-3805-492d-8242-084792c023ad tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150475 Aug 06 12:58:15.872126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1463/2916] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:16.497588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:16.498181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:16.504548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:16.505024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:16.505454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:16.506129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:16.507152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:16.507572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:16.567553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:16.570398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:16.576823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-67618bf4-e235-4d63-b6d0-7488c0d31420 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:16.577430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-67618bf4-e235-4d63-b6d0-7488c0d31420 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:16.578151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:16.579660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:16.580841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d4a60f37-7074-4d01-bc0a-6072f402c3d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087157 Aug 06 12:58:16.581394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1454/2917] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:16 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:16.583696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67618bf4-e235-4d63-b6d0-7488c0d31420 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:16.584175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67618bf4-e235-4d63-b6d0-7488c0d31420 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:16.584644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67618bf4-e235-4d63-b6d0-7488c0d31420 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:16.585331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67618bf4-e235-4d63-b6d0-7488c0d31420 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:16.585792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67618bf4-e235-4d63-b6d0-7488c0d31420 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:16.586217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-67618bf4-e235-4d63-b6d0-7488c0d31420 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:16.645898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-67618bf4-e235-4d63-b6d0-7488c0d31420 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:16.653695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-67618bf4-e235-4d63-b6d0-7488c0d31420 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.080643 Aug 06 12:58:16.654250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1464/2918] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:16 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:16.734930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-62b21697-b754-441c-b5ab-dd3c30e01311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:16.735535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-62b21697-b754-441c-b5ab-dd3c30e01311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:16.741936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62b21697-b754-441c-b5ab-dd3c30e01311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:16.742417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62b21697-b754-441c-b5ab-dd3c30e01311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:16.742850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62b21697-b754-441c-b5ab-dd3c30e01311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:16.743530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62b21697-b754-441c-b5ab-dd3c30e01311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:16.743981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62b21697-b754-441c-b5ab-dd3c30e01311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:16.744429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62b21697-b754-441c-b5ab-dd3c30e01311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:16.869844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-62b21697-b754-441c-b5ab-dd3c30e01311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:16.877633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-62b21697-b754-441c-b5ab-dd3c30e01311 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146742 Aug 06 12:58:16.878196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1455/2919] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:16 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:16.892431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-23f944a7-74a0-43a9-bec4-a6a876523bcf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:16.893027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-23f944a7-74a0-43a9-bec4-a6a876523bcf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:16.898793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f944a7-74a0-43a9-bec4-a6a876523bcf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:16.899258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f944a7-74a0-43a9-bec4-a6a876523bcf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:16.899682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f944a7-74a0-43a9-bec4-a6a876523bcf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:16.900437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f944a7-74a0-43a9-bec4-a6a876523bcf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:16.900882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f944a7-74a0-43a9-bec4-a6a876523bcf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:16.901295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23f944a7-74a0-43a9-bec4-a6a876523bcf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:17.032421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23f944a7-74a0-43a9-bec4-a6a876523bcf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:17.040776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-23f944a7-74a0-43a9-bec4-a6a876523bcf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152197 Aug 06 12:58:17.041329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1465/2920] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:17.603102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:17.603702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:17.610334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:17.610809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:17.611242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:17.611914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:17.612450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:17.612878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:17.674412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-03e0599e-4c6a-4838-b836-2cd2be09ed76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:17.674802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-03e0599e-4c6a-4838-b836-2cd2be09ed76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:17.676595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:17.681167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03e0599e-4c6a-4838-b836-2cd2be09ed76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:17.681649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03e0599e-4c6a-4838-b836-2cd2be09ed76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:17.682085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03e0599e-4c6a-4838-b836-2cd2be09ed76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:17.682772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03e0599e-4c6a-4838-b836-2cd2be09ed76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:17.683223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03e0599e-4c6a-4838-b836-2cd2be09ed76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:17.683646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03e0599e-4c6a-4838-b836-2cd2be09ed76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:17.684905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:17.686382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:17.687508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b70f4db5-1d26-4144-ab1b-c9c3d5954e1d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088899 Aug 06 12:58:17.688057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1456/2921] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:17 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:17.747719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-03e0599e-4c6a-4838-b836-2cd2be09ed76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:17.755539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-03e0599e-4c6a-4838-b836-2cd2be09ed76 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085479 Aug 06 12:58:17.756599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1466/2922] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:17 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:17.899373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9e392d3-cc58-4790-9339-9c58dc3c986e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:17.899906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9e392d3-cc58-4790-9339-9c58dc3c986e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:17.905786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e392d3-cc58-4790-9339-9c58dc3c986e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:17.906258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e392d3-cc58-4790-9339-9c58dc3c986e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:17.906686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e392d3-cc58-4790-9339-9c58dc3c986e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:17.907357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e392d3-cc58-4790-9339-9c58dc3c986e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:17.907803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e392d3-cc58-4790-9339-9c58dc3c986e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:17.908216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9e392d3-cc58-4790-9339-9c58dc3c986e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:18.034071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9e392d3-cc58-4790-9339-9c58dc3c986e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:18.044158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9e392d3-cc58-4790-9339-9c58dc3c986e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148850 Aug 06 12:58:18.045090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1457/2923] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:17 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:18.062420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fbf202de-c068-4560-9604-08480808c7cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:18.063055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fbf202de-c068-4560-9604-08480808c7cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:18.069499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbf202de-c068-4560-9604-08480808c7cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:18.070005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbf202de-c068-4560-9604-08480808c7cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:18.070439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbf202de-c068-4560-9604-08480808c7cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:18.071114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbf202de-c068-4560-9604-08480808c7cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:18.071566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbf202de-c068-4560-9604-08480808c7cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:18.071989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbf202de-c068-4560-9604-08480808c7cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:18.197953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fbf202de-c068-4560-9604-08480808c7cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:18.205841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fbf202de-c068-4560-9604-08480808c7cf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147198 Aug 06 12:58:18.206397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1467/2924] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:18 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:18.710677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:18.711281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:18.717711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:18.718189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:18.718624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:18.719305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:18.719758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:18.720188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:18.776809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-71df0572-ec8e-4edf-8cc3-c2e93a03c6b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:18.777483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-71df0572-ec8e-4edf-8cc3-c2e93a03c6b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:18.781973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:18.783583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71df0572-ec8e-4edf-8cc3-c2e93a03c6b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:18.784059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71df0572-ec8e-4edf-8cc3-c2e93a03c6b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:18.784512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71df0572-ec8e-4edf-8cc3-c2e93a03c6b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:18.785189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71df0572-ec8e-4edf-8cc3-c2e93a03c6b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:18.785640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71df0572-ec8e-4edf-8cc3-c2e93a03c6b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:18.786052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71df0572-ec8e-4edf-8cc3-c2e93a03c6b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:18.790986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:18.792504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:18.793646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-29b9f994-04ce-4658-a1e5-dd14bea26724 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087387 Aug 06 12:58:18.794196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1458/2925] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:18 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:18.846296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-71df0572-ec8e-4edf-8cc3-c2e93a03c6b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:18.854591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-71df0572-ec8e-4edf-8cc3-c2e93a03c6b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081640 Aug 06 12:58:18.855147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1468/2926] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:18 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:19.066281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-64679770-2863-41e6-bc18-9c2e7462be9f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:19.066899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-64679770-2863-41e6-bc18-9c2e7462be9f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:19.073361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64679770-2863-41e6-bc18-9c2e7462be9f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:19.073869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64679770-2863-41e6-bc18-9c2e7462be9f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:19.074302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64679770-2863-41e6-bc18-9c2e7462be9f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:19.074986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64679770-2863-41e6-bc18-9c2e7462be9f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:19.075440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64679770-2863-41e6-bc18-9c2e7462be9f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:19.075862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64679770-2863-41e6-bc18-9c2e7462be9f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:19.205251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-64679770-2863-41e6-bc18-9c2e7462be9f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:19.213958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-64679770-2863-41e6-bc18-9c2e7462be9f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151515 Aug 06 12:58:19.214517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1459/2927] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:19 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:19.226740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a45f8fc5-b752-4762-aa2e-198005a1d577 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:19.227367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a45f8fc5-b752-4762-aa2e-198005a1d577 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:19.233473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a45f8fc5-b752-4762-aa2e-198005a1d577 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:19.233944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a45f8fc5-b752-4762-aa2e-198005a1d577 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:19.234370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a45f8fc5-b752-4762-aa2e-198005a1d577 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:19.235039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a45f8fc5-b752-4762-aa2e-198005a1d577 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:19.235484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a45f8fc5-b752-4762-aa2e-198005a1d577 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:19.235896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a45f8fc5-b752-4762-aa2e-198005a1d577 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:19.363934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a45f8fc5-b752-4762-aa2e-198005a1d577 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:19.367119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:19.374126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a45f8fc5-b752-4762-aa2e-198005a1d577 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151232 Aug 06 12:58:19.374680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1469/2928] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:19.815836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:19.816471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:19.823334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:19.823814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:19.824247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:19.824951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:19.825402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:19.825825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:19.875616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f16c5196-afb5-4071-8697-516998103d3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:19.876249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f16c5196-afb5-4071-8697-516998103d3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:19.883098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f16c5196-afb5-4071-8697-516998103d3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:19.883577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f16c5196-afb5-4071-8697-516998103d3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:19.884005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f16c5196-afb5-4071-8697-516998103d3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:19.884718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f16c5196-afb5-4071-8697-516998103d3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:19.885167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f16c5196-afb5-4071-8697-516998103d3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:19.885991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f16c5196-afb5-4071-8697-516998103d3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:19.888206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:19.896465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:19.898541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:19.899667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-316460c5-2049-4c88-af17-6e12a8f1e35e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087716 Aug 06 12:58:19.900428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1460/2929] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:19 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:19.946498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f16c5196-afb5-4071-8697-516998103d3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:19.954368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f16c5196-afb5-4071-8697-516998103d3f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082620 Aug 06 12:58:19.954926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1470/2930] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:19 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:20.235259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-54359864-42f2-42e4-ad78-8a028504eced tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:20.235778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-54359864-42f2-42e4-ad78-8a028504eced tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:20.242189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54359864-42f2-42e4-ad78-8a028504eced tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:20.242660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54359864-42f2-42e4-ad78-8a028504eced tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:20.243084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54359864-42f2-42e4-ad78-8a028504eced tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:20.243756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54359864-42f2-42e4-ad78-8a028504eced tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:20.244201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54359864-42f2-42e4-ad78-8a028504eced tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:20.244642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54359864-42f2-42e4-ad78-8a028504eced tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:20.373769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-54359864-42f2-42e4-ad78-8a028504eced tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:20.382310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-54359864-42f2-42e4-ad78-8a028504eced tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151204 Aug 06 12:58:20.382867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1461/2931] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:20 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:20.394785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-625d41c6-a582-4d2f-841b-f3e42a8da5ce tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:20.395380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-625d41c6-a582-4d2f-841b-f3e42a8da5ce tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:20.401413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-625d41c6-a582-4d2f-841b-f3e42a8da5ce tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:20.401887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-625d41c6-a582-4d2f-841b-f3e42a8da5ce tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:20.402311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-625d41c6-a582-4d2f-841b-f3e42a8da5ce tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:20.402983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-625d41c6-a582-4d2f-841b-f3e42a8da5ce tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:20.403428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-625d41c6-a582-4d2f-841b-f3e42a8da5ce tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:20.403845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-625d41c6-a582-4d2f-841b-f3e42a8da5ce tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:20.530028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-625d41c6-a582-4d2f-841b-f3e42a8da5ce tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:20.537901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-625d41c6-a582-4d2f-841b-f3e42a8da5ce tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146902 Aug 06 12:58:20.538454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1471/2932] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:20.922526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:20.923120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:20.925385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:20.931095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:20.931565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:20.931992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:20.932697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:20.933145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:20.933561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:20.975542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-80dc1939-189d-4edc-8c1b-81bdfab55072 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:20.976283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-80dc1939-189d-4edc-8c1b-81bdfab55072 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:20.978972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:20.984571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80dc1939-189d-4edc-8c1b-81bdfab55072 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:20.985057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80dc1939-189d-4edc-8c1b-81bdfab55072 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:20.985493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80dc1939-189d-4edc-8c1b-81bdfab55072 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:20.986208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80dc1939-189d-4edc-8c1b-81bdfab55072 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:20.986663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80dc1939-189d-4edc-8c1b-81bdfab55072 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:20.987082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-80dc1939-189d-4edc-8c1b-81bdfab55072 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:20.999217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:21.007603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:21.009113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:21.010239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2efb3bf3-43b7-4e39-8342-9685476846d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.091713 Aug 06 12:58:21.010788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1462/2933] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:21.052391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-80dc1939-189d-4edc-8c1b-81bdfab55072 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:21.060281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-80dc1939-189d-4edc-8c1b-81bdfab55072 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.089239 Aug 06 12:58:21.060859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1472/2934] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:20 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:21.403734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b7dddfd8-85d4-43c3-b041-6bc1de9d65b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:21.404361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b7dddfd8-85d4-43c3-b041-6bc1de9d65b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:21.410264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7dddfd8-85d4-43c3-b041-6bc1de9d65b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:21.410745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7dddfd8-85d4-43c3-b041-6bc1de9d65b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:21.411181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7dddfd8-85d4-43c3-b041-6bc1de9d65b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:21.411861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7dddfd8-85d4-43c3-b041-6bc1de9d65b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:21.412333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7dddfd8-85d4-43c3-b041-6bc1de9d65b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:21.412848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7dddfd8-85d4-43c3-b041-6bc1de9d65b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:21.538251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b7dddfd8-85d4-43c3-b041-6bc1de9d65b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:21.546114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b7dddfd8-85d4-43c3-b041-6bc1de9d65b6 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146199 Aug 06 12:58:21.546673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1463/2935] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:21 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:21.558564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-249bcaa2-0dbf-4cb0-baa6-97f5d40c5301 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:21.559161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-249bcaa2-0dbf-4cb0-baa6-97f5d40c5301 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:21.564945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249bcaa2-0dbf-4cb0-baa6-97f5d40c5301 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:21.565415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249bcaa2-0dbf-4cb0-baa6-97f5d40c5301 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:21.565841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249bcaa2-0dbf-4cb0-baa6-97f5d40c5301 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:21.566505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249bcaa2-0dbf-4cb0-baa6-97f5d40c5301 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:21.566948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249bcaa2-0dbf-4cb0-baa6-97f5d40c5301 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:21.567362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-249bcaa2-0dbf-4cb0-baa6-97f5d40c5301 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:21.692019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-249bcaa2-0dbf-4cb0-baa6-97f5d40c5301 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:21.700452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-249bcaa2-0dbf-4cb0-baa6-97f5d40c5301 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145594 Aug 06 12:58:21.700999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1473/2936] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:21 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:22.032978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:22.033583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:22.039868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:22.040377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:22.040812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:22.041493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:22.041941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:22.042364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:22.080053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-51c6c972-e730-4d45-8b82-35d23d677e8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:22.080677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-51c6c972-e730-4d45-8b82-35d23d677e8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:22.087212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51c6c972-e730-4d45-8b82-35d23d677e8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:22.087691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51c6c972-e730-4d45-8b82-35d23d677e8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:22.088119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51c6c972-e730-4d45-8b82-35d23d677e8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:22.088829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51c6c972-e730-4d45-8b82-35d23d677e8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:22.089273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51c6c972-e730-4d45-8b82-35d23d677e8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:22.089690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51c6c972-e730-4d45-8b82-35d23d677e8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:22.104315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:22.112890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:22.114385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:22.116109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e60373c2-506e-4099-bc77-078f0a78bba6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086473 Aug 06 12:58:22.116933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1464/2937] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:22 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:22.152054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-51c6c972-e730-4d45-8b82-35d23d677e8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:22.160010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-51c6c972-e730-4d45-8b82-35d23d677e8d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083644 Aug 06 12:58:22.160592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1474/2938] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:22 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:22.567051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1070919e-affa-4989-b0d2-8c2ef4cfc724 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:22.567658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1070919e-affa-4989-b0d2-8c2ef4cfc724 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:22.573616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1070919e-affa-4989-b0d2-8c2ef4cfc724 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:22.574094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1070919e-affa-4989-b0d2-8c2ef4cfc724 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:22.574558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1070919e-affa-4989-b0d2-8c2ef4cfc724 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:22.575242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1070919e-affa-4989-b0d2-8c2ef4cfc724 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:22.575692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1070919e-affa-4989-b0d2-8c2ef4cfc724 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:22.576122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1070919e-affa-4989-b0d2-8c2ef4cfc724 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:22.704812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1070919e-affa-4989-b0d2-8c2ef4cfc724 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:22.713137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1070919e-affa-4989-b0d2-8c2ef4cfc724 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149888 Aug 06 12:58:22.713693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1465/2939] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:22 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:22.722425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ddfe03e0-4fd1-4e1b-8792-bb6aa2056ee9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:22.723103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ddfe03e0-4fd1-4e1b-8792-bb6aa2056ee9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:22.729626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddfe03e0-4fd1-4e1b-8792-bb6aa2056ee9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:22.730101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddfe03e0-4fd1-4e1b-8792-bb6aa2056ee9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:22.730525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddfe03e0-4fd1-4e1b-8792-bb6aa2056ee9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:22.731191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddfe03e0-4fd1-4e1b-8792-bb6aa2056ee9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:22.731634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddfe03e0-4fd1-4e1b-8792-bb6aa2056ee9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:22.732048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddfe03e0-4fd1-4e1b-8792-bb6aa2056ee9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:22.859400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ddfe03e0-4fd1-4e1b-8792-bb6aa2056ee9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:22.867301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ddfe03e0-4fd1-4e1b-8792-bb6aa2056ee9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148710 Aug 06 12:58:22.867856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1475/2940] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:22 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:23.138654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:23.139198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:23.145595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:23.146072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:23.146507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:23.147825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:23.148280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:23.148795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:23.180158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dd8c6f12-28b2-4d2b-9186-2d584b4e3948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:23.180890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dd8c6f12-28b2-4d2b-9186-2d584b4e3948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:23.187355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd8c6f12-28b2-4d2b-9186-2d584b4e3948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:23.187833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd8c6f12-28b2-4d2b-9186-2d584b4e3948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:23.188276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd8c6f12-28b2-4d2b-9186-2d584b4e3948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:23.188989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd8c6f12-28b2-4d2b-9186-2d584b4e3948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:23.189439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd8c6f12-28b2-4d2b-9186-2d584b4e3948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:23.189877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd8c6f12-28b2-4d2b-9186-2d584b4e3948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:23.210525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:23.218790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:23.220327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:23.221471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f778925c-6c0c-41c8-8512-4ce3e4d0cc5c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086776 Aug 06 12:58:23.222028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1466/2941] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:23 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:23.252981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dd8c6f12-28b2-4d2b-9186-2d584b4e3948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:23.261520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dd8c6f12-28b2-4d2b-9186-2d584b4e3948 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085099 Aug 06 12:58:23.262107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1476/2942] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:23 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:23.735015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5ad34ff2-6057-46e2-a1a2-503c9922fadd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:23.735533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5ad34ff2-6057-46e2-a1a2-503c9922fadd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:23.742094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad34ff2-6057-46e2-a1a2-503c9922fadd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:23.742576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad34ff2-6057-46e2-a1a2-503c9922fadd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:23.743004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad34ff2-6057-46e2-a1a2-503c9922fadd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:23.743685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad34ff2-6057-46e2-a1a2-503c9922fadd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:23.744134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad34ff2-6057-46e2-a1a2-503c9922fadd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:23.744577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ad34ff2-6057-46e2-a1a2-503c9922fadd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:23.874038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5ad34ff2-6057-46e2-a1a2-503c9922fadd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:23.882453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5ad34ff2-6057-46e2-a1a2-503c9922fadd tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151534 Aug 06 12:58:23.883005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1467/2943] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:23 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:23.888283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-379ca488-dfd6-46d8-aedb-41c97a5ef3e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:23.888985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-379ca488-dfd6-46d8-aedb-41c97a5ef3e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:23.894844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379ca488-dfd6-46d8-aedb-41c97a5ef3e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:23.895316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379ca488-dfd6-46d8-aedb-41c97a5ef3e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:23.895742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379ca488-dfd6-46d8-aedb-41c97a5ef3e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:23.896448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379ca488-dfd6-46d8-aedb-41c97a5ef3e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:23.896896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379ca488-dfd6-46d8-aedb-41c97a5ef3e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:23.897319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-379ca488-dfd6-46d8-aedb-41c97a5ef3e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:24.022692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-379ca488-dfd6-46d8-aedb-41c97a5ef3e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:24.030516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-379ca488-dfd6-46d8-aedb-41c97a5ef3e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146022 Aug 06 12:58:24.031073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1477/2944] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:23 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:24.243997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:24.244630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:24.251071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:24.251496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:24.251933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:24.252636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:24.253087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:24.253512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:24.284232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e2ea300b-313b-4b0b-889a-44852bfff14a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:24.284941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e2ea300b-313b-4b0b-889a-44852bfff14a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:24.292014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2ea300b-313b-4b0b-889a-44852bfff14a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:24.292535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2ea300b-313b-4b0b-889a-44852bfff14a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:24.292966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2ea300b-313b-4b0b-889a-44852bfff14a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:24.293657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2ea300b-313b-4b0b-889a-44852bfff14a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:24.294105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2ea300b-313b-4b0b-889a-44852bfff14a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:24.294522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2ea300b-313b-4b0b-889a-44852bfff14a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:24.320075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:24.328549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:24.330045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:24.331194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6f0ec9ed-179d-488b-995f-e16487fcaca3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.091180 Aug 06 12:58:24.331734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1468/2945] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:24 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:24.361286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e2ea300b-313b-4b0b-889a-44852bfff14a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:24.369127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e2ea300b-313b-4b0b-889a-44852bfff14a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.088701 Aug 06 12:58:24.369681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1478/2946] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:24 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:24.902915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d4dd4758-1d26-4bbc-8cfa-6391988f5642 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:24.903519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d4dd4758-1d26-4bbc-8cfa-6391988f5642 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:24.909323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4dd4758-1d26-4bbc-8cfa-6391988f5642 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:24.909796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4dd4758-1d26-4bbc-8cfa-6391988f5642 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:24.910225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4dd4758-1d26-4bbc-8cfa-6391988f5642 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:24.910896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4dd4758-1d26-4bbc-8cfa-6391988f5642 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:24.911341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4dd4758-1d26-4bbc-8cfa-6391988f5642 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:24.911756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4dd4758-1d26-4bbc-8cfa-6391988f5642 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:25.038481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d4dd4758-1d26-4bbc-8cfa-6391988f5642 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:25.046337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d4dd4758-1d26-4bbc-8cfa-6391988f5642 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147229 Aug 06 12:58:25.047079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1469/2947] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:24 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:25.052324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-76dd5852-cd0b-427c-8ba3-82385f0d8f37 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:25.053570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-76dd5852-cd0b-427c-8ba3-82385f0d8f37 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:25.059518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76dd5852-cd0b-427c-8ba3-82385f0d8f37 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:25.060071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76dd5852-cd0b-427c-8ba3-82385f0d8f37 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:25.060542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76dd5852-cd0b-427c-8ba3-82385f0d8f37 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:25.061226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76dd5852-cd0b-427c-8ba3-82385f0d8f37 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:25.061677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76dd5852-cd0b-427c-8ba3-82385f0d8f37 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:25.062100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76dd5852-cd0b-427c-8ba3-82385f0d8f37 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:25.340283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-76dd5852-cd0b-427c-8ba3-82385f0d8f37 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:25.348215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-76dd5852-cd0b-427c-8ba3-82385f0d8f37 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.299728 Aug 06 12:58:25.348955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1479/2948] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:25 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:25.354329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:25.354929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:25.361427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:25.361898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:25.362324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:25.362995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:25.363439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:25.363852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:25.390660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f803a8ed-8ee4-468c-9f1e-bda895dc4631 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:25.391261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f803a8ed-8ee4-468c-9f1e-bda895dc4631 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:25.397187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f803a8ed-8ee4-468c-9f1e-bda895dc4631 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:25.397667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f803a8ed-8ee4-468c-9f1e-bda895dc4631 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:25.398095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f803a8ed-8ee4-468c-9f1e-bda895dc4631 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:25.398783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f803a8ed-8ee4-468c-9f1e-bda895dc4631 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:25.399236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f803a8ed-8ee4-468c-9f1e-bda895dc4631 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:25.399654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f803a8ed-8ee4-468c-9f1e-bda895dc4631 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:25.428591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:25.437155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:25.438661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:25.439814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd0e0073-456d-40a7-bcb7-58bd8e040283 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089940 Aug 06 12:58:25.440431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1470/2949] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:25 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:25.462717 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f803a8ed-8ee4-468c-9f1e-bda895dc4631 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:25.470649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f803a8ed-8ee4-468c-9f1e-bda895dc4631 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083852 Aug 06 12:58:25.471188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1480/2950] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:25 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:26.066908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cf079157-cb04-4633-a530-25503ce7fb8f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:26.067513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cf079157-cb04-4633-a530-25503ce7fb8f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:26.074039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf079157-cb04-4633-a530-25503ce7fb8f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:26.074495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf079157-cb04-4633-a530-25503ce7fb8f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:26.074926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf079157-cb04-4633-a530-25503ce7fb8f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:26.075605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf079157-cb04-4633-a530-25503ce7fb8f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:26.076052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf079157-cb04-4633-a530-25503ce7fb8f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:26.076948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf079157-cb04-4633-a530-25503ce7fb8f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:26.091960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:26.207330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cf079157-cb04-4633-a530-25503ce7fb8f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:26.216033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cf079157-cb04-4633-a530-25503ce7fb8f tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.152927 Aug 06 12:58:26.216654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1471/2951] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:26 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:26.370401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-92201b89-80b0-4d86-80db-8962383d2b89 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:26.370938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-92201b89-80b0-4d86-80db-8962383d2b89 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:26.377353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92201b89-80b0-4d86-80db-8962383d2b89 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:26.377832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92201b89-80b0-4d86-80db-8962383d2b89 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:26.378288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92201b89-80b0-4d86-80db-8962383d2b89 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:26.378965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92201b89-80b0-4d86-80db-8962383d2b89 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:26.379434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92201b89-80b0-4d86-80db-8962383d2b89 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:26.379877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92201b89-80b0-4d86-80db-8962383d2b89 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:26.461868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:26.462473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:26.468977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:26.469460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:26.469901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:26.470592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:26.471047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:26.471472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:26.510344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-92201b89-80b0-4d86-80db-8962383d2b89 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:26.518478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-92201b89-80b0-4d86-80db-8962383d2b89 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151906 Aug 06 12:58:26.519044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1481/2952] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:26 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:26.523818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-308a92c9-be04-47f1-a8d0-d07124c5b688 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:26.524440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-308a92c9-be04-47f1-a8d0-d07124c5b688 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:26.530218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-308a92c9-be04-47f1-a8d0-d07124c5b688 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:26.530727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-308a92c9-be04-47f1-a8d0-d07124c5b688 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:26.531160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-308a92c9-be04-47f1-a8d0-d07124c5b688 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:26.531840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-308a92c9-be04-47f1-a8d0-d07124c5b688 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:26.532402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-308a92c9-be04-47f1-a8d0-d07124c5b688 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:26.533122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-308a92c9-be04-47f1-a8d0-d07124c5b688 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:26.535242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:26.543719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:26.545252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:26.546389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c1558ad7-c530-4fa8-b420-11333ce5dd14 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088534 Aug 06 12:58:26.547468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1472/2953] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:26 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:58:26.593445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-308a92c9-be04-47f1-a8d0-d07124c5b688 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:26.601714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-308a92c9-be04-47f1-a8d0-d07124c5b688 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081610 Aug 06 12:58:26.602263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1482/2954] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:26 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:27.237389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2f7f8640-5345-4449-a987-fba759048db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:27.237998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2f7f8640-5345-4449-a987-fba759048db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:27.244824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7f8640-5345-4449-a987-fba759048db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:27.245300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7f8640-5345-4449-a987-fba759048db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:27.245810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7f8640-5345-4449-a987-fba759048db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:27.246493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7f8640-5345-4449-a987-fba759048db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:27.246969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7f8640-5345-4449-a987-fba759048db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:27.247389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7f8640-5345-4449-a987-fba759048db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:27.372737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2f7f8640-5345-4449-a987-fba759048db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:27.380582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2f7f8640-5345-4449-a987-fba759048db3 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146948 Aug 06 12:58:27.381623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1473/2955] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:27 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:27.538562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e7ce722e-d3ca-4a7c-8a9a-31ca523a4852 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:27.539168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e7ce722e-d3ca-4a7c-8a9a-31ca523a4852 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:27.545584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ce722e-d3ca-4a7c-8a9a-31ca523a4852 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:27.546060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ce722e-d3ca-4a7c-8a9a-31ca523a4852 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:27.546491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ce722e-d3ca-4a7c-8a9a-31ca523a4852 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:27.547167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ce722e-d3ca-4a7c-8a9a-31ca523a4852 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:27.547614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ce722e-d3ca-4a7c-8a9a-31ca523a4852 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:27.548032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ce722e-d3ca-4a7c-8a9a-31ca523a4852 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:27.570339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:27.570947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:27.577308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:27.577733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:27.578167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:27.578859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:27.579308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:27.579735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:27.644664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:27.658125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:27.659942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:27.661120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b06b4e8c-cfd2-43ec-b47c-e205308adaf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.095109 Aug 06 12:58:27.661893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1474/2956] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:27 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:58:27.666397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f63b97c8-5bc3-4881-b8b9-4bfa982d224b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:27.666994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f63b97c8-5bc3-4881-b8b9-4bfa982d224b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:27.672923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f63b97c8-5bc3-4881-b8b9-4bfa982d224b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:27.673399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f63b97c8-5bc3-4881-b8b9-4bfa982d224b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:27.673826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f63b97c8-5bc3-4881-b8b9-4bfa982d224b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:27.674505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f63b97c8-5bc3-4881-b8b9-4bfa982d224b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:27.674955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f63b97c8-5bc3-4881-b8b9-4bfa982d224b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:27.675375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f63b97c8-5bc3-4881-b8b9-4bfa982d224b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:27.678885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e7ce722e-d3ca-4a7c-8a9a-31ca523a4852 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:27.687021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e7ce722e-d3ca-4a7c-8a9a-31ca523a4852 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152286 Aug 06 12:58:27.687797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1483/2957] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:27 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:27.735519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f63b97c8-5bc3-4881-b8b9-4bfa982d224b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:27.743667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f63b97c8-5bc3-4881-b8b9-4bfa982d224b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.080790 Aug 06 12:58:27.744222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1475/2958] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:27 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:28.402682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b26421e3-8246-4897-b144-5e39a67b1983 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:28.403280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b26421e3-8246-4897-b144-5e39a67b1983 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:28.409161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b26421e3-8246-4897-b144-5e39a67b1983 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:28.409630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b26421e3-8246-4897-b144-5e39a67b1983 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:28.410053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b26421e3-8246-4897-b144-5e39a67b1983 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:28.410721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b26421e3-8246-4897-b144-5e39a67b1983 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:28.411165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b26421e3-8246-4897-b144-5e39a67b1983 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:28.411576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b26421e3-8246-4897-b144-5e39a67b1983 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:28.540165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b26421e3-8246-4897-b144-5e39a67b1983 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:28.548502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b26421e3-8246-4897-b144-5e39a67b1983 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.149693 Aug 06 12:58:28.549063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1484/2959] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:28 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:28.683339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:28.683865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:28.690326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:28.690804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:28.691240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:28.691928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:28.692403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:28.692828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:28.708499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1255b80-1b3e-427f-87b9-60431e95172d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:28.709587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b1255b80-1b3e-427f-87b9-60431e95172d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:28.715492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1255b80-1b3e-427f-87b9-60431e95172d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:28.715983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1255b80-1b3e-427f-87b9-60431e95172d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:28.716464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1255b80-1b3e-427f-87b9-60431e95172d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:28.717155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1255b80-1b3e-427f-87b9-60431e95172d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:28.717612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1255b80-1b3e-427f-87b9-60431e95172d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:28.718034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1255b80-1b3e-427f-87b9-60431e95172d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:28.755195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:28.767202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:28.768726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:28.769882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-34e40578-e30f-4f52-8cf3-1edcd21d1d4c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.090536 Aug 06 12:58:28.770442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1476/2960] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:28 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:28.775301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-40956c1c-3d97-4e47-a24a-9584b1a03032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:28.775900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-40956c1c-3d97-4e47-a24a-9584b1a03032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:28.781872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40956c1c-3d97-4e47-a24a-9584b1a03032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:28.782442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40956c1c-3d97-4e47-a24a-9584b1a03032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:28.782943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40956c1c-3d97-4e47-a24a-9584b1a03032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:28.783685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40956c1c-3d97-4e47-a24a-9584b1a03032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:28.784819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40956c1c-3d97-4e47-a24a-9584b1a03032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:28.784819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40956c1c-3d97-4e47-a24a-9584b1a03032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:28.847809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-40956c1c-3d97-4e47-a24a-9584b1a03032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:28.850078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1255b80-1b3e-427f-87b9-60431e95172d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:28.855963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-40956c1c-3d97-4e47-a24a-9584b1a03032 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.084567 Aug 06 12:58:28.856560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1477/2961] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:28 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:28.858407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b1255b80-1b3e-427f-87b9-60431e95172d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153715 Aug 06 12:58:28.861491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1485/2962] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:28 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:29.569548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-835f8016-6e5f-4613-8538-73c8c46c1cca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:29.570157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-835f8016-6e5f-4613-8538-73c8c46c1cca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:29.576007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835f8016-6e5f-4613-8538-73c8c46c1cca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:29.576509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835f8016-6e5f-4613-8538-73c8c46c1cca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:29.576939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835f8016-6e5f-4613-8538-73c8c46c1cca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:29.577611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835f8016-6e5f-4613-8538-73c8c46c1cca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:29.578055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835f8016-6e5f-4613-8538-73c8c46c1cca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:29.578471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-835f8016-6e5f-4613-8538-73c8c46c1cca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:29.717216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-835f8016-6e5f-4613-8538-73c8c46c1cca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:29.725535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-835f8016-6e5f-4613-8538-73c8c46c1cca tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.160395 Aug 06 12:58:29.726095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1478/2963] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:29 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:29.792631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:29.793234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:29.799517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:29.799995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:29.800482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:29.801162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:29.801608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:29.802025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:29.817098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:29.862970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:29.872064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:29.873792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:29.874854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f4292cdf-7e0a-4fe8-badf-153d7c790235 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086249 Aug 06 12:58:29.875403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1486/2964] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:29 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:29.876955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c9b11672-5bab-42f6-8831-136c041756aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:29.877560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c9b11672-5bab-42f6-8831-136c041756aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:29.879857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2a0b66da-9bca-4e27-b827-3847ddf77d6b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:29.880480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2a0b66da-9bca-4e27-b827-3847ddf77d6b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:29.883486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b11672-5bab-42f6-8831-136c041756aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:29.883964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b11672-5bab-42f6-8831-136c041756aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:29.884424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b11672-5bab-42f6-8831-136c041756aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:29.885146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b11672-5bab-42f6-8831-136c041756aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:29.885548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b11672-5bab-42f6-8831-136c041756aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:29.886017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9b11672-5bab-42f6-8831-136c041756aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:29.886249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a0b66da-9bca-4e27-b827-3847ddf77d6b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:29.886723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a0b66da-9bca-4e27-b827-3847ddf77d6b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:29.887159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a0b66da-9bca-4e27-b827-3847ddf77d6b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:29.887961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a0b66da-9bca-4e27-b827-3847ddf77d6b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:29.888443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a0b66da-9bca-4e27-b827-3847ddf77d6b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:29.888867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a0b66da-9bca-4e27-b827-3847ddf77d6b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:29.947950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c9b11672-5bab-42f6-8831-136c041756aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:29.956453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c9b11672-5bab-42f6-8831-136c041756aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083325 Aug 06 12:58:29.957022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1479/2965] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:29 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:30.025212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2a0b66da-9bca-4e27-b827-3847ddf77d6b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:30.033109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2a0b66da-9bca-4e27-b827-3847ddf77d6b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.156792 Aug 06 12:58:30.033696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1487/2966] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:29 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:30.746968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8d83c24f-f174-498f-a6ee-ff45f969dd9d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:30.747593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8d83c24f-f174-498f-a6ee-ff45f969dd9d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:30.753862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d83c24f-f174-498f-a6ee-ff45f969dd9d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:30.754336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d83c24f-f174-498f-a6ee-ff45f969dd9d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:30.754759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d83c24f-f174-498f-a6ee-ff45f969dd9d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:30.755432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d83c24f-f174-498f-a6ee-ff45f969dd9d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:30.756500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d83c24f-f174-498f-a6ee-ff45f969dd9d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:30.756918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d83c24f-f174-498f-a6ee-ff45f969dd9d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:30.883396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8d83c24f-f174-498f-a6ee-ff45f969dd9d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:30.891288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8d83c24f-f174-498f-a6ee-ff45f969dd9d tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148113 Aug 06 12:58:30.891834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1480/2967] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:30 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:30.896111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:30.896741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:30.903006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:30.903478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:30.903958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:30.904697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:30.905148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:30.905564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:30.965600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:30.973940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:30.975437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:30.976588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9e434824-7700-46fb-8ad3-91bb80f50a13 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.084437 Aug 06 12:58:30.977130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1488/2968] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:30 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:58:30.977988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4947f426-c102-4e74-89bb-4ee9c262a7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:30.978593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4947f426-c102-4e74-89bb-4ee9c262a7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:30.984830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4947f426-c102-4e74-89bb-4ee9c262a7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:30.985303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4947f426-c102-4e74-89bb-4ee9c262a7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:30.985758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4947f426-c102-4e74-89bb-4ee9c262a7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:30.986431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4947f426-c102-4e74-89bb-4ee9c262a7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:30.986875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4947f426-c102-4e74-89bb-4ee9c262a7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:30.987289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4947f426-c102-4e74-89bb-4ee9c262a7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:31.050862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4947f426-c102-4e74-89bb-4ee9c262a7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:31.055043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fbe1b7c6-fa70-4251-add7-825c5d928f8b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:31.055651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fbe1b7c6-fa70-4251-add7-825c5d928f8b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:31.059182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4947f426-c102-4e74-89bb-4ee9c262a7bc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085117 Aug 06 12:58:31.059757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1481/2969] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:30 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:31.061676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbe1b7c6-fa70-4251-add7-825c5d928f8b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:31.062153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbe1b7c6-fa70-4251-add7-825c5d928f8b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:31.062584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbe1b7c6-fa70-4251-add7-825c5d928f8b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:31.063266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbe1b7c6-fa70-4251-add7-825c5d928f8b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:31.063716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbe1b7c6-fa70-4251-add7-825c5d928f8b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:31.064145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbe1b7c6-fa70-4251-add7-825c5d928f8b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:31.189937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fbe1b7c6-fa70-4251-add7-825c5d928f8b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:31.197777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fbe1b7c6-fa70-4251-add7-825c5d928f8b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146980 Aug 06 12:58:31.198330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1489/2970] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:31 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:31.912558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9fcf8edb-d34b-49f6-8abb-89151a2019b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:31.913160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9fcf8edb-d34b-49f6-8abb-89151a2019b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:31.919608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fcf8edb-d34b-49f6-8abb-89151a2019b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:31.920082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fcf8edb-d34b-49f6-8abb-89151a2019b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:31.920552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fcf8edb-d34b-49f6-8abb-89151a2019b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:31.921226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fcf8edb-d34b-49f6-8abb-89151a2019b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:31.921672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fcf8edb-d34b-49f6-8abb-89151a2019b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:31.922088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fcf8edb-d34b-49f6-8abb-89151a2019b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:32.001196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:32.001807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:32.008834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:32.009346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:32.009774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:32.010466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:32.010903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:32.011326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:32.048518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9fcf8edb-d34b-49f6-8abb-89151a2019b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:32.056736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9fcf8edb-d34b-49f6-8abb-89151a2019b9 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147984 Aug 06 12:58:32.057309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1482/2971] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:31 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:32.077119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:32.080259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7fb71aea-46ef-4ebc-8b45-a7f0e2fc1a80 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:32.080887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7fb71aea-46ef-4ebc-8b45-a7f0e2fc1a80 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:32.086515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:32.087277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fb71aea-46ef-4ebc-8b45-a7f0e2fc1a80 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:32.087757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fb71aea-46ef-4ebc-8b45-a7f0e2fc1a80 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:32.088120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:32.088240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fb71aea-46ef-4ebc-8b45-a7f0e2fc1a80 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:32.088881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fb71aea-46ef-4ebc-8b45-a7f0e2fc1a80 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:32.089282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-21475d0c-2a58-4671-94d3-a0edc5cf6589 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.094115 Aug 06 12:58:32.089402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fb71aea-46ef-4ebc-8b45-a7f0e2fc1a80 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:32.089733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fb71aea-46ef-4ebc-8b45-a7f0e2fc1a80 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:32.089839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1490/2972] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:31 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:32.150585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7fb71aea-46ef-4ebc-8b45-a7f0e2fc1a80 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:32.158420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7fb71aea-46ef-4ebc-8b45-a7f0e2fc1a80 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081909 Aug 06 12:58:32.158975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1483/2973] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:32.218122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1ebe74c6-3484-4281-b0e0-3eb9dc0c7721 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:32.218674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1ebe74c6-3484-4281-b0e0-3eb9dc0c7721 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:32.224598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe74c6-3484-4281-b0e0-3eb9dc0c7721 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:32.225082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe74c6-3484-4281-b0e0-3eb9dc0c7721 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:32.225515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe74c6-3484-4281-b0e0-3eb9dc0c7721 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:32.226197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe74c6-3484-4281-b0e0-3eb9dc0c7721 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:32.226656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe74c6-3484-4281-b0e0-3eb9dc0c7721 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:32.227075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ebe74c6-3484-4281-b0e0-3eb9dc0c7721 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:32.359463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1ebe74c6-3484-4281-b0e0-3eb9dc0c7721 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:32.367800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1ebe74c6-3484-4281-b0e0-3eb9dc0c7721 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153557 Aug 06 12:58:32.368396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1491/2974] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:32 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:33.078431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-53c293b6-8882-473e-9e1f-9940b90a4c7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:33.079056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-53c293b6-8882-473e-9e1f-9940b90a4c7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:33.085484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53c293b6-8882-473e-9e1f-9940b90a4c7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:33.085954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53c293b6-8882-473e-9e1f-9940b90a4c7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:33.086379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53c293b6-8882-473e-9e1f-9940b90a4c7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:33.087050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53c293b6-8882-473e-9e1f-9940b90a4c7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:33.087495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53c293b6-8882-473e-9e1f-9940b90a4c7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:33.087912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53c293b6-8882-473e-9e1f-9940b90a4c7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:33.112650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:33.113246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:33.119866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:33.120367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:33.120794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:33.121466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:33.121909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:33.122321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:33.185274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:33.193541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:33.195531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:33.196864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6ca1ad0d-7bda-40c3-9616-b8e29f2204d7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088013 Aug 06 12:58:33.197465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1492/2975] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:33 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:58:33.202101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4cb9d36-f1ed-4d56-8ecb-5b839fb4164b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:33.202692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c4cb9d36-f1ed-4d56-8ecb-5b839fb4164b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:33.210041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4cb9d36-f1ed-4d56-8ecb-5b839fb4164b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:33.210806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4cb9d36-f1ed-4d56-8ecb-5b839fb4164b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:33.211452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4cb9d36-f1ed-4d56-8ecb-5b839fb4164b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:33.212866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4cb9d36-f1ed-4d56-8ecb-5b839fb4164b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:33.213315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4cb9d36-f1ed-4d56-8ecb-5b839fb4164b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:33.213735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c4cb9d36-f1ed-4d56-8ecb-5b839fb4164b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:33.221797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-53c293b6-8882-473e-9e1f-9940b90a4c7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:33.230282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-53c293b6-8882-473e-9e1f-9940b90a4c7a tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.155823 Aug 06 12:58:33.230844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1484/2976] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:33 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:33.279436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c4cb9d36-f1ed-4d56-8ecb-5b839fb4164b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:33.288140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c4cb9d36-f1ed-4d56-8ecb-5b839fb4164b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.089721 Aug 06 12:58:33.288763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1493/2977] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:33 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:33.389094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dc51290a-8f5d-49b3-bc7b-ea15bad4853a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:33.389696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dc51290a-8f5d-49b3-bc7b-ea15bad4853a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:33.395503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc51290a-8f5d-49b3-bc7b-ea15bad4853a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:33.395975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc51290a-8f5d-49b3-bc7b-ea15bad4853a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:33.397030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc51290a-8f5d-49b3-bc7b-ea15bad4853a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:33.397706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc51290a-8f5d-49b3-bc7b-ea15bad4853a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:33.398152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc51290a-8f5d-49b3-bc7b-ea15bad4853a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:33.398581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc51290a-8f5d-49b3-bc7b-ea15bad4853a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:33.525379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dc51290a-8f5d-49b3-bc7b-ea15bad4853a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:33.533170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dc51290a-8f5d-49b3-bc7b-ea15bad4853a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147825 Aug 06 12:58:33.533728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1485/2978] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:33 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:34.220258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:34.220907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:34.227154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:34.227630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:34.228060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:34.228776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:34.229226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:34.229646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:34.251095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6c609f65-5a94-465f-b216-c390e9354584 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:34.251728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6c609f65-5a94-465f-b216-c390e9354584 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:34.258667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c609f65-5a94-465f-b216-c390e9354584 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:34.259146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c609f65-5a94-465f-b216-c390e9354584 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:34.260849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c609f65-5a94-465f-b216-c390e9354584 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:34.261587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c609f65-5a94-465f-b216-c390e9354584 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:34.262056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c609f65-5a94-465f-b216-c390e9354584 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:34.262489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c609f65-5a94-465f-b216-c390e9354584 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:34.290549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:34.298829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:34.300328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:34.301462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-65a74ec0-e9df-434f-ac14-c725f11d8da2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085304 Aug 06 12:58:34.302299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1494/2979] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:34 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:34.308389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a88cec0a-ed16-4d7e-a28e-6dcd2484ab4a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:34.309107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a88cec0a-ed16-4d7e-a28e-6dcd2484ab4a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:34.315093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a88cec0a-ed16-4d7e-a28e-6dcd2484ab4a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:34.315641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a88cec0a-ed16-4d7e-a28e-6dcd2484ab4a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:34.316079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a88cec0a-ed16-4d7e-a28e-6dcd2484ab4a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:34.316804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a88cec0a-ed16-4d7e-a28e-6dcd2484ab4a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:34.317252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a88cec0a-ed16-4d7e-a28e-6dcd2484ab4a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:34.317674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a88cec0a-ed16-4d7e-a28e-6dcd2484ab4a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:34.377793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a88cec0a-ed16-4d7e-a28e-6dcd2484ab4a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:34.386350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a88cec0a-ed16-4d7e-a28e-6dcd2484ab4a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081774 Aug 06 12:58:34.386917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1495/2980] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:34 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:34.395300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6c609f65-5a94-465f-b216-c390e9354584 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:34.403701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6c609f65-5a94-465f-b216-c390e9354584 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.156508 Aug 06 12:58:34.404250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1486/2981] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:34 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:34.555080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3e5a177b-d5e5-49de-b867-b70b4d678d6a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:34.555679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e5a177b-d5e5-49de-b867-b70b4d678d6a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:34.561531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e5a177b-d5e5-49de-b867-b70b4d678d6a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:34.562004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e5a177b-d5e5-49de-b867-b70b4d678d6a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:34.562433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e5a177b-d5e5-49de-b867-b70b4d678d6a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:34.563104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e5a177b-d5e5-49de-b867-b70b4d678d6a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:34.563547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e5a177b-d5e5-49de-b867-b70b4d678d6a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:34.563960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e5a177b-d5e5-49de-b867-b70b4d678d6a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:34.687344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3e5a177b-d5e5-49de-b867-b70b4d678d6a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:34.695783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3e5a177b-d5e5-49de-b867-b70b4d678d6a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145005 Aug 06 12:58:34.696351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1496/2982] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:34 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:35.323035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:35.323670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:35.330131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:35.330606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:35.331035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:35.331712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:35.332159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:35.332709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:35.394427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:35.403597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:35.405130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:35.406290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d2bd656c-fdf9-4774-a952-a9a3760b3ee6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087211 Aug 06 12:58:35.407018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1487/2983] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:35 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:35.407490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eaca6eba-b7f6-4954-9a95-003870095f09 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:35.408162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eaca6eba-b7f6-4954-9a95-003870095f09 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:35.423884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaca6eba-b7f6-4954-9a95-003870095f09 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:35.424417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaca6eba-b7f6-4954-9a95-003870095f09 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:35.424885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaca6eba-b7f6-4954-9a95-003870095f09 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:35.425570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaca6eba-b7f6-4954-9a95-003870095f09 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:35.426052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaca6eba-b7f6-4954-9a95-003870095f09 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:35.426469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eaca6eba-b7f6-4954-9a95-003870095f09 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:35.426737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-abb5cd5e-1a74-4bd6-845f-690077d96248 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:35.427796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-abb5cd5e-1a74-4bd6-845f-690077d96248 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:35.433425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abb5cd5e-1a74-4bd6-845f-690077d96248 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:35.434066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abb5cd5e-1a74-4bd6-845f-690077d96248 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:35.434513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abb5cd5e-1a74-4bd6-845f-690077d96248 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:35.435204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abb5cd5e-1a74-4bd6-845f-690077d96248 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:35.435662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abb5cd5e-1a74-4bd6-845f-690077d96248 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:35.436088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abb5cd5e-1a74-4bd6-845f-690077d96248 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:35.440152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:35.494018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eaca6eba-b7f6-4954-9a95-003870095f09 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:35.502363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eaca6eba-b7f6-4954-9a95-003870095f09 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.098834 Aug 06 12:58:35.503295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1497/2984] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:35 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:35.564856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-abb5cd5e-1a74-4bd6-845f-690077d96248 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:35.573274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-abb5cd5e-1a74-4bd6-845f-690077d96248 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150171 Aug 06 12:58:35.573777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1488/2985] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:35 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:35.716817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f60c80af-e828-44f2-9c62-ed91c323d1fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:35.717427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f60c80af-e828-44f2-9c62-ed91c323d1fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:35.723285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f60c80af-e828-44f2-9c62-ed91c323d1fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:35.723774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f60c80af-e828-44f2-9c62-ed91c323d1fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:35.724213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f60c80af-e828-44f2-9c62-ed91c323d1fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:35.724928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f60c80af-e828-44f2-9c62-ed91c323d1fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:35.725384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f60c80af-e828-44f2-9c62-ed91c323d1fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:35.725812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f60c80af-e828-44f2-9c62-ed91c323d1fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:35.853001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f60c80af-e828-44f2-9c62-ed91c323d1fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:35.861182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f60c80af-e828-44f2-9c62-ed91c323d1fb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148185 Aug 06 12:58:35.861741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1498/2986] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:35 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:36.430367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:36.430901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:36.437261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:36.437740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:36.438173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:36.438855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:36.439307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:36.439731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:36.504097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:36.512557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:36.514032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:36.515154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-41234f2e-d095-43db-a313-e2d67603fa18 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089368 Aug 06 12:58:36.515711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1489/2987] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:36 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:36.523073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-565f9329-d975-420e-a3e4-8661af2396b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:36.523684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-565f9329-d975-420e-a3e4-8661af2396b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:36.530576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-565f9329-d975-420e-a3e4-8661af2396b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:36.531053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-565f9329-d975-420e-a3e4-8661af2396b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:36.531483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-565f9329-d975-420e-a3e4-8661af2396b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:36.532167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-565f9329-d975-420e-a3e4-8661af2396b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:36.532655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-565f9329-d975-420e-a3e4-8661af2396b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:36.533072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-565f9329-d975-420e-a3e4-8661af2396b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:36.593059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-565f9329-d975-420e-a3e4-8661af2396b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:36.594459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-53e7e6b1-0b5f-45bc-8f74-5057286d4051 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:36.595063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-53e7e6b1-0b5f-45bc-8f74-5057286d4051 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:36.601431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-565f9329-d975-420e-a3e4-8661af2396b5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082430 Aug 06 12:58:36.601602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53e7e6b1-0b5f-45bc-8f74-5057286d4051 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:36.601951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53e7e6b1-0b5f-45bc-8f74-5057286d4051 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:36.602059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1499/2988] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:36 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:36.602469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53e7e6b1-0b5f-45bc-8f74-5057286d4051 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:36.603204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53e7e6b1-0b5f-45bc-8f74-5057286d4051 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:36.603656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53e7e6b1-0b5f-45bc-8f74-5057286d4051 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:36.604073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53e7e6b1-0b5f-45bc-8f74-5057286d4051 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:36.728227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-53e7e6b1-0b5f-45bc-8f74-5057286d4051 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:36.736277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-53e7e6b1-0b5f-45bc-8f74-5057286d4051 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145576 Aug 06 12:58:36.736857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1490/2989] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:36 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:36.769010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:58:36.769178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 12:58:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:58:36.881808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-28494d0d-5c7d-42aa-ad48-55b5df77be0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:36.882407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-28494d0d-5c7d-42aa-ad48-55b5df77be0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:36.888344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28494d0d-5c7d-42aa-ad48-55b5df77be0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:36.888863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28494d0d-5c7d-42aa-ad48-55b5df77be0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:36.889533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28494d0d-5c7d-42aa-ad48-55b5df77be0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:36.890167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28494d0d-5c7d-42aa-ad48-55b5df77be0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:36.890748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28494d0d-5c7d-42aa-ad48-55b5df77be0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:36.891168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28494d0d-5c7d-42aa-ad48-55b5df77be0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:37.023093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-28494d0d-5c7d-42aa-ad48-55b5df77be0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:37.030960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-28494d0d-5c7d-42aa-ad48-55b5df77be0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152881 Aug 06 12:58:37.031515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1500/2990] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:36 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:37.537399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:37.538006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:37.544319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:37.544802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:37.545228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:37.547078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:37.547078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:37.547078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:37.607867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:37.616851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:37.618362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:37.619514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3b0b6afd-912a-4634-ac20-107c0893097e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086025 Aug 06 12:58:37.620059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1491/2991] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:37 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:37.622337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-51392012-9a08-4efb-8ff5-6242563e07aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:37.622966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-51392012-9a08-4efb-8ff5-6242563e07aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:37.629649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51392012-9a08-4efb-8ff5-6242563e07aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:37.630219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51392012-9a08-4efb-8ff5-6242563e07aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:37.631280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51392012-9a08-4efb-8ff5-6242563e07aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:37.631958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51392012-9a08-4efb-8ff5-6242563e07aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:37.632451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51392012-9a08-4efb-8ff5-6242563e07aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:37.632990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-51392012-9a08-4efb-8ff5-6242563e07aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:37.695979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-51392012-9a08-4efb-8ff5-6242563e07aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:37.703920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-51392012-9a08-4efb-8ff5-6242563e07aa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.085422 Aug 06 12:58:37.704581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1501/2992] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:37 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:37.734502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:58:37.734702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:58:37.757570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2970410e-d2e5-4a00-9455-2682ca46b9bb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:37.758176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2970410e-d2e5-4a00-9455-2682ca46b9bb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:37.764141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2970410e-d2e5-4a00-9455-2682ca46b9bb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:37.764645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2970410e-d2e5-4a00-9455-2682ca46b9bb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:37.765076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2970410e-d2e5-4a00-9455-2682ca46b9bb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:37.765758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2970410e-d2e5-4a00-9455-2682ca46b9bb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:37.766206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2970410e-d2e5-4a00-9455-2682ca46b9bb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:37.766626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2970410e-d2e5-4a00-9455-2682ca46b9bb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:37.897137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2970410e-d2e5-4a00-9455-2682ca46b9bb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:37.905174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2970410e-d2e5-4a00-9455-2682ca46b9bb tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.151966 Aug 06 12:58:37.905734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1492/2993] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:37 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:38.053343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-01545537-2213-498c-ba61-747e8deb7752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:38.053939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-01545537-2213-498c-ba61-747e8deb7752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:38.059718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01545537-2213-498c-ba61-747e8deb7752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:38.060196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01545537-2213-498c-ba61-747e8deb7752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:38.060654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01545537-2213-498c-ba61-747e8deb7752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:38.061330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01545537-2213-498c-ba61-747e8deb7752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:38.061775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01545537-2213-498c-ba61-747e8deb7752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:38.062281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01545537-2213-498c-ba61-747e8deb7752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:38.188578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-01545537-2213-498c-ba61-747e8deb7752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:38.196347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-01545537-2213-498c-ba61-747e8deb7752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147445 Aug 06 12:58:38.196897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1502/2994] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:38 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:38.642348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:38.643020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:38.649401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:38.649881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:38.650313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:38.650999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:38.651448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:38.651870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:38.714113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:38.722333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:38.723810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:38.724952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-650804e0-088a-4225-82ba-1c93509d7123 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:38.725432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fbf3443a-e273-47ed-bcc0-ef3cc6f2c4b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087020 Aug 06 12:58:38.725560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-650804e0-088a-4225-82ba-1c93509d7123 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:38.726053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1493/2995] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:38 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:38.732069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-650804e0-088a-4225-82ba-1c93509d7123 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:38.732843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-650804e0-088a-4225-82ba-1c93509d7123 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:38.733272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-650804e0-088a-4225-82ba-1c93509d7123 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:38.733950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-650804e0-088a-4225-82ba-1c93509d7123 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:38.734396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-650804e0-088a-4225-82ba-1c93509d7123 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:38.734815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-650804e0-088a-4225-82ba-1c93509d7123 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:38.738655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:38.800237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-650804e0-088a-4225-82ba-1c93509d7123 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:38.808917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-650804e0-088a-4225-82ba-1c93509d7123 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.088226 Aug 06 12:58:38.809500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1503/2996] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:38 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:38.926956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4718820b-21d3-4ce6-93a8-34d147cf8098 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:38.928209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4718820b-21d3-4ce6-93a8-34d147cf8098 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:38.934095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4718820b-21d3-4ce6-93a8-34d147cf8098 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:38.934565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4718820b-21d3-4ce6-93a8-34d147cf8098 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:38.934993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4718820b-21d3-4ce6-93a8-34d147cf8098 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:38.935670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4718820b-21d3-4ce6-93a8-34d147cf8098 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:38.936118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4718820b-21d3-4ce6-93a8-34d147cf8098 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:38.936559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4718820b-21d3-4ce6-93a8-34d147cf8098 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:39.062765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4718820b-21d3-4ce6-93a8-34d147cf8098 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:39.070504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4718820b-21d3-4ce6-93a8-34d147cf8098 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.147474 Aug 06 12:58:39.071051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1494/2997] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:38 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:39.217734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8bc23da5-f62e-4927-a09c-f49231129f01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:39.218283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8bc23da5-f62e-4927-a09c-f49231129f01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:39.224705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bc23da5-f62e-4927-a09c-f49231129f01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:39.225178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bc23da5-f62e-4927-a09c-f49231129f01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:39.225603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bc23da5-f62e-4927-a09c-f49231129f01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:39.226273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bc23da5-f62e-4927-a09c-f49231129f01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:39.226713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bc23da5-f62e-4927-a09c-f49231129f01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:39.227125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bc23da5-f62e-4927-a09c-f49231129f01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:39.351519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8bc23da5-f62e-4927-a09c-f49231129f01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:39.359659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8bc23da5-f62e-4927-a09c-f49231129f01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145866 Aug 06 12:58:39.360207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1504/2998] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:39 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:39.748450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:39.749059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:39.756023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:39.756527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:39.756960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:39.757636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:39.758086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:39.758509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:39.821330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:39.829355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e82597f6-bf81-4d7e-a2d7-3186dca9a390 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:39.829861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:39.829995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e82597f6-bf81-4d7e-a2d7-3186dca9a390 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:39.831230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:39.832387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2db07527-4a70-47af-b180-48178c146137 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.087854 Aug 06 12:58:39.832941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1495/2999] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:39 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:39.835974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e82597f6-bf81-4d7e-a2d7-3186dca9a390 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:39.836472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e82597f6-bf81-4d7e-a2d7-3186dca9a390 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:39.836903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e82597f6-bf81-4d7e-a2d7-3186dca9a390 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:39.837602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e82597f6-bf81-4d7e-a2d7-3186dca9a390 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:39.838047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e82597f6-bf81-4d7e-a2d7-3186dca9a390 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:39.838462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e82597f6-bf81-4d7e-a2d7-3186dca9a390 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:39.899084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e82597f6-bf81-4d7e-a2d7-3186dca9a390 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:39.906941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e82597f6-bf81-4d7e-a2d7-3186dca9a390 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.081552 Aug 06 12:58:39.907496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1505/3000] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:39 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:40.091353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b27a440b-2515-4f4b-ba3b-10987b7b9f83 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:40.091964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b27a440b-2515-4f4b-ba3b-10987b7b9f83 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:40.098036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b27a440b-2515-4f4b-ba3b-10987b7b9f83 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:40.098537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b27a440b-2515-4f4b-ba3b-10987b7b9f83 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:40.099449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b27a440b-2515-4f4b-ba3b-10987b7b9f83 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:40.100135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b27a440b-2515-4f4b-ba3b-10987b7b9f83 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:40.100613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b27a440b-2515-4f4b-ba3b-10987b7b9f83 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:40.101041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b27a440b-2515-4f4b-ba3b-10987b7b9f83 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:40.226354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b27a440b-2515-4f4b-ba3b-10987b7b9f83 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:40.234401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b27a440b-2515-4f4b-ba3b-10987b7b9f83 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146936 Aug 06 12:58:40.234960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1496/3001] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:40 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:40.380566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d8c02eb6-4c00-4ed8-b28c-aa6e3df8ccde tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:40.381176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d8c02eb6-4c00-4ed8-b28c-aa6e3df8ccde tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:40.387112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8c02eb6-4c00-4ed8-b28c-aa6e3df8ccde tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:40.387600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8c02eb6-4c00-4ed8-b28c-aa6e3df8ccde tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:40.388037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8c02eb6-4c00-4ed8-b28c-aa6e3df8ccde tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:40.388746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8c02eb6-4c00-4ed8-b28c-aa6e3df8ccde tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:40.389205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8c02eb6-4c00-4ed8-b28c-aa6e3df8ccde tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:40.389634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8c02eb6-4c00-4ed8-b28c-aa6e3df8ccde tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:40.520053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d8c02eb6-4c00-4ed8-b28c-aa6e3df8ccde tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:40.528395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d8c02eb6-4c00-4ed8-b28c-aa6e3df8ccde tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151731 Aug 06 12:58:40.528955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1506/3002] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:40 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:40.853607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:40.854246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:40.860943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:40.861425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:40.861858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:40.862541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:40.862995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:40.863423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:40.923892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:40.926477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a1a82f2c-384d-41d5-9f98-d191db227e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:40.927163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a1a82f2c-384d-41d5-9f98-d191db227e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:40.932325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:40.933587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a82f2c-384d-41d5-9f98-d191db227e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:40.933839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:40.934077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a82f2c-384d-41d5-9f98-d191db227e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:40.934513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a82f2c-384d-41d5-9f98-d191db227e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:40.934962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7f6b3d70-bc1a-49af-b56a-98a27981913f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.085286 Aug 06 12:58:40.935196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a82f2c-384d-41d5-9f98-d191db227e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:40.935561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1497/3003] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:40 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:40.935714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a82f2c-384d-41d5-9f98-d191db227e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:40.936063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1a82f2c-384d-41d5-9f98-d191db227e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:40.997342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a1a82f2c-384d-41d5-9f98-d191db227e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:41.005912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a1a82f2c-384d-41d5-9f98-d191db227e92 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082829 Aug 06 12:58:41.006467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1507/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:40 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:41.256416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dd99a53f-572c-41bb-bb0b-cb1dd30299fa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:41.256943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dd99a53f-572c-41bb-bb0b-cb1dd30299fa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:41.262902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd99a53f-572c-41bb-bb0b-cb1dd30299fa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:41.263382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd99a53f-572c-41bb-bb0b-cb1dd30299fa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:41.263815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd99a53f-572c-41bb-bb0b-cb1dd30299fa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:41.264511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd99a53f-572c-41bb-bb0b-cb1dd30299fa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:41.264958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd99a53f-572c-41bb-bb0b-cb1dd30299fa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:41.265377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd99a53f-572c-41bb-bb0b-cb1dd30299fa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:41.392183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dd99a53f-572c-41bb-bb0b-cb1dd30299fa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:41.400073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dd99a53f-572c-41bb-bb0b-cb1dd30299fa tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.148150 Aug 06 12:58:41.400666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1498/3005] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:41 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:41.550236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1791947c-8f75-4a97-97c7-36cc0a175903 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:41.550905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1791947c-8f75-4a97-97c7-36cc0a175903 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:41.557532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1791947c-8f75-4a97-97c7-36cc0a175903 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:41.558013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1791947c-8f75-4a97-97c7-36cc0a175903 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:41.558444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1791947c-8f75-4a97-97c7-36cc0a175903 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:41.559130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1791947c-8f75-4a97-97c7-36cc0a175903 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:41.559607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1791947c-8f75-4a97-97c7-36cc0a175903 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:41.560025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1791947c-8f75-4a97-97c7-36cc0a175903 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:41.686824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1791947c-8f75-4a97-97c7-36cc0a175903 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:41.694797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1791947c-8f75-4a97-97c7-36cc0a175903 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148400 Aug 06 12:58:41.695347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1508/3006] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:41 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:41.957805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:41.958857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:41.965311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:41.965784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:41.966212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:41.966888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:41.967338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:41.967758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:42.026608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-28443449-0ba9-4e33-bee6-f0d06c9f6f5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:42.027576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-28443449-0ba9-4e33-bee6-f0d06c9f6f5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:42.030939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:42.033658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28443449-0ba9-4e33-bee6-f0d06c9f6f5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:42.034140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28443449-0ba9-4e33-bee6-f0d06c9f6f5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:42.034569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28443449-0ba9-4e33-bee6-f0d06c9f6f5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:42.035284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28443449-0ba9-4e33-bee6-f0d06c9f6f5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:42.035732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28443449-0ba9-4e33-bee6-f0d06c9f6f5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:42.036152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28443449-0ba9-4e33-bee6-f0d06c9f6f5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:42.044603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:42.047109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:42.048881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dfb752b8-8fde-4539-b97b-fbdf5bda22ee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.094792 Aug 06 12:58:42.049743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1499/3007] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:41 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:42.102598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-28443449-0ba9-4e33-bee6-f0d06c9f6f5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:42.110689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-28443449-0ba9-4e33-bee6-f0d06c9f6f5e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.087964 Aug 06 12:58:42.111240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1509/3008] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:42 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:42.421222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-71306d5b-cb56-41f9-a76d-03055b80d12e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:42.422113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-71306d5b-cb56-41f9-a76d-03055b80d12e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:42.427994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71306d5b-cb56-41f9-a76d-03055b80d12e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:42.428510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71306d5b-cb56-41f9-a76d-03055b80d12e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:42.428944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71306d5b-cb56-41f9-a76d-03055b80d12e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:42.429625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71306d5b-cb56-41f9-a76d-03055b80d12e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:42.430076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71306d5b-cb56-41f9-a76d-03055b80d12e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:42.430496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71306d5b-cb56-41f9-a76d-03055b80d12e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:42.555471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-71306d5b-cb56-41f9-a76d-03055b80d12e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:42.563287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-71306d5b-cb56-41f9-a76d-03055b80d12e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.145964 Aug 06 12:58:42.563842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1500/3009] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:42 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:42.715549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1e8cd4f0-42b0-4091-a405-dfb96cb61392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:42.716098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1e8cd4f0-42b0-4091-a405-dfb96cb61392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:42.721968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e8cd4f0-42b0-4091-a405-dfb96cb61392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:42.722440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e8cd4f0-42b0-4091-a405-dfb96cb61392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:42.722864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e8cd4f0-42b0-4091-a405-dfb96cb61392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:42.723529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e8cd4f0-42b0-4091-a405-dfb96cb61392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:42.724043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e8cd4f0-42b0-4091-a405-dfb96cb61392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:42.724491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e8cd4f0-42b0-4091-a405-dfb96cb61392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:42.852107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e8cd4f0-42b0-4091-a405-dfb96cb61392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:42.860279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1e8cd4f0-42b0-4091-a405-dfb96cb61392 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148591 Aug 06 12:58:42.860846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1510/3010] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:42 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:43.071637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:43.072254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:43.078623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:43.079109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:43.079549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:43.080239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:43.080725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:43.081152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:43.130828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-44445ca1-cff1-4a51-a076-fce3dcaae4b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:43.131427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-44445ca1-cff1-4a51-a076-fce3dcaae4b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:43.137733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44445ca1-cff1-4a51-a076-fce3dcaae4b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:43.138213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44445ca1-cff1-4a51-a076-fce3dcaae4b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:43.138643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44445ca1-cff1-4a51-a076-fce3dcaae4b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:43.139318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44445ca1-cff1-4a51-a076-fce3dcaae4b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:43.139768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44445ca1-cff1-4a51-a076-fce3dcaae4b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:43.140187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44445ca1-cff1-4a51-a076-fce3dcaae4b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:43.147179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:43.155531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:43.157037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:43.158162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fd57abb3-3bfb-4a0f-899b-51e6e3219da3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.091047 Aug 06 12:58:43.158710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1501/3011] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:43 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:43.207196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-44445ca1-cff1-4a51-a076-fce3dcaae4b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:43.215082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-44445ca1-cff1-4a51-a076-fce3dcaae4b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.088048 Aug 06 12:58:43.215641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1511/3012] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:43 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:43.543944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 12:58:43.544118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 12:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 12:58:43.584487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff08b0e1-8242-4273-a1d4-8f480be91c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:43.585096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ff08b0e1-8242-4273-a1d4-8f480be91c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:43.591011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff08b0e1-8242-4273-a1d4-8f480be91c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:43.591486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff08b0e1-8242-4273-a1d4-8f480be91c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:43.591913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff08b0e1-8242-4273-a1d4-8f480be91c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:43.592610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff08b0e1-8242-4273-a1d4-8f480be91c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:43.593057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff08b0e1-8242-4273-a1d4-8f480be91c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:43.593474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff08b0e1-8242-4273-a1d4-8f480be91c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:43.722119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ff08b0e1-8242-4273-a1d4-8f480be91c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:43.730563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff08b0e1-8242-4273-a1d4-8f480be91c4c tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.150291 Aug 06 12:58:43.731111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1502/3013] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:43 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:43.882524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-df028608-7514-4e65-96d5-cba09512da17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:43.883130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-df028608-7514-4e65-96d5-cba09512da17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:43.889007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df028608-7514-4e65-96d5-cba09512da17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:43.889482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df028608-7514-4e65-96d5-cba09512da17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:43.889913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df028608-7514-4e65-96d5-cba09512da17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:43.890589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df028608-7514-4e65-96d5-cba09512da17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:43.891037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df028608-7514-4e65-96d5-cba09512da17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:43.891459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df028608-7514-4e65-96d5-cba09512da17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:44.025349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-df028608-7514-4e65-96d5-cba09512da17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:44.033207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-df028608-7514-4e65-96d5-cba09512da17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155024 Aug 06 12:58:44.033768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1512/3014] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:43 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:44.180756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:44.181357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:44.187927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:44.188444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:44.188874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:44.189552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:44.190001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:44.190418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:44.235835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-262fe552-94b1-4090-b8eb-c9db166c0698 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:44.236411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-262fe552-94b1-4090-b8eb-c9db166c0698 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:44.243115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-262fe552-94b1-4090-b8eb-c9db166c0698 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:44.243590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-262fe552-94b1-4090-b8eb-c9db166c0698 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:44.244021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-262fe552-94b1-4090-b8eb-c9db166c0698 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:44.244726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-262fe552-94b1-4090-b8eb-c9db166c0698 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:44.245176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-262fe552-94b1-4090-b8eb-c9db166c0698 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:44.245596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-262fe552-94b1-4090-b8eb-c9db166c0698 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:44.251654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:44.260861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:44.262461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:44.263597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-63c8a4d0-90d9-4aae-83ce-f06045a92e41 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086767 Aug 06 12:58:44.264153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1503/3015] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:44 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:44.307125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-262fe552-94b1-4090-b8eb-c9db166c0698 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:44.315052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-262fe552-94b1-4090-b8eb-c9db166c0698 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.083356 Aug 06 12:58:44.315599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1513/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:44 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:44.751720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9535c5ec-6e15-4602-93a0-47d6c7506d60 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:44.752339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9535c5ec-6e15-4602-93a0-47d6c7506d60 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:44.758208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9535c5ec-6e15-4602-93a0-47d6c7506d60 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:44.758679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9535c5ec-6e15-4602-93a0-47d6c7506d60 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:44.759103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9535c5ec-6e15-4602-93a0-47d6c7506d60 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:44.759770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9535c5ec-6e15-4602-93a0-47d6c7506d60 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:44.760213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9535c5ec-6e15-4602-93a0-47d6c7506d60 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:44.760651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9535c5ec-6e15-4602-93a0-47d6c7506d60 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:44.891825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9535c5ec-6e15-4602-93a0-47d6c7506d60 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:44.894052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:44.900971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9535c5ec-6e15-4602-93a0-47d6c7506d60 tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.153074 Aug 06 12:58:44.901529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1504/3017] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:44 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:45.054286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f5225bcc-c4fc-4f5c-bc47-02e49cf21c12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:45.054886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f5225bcc-c4fc-4f5c-bc47-02e49cf21c12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:45.060751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5225bcc-c4fc-4f5c-bc47-02e49cf21c12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:45.061224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5225bcc-c4fc-4f5c-bc47-02e49cf21c12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:45.061650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5225bcc-c4fc-4f5c-bc47-02e49cf21c12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:45.062319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5225bcc-c4fc-4f5c-bc47-02e49cf21c12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:45.062764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5225bcc-c4fc-4f5c-bc47-02e49cf21c12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:45.063176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5225bcc-c4fc-4f5c-bc47-02e49cf21c12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:45.186989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f5225bcc-c4fc-4f5c-bc47-02e49cf21c12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:45.194737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f5225bcc-c4fc-4f5c-bc47-02e49cf21c12 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.144296 Aug 06 12:58:45.195283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1514/3018] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:45 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:45.288269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:45.288916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:45.300166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:45.300690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:45.301125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:45.301938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:45.302518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:45.302951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:45.335640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3fb402e5-6830-43d0-8062-403a2afa377c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:45.337692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3fb402e5-6830-43d0-8062-403a2afa377c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:45.344191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb402e5-6830-43d0-8062-403a2afa377c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:45.344791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb402e5-6830-43d0-8062-403a2afa377c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:45.345292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb402e5-6830-43d0-8062-403a2afa377c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:45.346176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb402e5-6830-43d0-8062-403a2afa377c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:45.346711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb402e5-6830-43d0-8062-403a2afa377c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:45.347098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fb402e5-6830-43d0-8062-403a2afa377c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:45.368421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:45.376747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:45.378251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:45.379391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-520db807-e980-4594-9670-9f3aff73e63e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.097118 Aug 06 12:58:45.385872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1505/3019] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:45 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:45.412187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3fb402e5-6830-43d0-8062-403a2afa377c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:45.420179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3fb402e5-6830-43d0-8062-403a2afa377c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.089077 Aug 06 12:58:45.420762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1515/3020] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:45 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:45.922375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-02826c28-27d0-4d39-abe1-aa822df6e87e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:45.922971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-02826c28-27d0-4d39-abe1-aa822df6e87e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] [instance: e5982553-7c7c-4d67-bb7e-13ac69cfc674] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:45.929404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02826c28-27d0-4d39-abe1-aa822df6e87e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:45.929877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02826c28-27d0-4d39-abe1-aa822df6e87e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:45.930303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02826c28-27d0-4d39-abe1-aa822df6e87e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:45.930972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02826c28-27d0-4d39-abe1-aa822df6e87e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:45.931414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02826c28-27d0-4d39-abe1-aa822df6e87e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:45.931829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02826c28-27d0-4d39-abe1-aa822df6e87e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:46.057121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-02826c28-27d0-4d39-abe1-aa822df6e87e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc91d2e9cd24694a5aa62e9d579c8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cc3ab0fa2d47008fc45f600ff1613a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:46.065110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-02826c28-27d0-4d39-abe1-aa822df6e87e tempest-VolumesSnapshotTestJSON-1038996424 tempest-VolumesSnapshotTestJSON-1038996424-project] 10.222.0.20 "GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674" status: 200 len: 1560 microversion: 2.1 time: 0.146533 Aug 06 12:58:46.065737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1506/3021] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:45 2022] GET /compute/v2.1/servers/e5982553-7c7c-4d67-bb7e-13ac69cfc674 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:46.216462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7cf8a9b7-b4fd-459b-b358-c3441b8d6fbf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:46.217011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7cf8a9b7-b4fd-459b-b358-c3441b8d6fbf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:46.223036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf8a9b7-b4fd-459b-b358-c3441b8d6fbf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:46.223999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf8a9b7-b4fd-459b-b358-c3441b8d6fbf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:46.224483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf8a9b7-b4fd-459b-b358-c3441b8d6fbf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:46.225166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf8a9b7-b4fd-459b-b358-c3441b8d6fbf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:46.225618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf8a9b7-b4fd-459b-b358-c3441b8d6fbf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:46.226042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cf8a9b7-b4fd-459b-b358-c3441b8d6fbf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:46.351473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7cf8a9b7-b4fd-459b-b358-c3441b8d6fbf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:46.359616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7cf8a9b7-b4fd-459b-b358-c3441b8d6fbf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147342 Aug 06 12:58:46.360166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1516/3022] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:46 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:46.402646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:46.403249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:46.409548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:46.410021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:46.410447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:46.411610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:46.412056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:46.412557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:46.440468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-895c5089-48d6-49f9-b726-2b5e7233f0f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:46.441064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-895c5089-48d6-49f9-b726-2b5e7233f0f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:46.446848 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-895c5089-48d6-49f9-b726-2b5e7233f0f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:46.447321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-895c5089-48d6-49f9-b726-2b5e7233f0f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:46.447747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-895c5089-48d6-49f9-b726-2b5e7233f0f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:46.448443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-895c5089-48d6-49f9-b726-2b5e7233f0f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:46.448887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-895c5089-48d6-49f9-b726-2b5e7233f0f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:46.449295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-895c5089-48d6-49f9-b726-2b5e7233f0f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:46.476052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:46.484832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:46.486432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:46.487580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-30054268-2112-47bc-be7a-5fce7caa4e6f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.088790 Aug 06 12:58:46.488137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1507/3023] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:46 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:58:46.511411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-895c5089-48d6-49f9-b726-2b5e7233f0f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:46.519183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-895c5089-48d6-49f9-b726-2b5e7233f0f5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082527 Aug 06 12:58:46.519734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1517/3024] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:46 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:47.381862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-efdeef81-c970-449a-8f21-6fd1f040fef9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:47.382472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-efdeef81-c970-449a-8f21-6fd1f040fef9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:47.388417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efdeef81-c970-449a-8f21-6fd1f040fef9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:47.388901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efdeef81-c970-449a-8f21-6fd1f040fef9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:47.389334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efdeef81-c970-449a-8f21-6fd1f040fef9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:47.390019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efdeef81-c970-449a-8f21-6fd1f040fef9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:47.390473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efdeef81-c970-449a-8f21-6fd1f040fef9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:47.390897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efdeef81-c970-449a-8f21-6fd1f040fef9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:47.510086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:47.510695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:47.516911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-efdeef81-c970-449a-8f21-6fd1f040fef9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:47.517382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:47.517559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:47.517983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:47.518661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:47.519103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:47.519517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:47.524887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-efdeef81-c970-449a-8f21-6fd1f040fef9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147530 Aug 06 12:58:47.525458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1508/3025] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:47 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:47.538536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c81737e7-6226-44d3-9fb8-abd3f132845b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:47.539137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c81737e7-6226-44d3-9fb8-abd3f132845b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:47.544888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c81737e7-6226-44d3-9fb8-abd3f132845b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:47.545368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c81737e7-6226-44d3-9fb8-abd3f132845b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:47.545800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c81737e7-6226-44d3-9fb8-abd3f132845b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:47.546477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c81737e7-6226-44d3-9fb8-abd3f132845b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:47.546928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c81737e7-6226-44d3-9fb8-abd3f132845b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:47.547349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c81737e7-6226-44d3-9fb8-abd3f132845b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:47.584905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:47.593296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:47.594778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:47.595895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-75712e60-f67e-41e1-a128-bec6ea8c3886 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.089705 Aug 06 12:58:47.596491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1518/3026] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:47 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:58:47.608813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c81737e7-6226-44d3-9fb8-abd3f132845b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:47.617492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c81737e7-6226-44d3-9fb8-abd3f132845b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.082607 Aug 06 12:58:47.618037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1509/3027] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:47 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:48.546095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5b6ea75a-c873-41b9-9635-831fd5cb16f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:48.546677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5b6ea75a-c873-41b9-9635-831fd5cb16f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:48.553141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b6ea75a-c873-41b9-9635-831fd5cb16f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:48.553609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b6ea75a-c873-41b9-9635-831fd5cb16f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:48.554033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b6ea75a-c873-41b9-9635-831fd5cb16f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:48.554703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b6ea75a-c873-41b9-9635-831fd5cb16f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:48.555146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b6ea75a-c873-41b9-9635-831fd5cb16f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:48.555561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5b6ea75a-c873-41b9-9635-831fd5cb16f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:48.618821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:48.619402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:48.625898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:48.626381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:48.626815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:48.627511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:48.627964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:48.628428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:48.683637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5b6ea75a-c873-41b9-9635-831fd5cb16f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:48.685894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:48.689267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:48.694012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5b6ea75a-c873-41b9-9635-831fd5cb16f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151723 Aug 06 12:58:48.694588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1519/3028] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:48 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:48.698330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:48.699024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8689887d-6899-4294-8fd4-dfd109ed2aac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:48.699615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8689887d-6899-4294-8fd4-dfd109ed2aac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:48.699883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:48.701066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f6b2767e-a8df-4330-897a-c57621298a21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 200 len: 1444 microversion: 2.20 time: 0.086115 Aug 06 12:58:48.701911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1510/3029] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:48 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:58:48.705571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8689887d-6899-4294-8fd4-dfd109ed2aac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:48.706050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8689887d-6899-4294-8fd4-dfd109ed2aac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:48.706482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8689887d-6899-4294-8fd4-dfd109ed2aac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:48.707166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8689887d-6899-4294-8fd4-dfd109ed2aac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:48.707615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8689887d-6899-4294-8fd4-dfd109ed2aac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:48.708720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8689887d-6899-4294-8fd4-dfd109ed2aac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:48.723655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7fa54b0f-433f-4e1c-a1f5-287b54032449 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '.version_select at 0x7f541a900c10>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:48.738982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:48.748150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7fa54b0f-433f-4e1c-a1f5-287b54032449 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205071423" status: 204 len: 0 microversion: 2.20 time: 0.028180 Aug 06 12:58:48.748970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1511/3030] 10.222.0.20 () {60 vars in 1259 bytes} [Sat Aug 6 12:58:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205071423 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 06 12:58:48.778739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8689887d-6899-4294-8fd4-dfd109ed2aac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:48.786987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8689887d-6899-4294-8fd4-dfd109ed2aac tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 200 len: 1371 microversion: 2.1 time: 0.091439 Aug 06 12:58:48.787646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1520/3031] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:48 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:48.808329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d35aa28e-3325-4774-a7b4-33df9a186ed4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '.version_select at 0x7f541a9f03a0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:48.827308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d35aa28e-3325-4774-a7b4-33df9a186ed4 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-410279104" status: 202 len: 0 microversion: 2.1 time: 0.022972 Aug 06 12:58:48.827886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1512/3032] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Aug 6 12:58:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-410279104 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 12:58:49.661596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ae09540-d981-480d-a302-49e2e802a96f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'create', calling method: .version_select at 0x7f541f172820>, body: {"keypair": {"name": "tempest-keypair-326204628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2c7m+DIuvNldOYzd7NTOvz13Zrj0v7Oyq13HASEBXzjS7ClB2/SBCMACij7t2f/H6LpRAvK7aZ0TjjiuajzkK7I3dVyxjRWP3+EQ/4mpILyJsWkADzsQXQKExujj7N7A=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:58:49.672102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:49.678632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-2ae09540-d981-480d-a302-49e2e802a96f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Getting quotas for project 9ce267dd4f15447fae8aef5e99cbb018. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:58:49.682626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-2ae09540-d981-480d-a302-49e2e802a96f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Getting quotas for user 257ddc018c33406aa47e7e7129943ae3 and project 9ce267dd4f15447fae8aef5e99cbb018. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:58:49.706815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2ae09540-d981-480d-a302-49e2e802a96f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049728 Aug 06 12:58:49.707413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1521/3033] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Aug 6 12:58:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 12:58:49.715174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a2ed8393-b475-4f33-8c15-09bae564ea7e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:49.715814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a2ed8393-b475-4f33-8c15-09bae564ea7e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:49.723166 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2ed8393-b475-4f33-8c15-09bae564ea7e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:49.724413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2ed8393-b475-4f33-8c15-09bae564ea7e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:49.725043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2ed8393-b475-4f33-8c15-09bae564ea7e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:49.725920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2ed8393-b475-4f33-8c15-09bae564ea7e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:49.726542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2ed8393-b475-4f33-8c15-09bae564ea7e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:49.726960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2ed8393-b475-4f33-8c15-09bae564ea7e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:49.782550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-576f1cd5-4499-467d-98ec-4d17e11227e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: .version_select at 0x7f541f19baf0>, body: {"keypair": {"name": "tempest-keypair-577736125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU2m9/jU3totwqL15AN1jSat1rYBKaEz/DA9Kbx6+s2aztWlrsHRSkZ7T6USLb6wj6Jnz3JGsKk5TQldjZmOrT72EIdzkd20KvHVAL+okhypG8XY85ko9ywr2UsN46dsg=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:58:49.801043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-576f1cd5-4499-467d-98ec-4d17e11227e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:58:49.805177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-576f1cd5-4499-467d-98ec-4d17e11227e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for user 1125a0b93c9d45ccb2d3f28f188dfd04 and project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:58:49.842013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-576f1cd5-4499-467d-98ec-4d17e11227e6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063233 Aug 06 12:58:49.842940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1522/3034] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Aug 6 12:58:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:58:49.869586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a2ed8393-b475-4f33-8c15-09bae564ea7e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:49.877766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a2ed8393-b475-4f33-8c15-09bae564ea7e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.166622 Aug 06 12:58:49.878327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1513/3035] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:49 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:50.903106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e04de799-1bea-4e48-a781-e3f363f3d219 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:50.903718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e04de799-1bea-4e48-a781-e3f363f3d219 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:50.911679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e04de799-1bea-4e48-a781-e3f363f3d219 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:50.912479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e04de799-1bea-4e48-a781-e3f363f3d219 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:50.912931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e04de799-1bea-4e48-a781-e3f363f3d219 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:50.913638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e04de799-1bea-4e48-a781-e3f363f3d219 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:50.914090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e04de799-1bea-4e48-a781-e3f363f3d219 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:50.914511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e04de799-1bea-4e48-a781-e3f363f3d219 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:51.135326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e04de799-1bea-4e48-a781-e3f363f3d219 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:51.143904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e04de799-1bea-4e48-a781-e3f363f3d219 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.245600 Aug 06 12:58:51.144593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1523/3036] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:50 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:51.300248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-245153117", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6d29da4-1787-4a36-8551-8fbcda8f3c70"}], "security_groups": [{"name": "tempest-securitygroup--985021658"}], "key_name": "tempest-keypair-326204628", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:58:51.431012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] validate_networks() for [('e6d29da4-1787-4a36-8551-8fbcda8f3c70', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:58:51.464666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:51.465157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:51.471345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:51.472103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:51.472610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:51.473343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:51.473793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:51.474211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:51.499799 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 12:58:51.560131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [1412f918-8261-4b45-bd67-d2432e518c03] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 12:58:51.860505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:58:51.860986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:58:51.861458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:58:51.861865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:58:51.862274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:58:51.871270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:51.871746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:51.872178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:51.872923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:51.873376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:51.873801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:51.890641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Getting quotas for project 9ce267dd4f15447fae8aef5e99cbb018. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:58:51.894441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Getting quotas for user 257ddc018c33406aa47e7e7129943ae3 and project 9ce267dd4f15447fae8aef5e99cbb018. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:58:51.905037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:58:51.907228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:58:51.953413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0184154c-4aa0-47b9-b912-41d3a3433226 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.657384 Aug 06 12:58:51.954053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1514/3037] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Aug 6 12:58:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 12:58:51.959798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1231290252", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eedc16df-3c43-4b30-b37e-93e76fe94c3d"}], "security_groups": [{"name": "tempest-securitygroup--1299991527"}], "key_name": "tempest-keypair-577736125", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:58:52.069979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] validate_networks() for [('eedc16df-3c43-4b30-b37e-93e76fe94c3d', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 12:58:52.447419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 12:58:52.448004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 12:58:52.448485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 12:58:52.448896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 12:58:52.449314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 12:58:52.458506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:52.458987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:52.459421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:52.460145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:52.460688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:52.461114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:52.478824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 12:58:52.483061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for user 1125a0b93c9d45ccb2d3f28f188dfd04 and project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 12:58:52.494044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 12:58:52.496155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 12:58:52.540857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-10db1118-adc1-4eb2-b8e5-eeb5e5cae09e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.585744 Aug 06 12:58:52.541487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1515/3038] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 12:58:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 12:58:52.545994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:52.546598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:52.552618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:52.553096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:52.553546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:52.554209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:52.554660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:52.555107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:52.568359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [1412f918-8261-4b45-bd67-d2432e518c03] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46900. Aug 06 12:58:52.600705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6139ae08-b98c-4cf2-92c1-d40e6ef60dec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 204 len: 0 microversion: 2.1 time: 1.139808 Aug 06 12:58:52.602743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1524/3039] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 12:58:51 2022] DELETE /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 12:58:52.609243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-599ea33a-602d-417f-bede-74c354ebbc5a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:52.610021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-599ea33a-602d-417f-bede-74c354ebbc5a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:52.619227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599ea33a-602d-417f-bede-74c354ebbc5a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:52.619798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599ea33a-602d-417f-bede-74c354ebbc5a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:52.620296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599ea33a-602d-417f-bede-74c354ebbc5a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:52.621070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599ea33a-602d-417f-bede-74c354ebbc5a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:52.621581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599ea33a-602d-417f-bede-74c354ebbc5a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:52.622065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-599ea33a-602d-417f-bede-74c354ebbc5a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:52.642650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:52.652840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:52.654592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:52.655878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4ce91ced-3c66-417b-a3e4-43d765305a64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1276 microversion: 2.20 time: 0.113477 Aug 06 12:58:52.656943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1516/3040] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:52 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:52.662730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61841aac-bc99-41d0-b262-1d90081f6ab0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:52.664556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61841aac-bc99-41d0-b262-1d90081f6ab0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:52.735147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61841aac-bc99-41d0-b262-1d90081f6ab0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:52.742301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61841aac-bc99-41d0-b262-1d90081f6ab0 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1241 microversion: 2.1 time: 0.083842 Aug 06 12:58:52.743004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1517/3041] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:52 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:52.753266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f2ed1484-bf59-4321-95f2-471b4b8a3381 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:52.753904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f2ed1484-bf59-4321-95f2-471b4b8a3381 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:52.760077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2ed1484-bf59-4321-95f2-471b4b8a3381 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:52.760581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2ed1484-bf59-4321-95f2-471b4b8a3381 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:52.761655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2ed1484-bf59-4321-95f2-471b4b8a3381 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:52.762350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2ed1484-bf59-4321-95f2-471b4b8a3381 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:52.762798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2ed1484-bf59-4321-95f2-471b4b8a3381 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:52.763220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2ed1484-bf59-4321-95f2-471b4b8a3381 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:52.774710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-599ea33a-602d-417f-bede-74c354ebbc5a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:52.783017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-599ea33a-602d-417f-bede-74c354ebbc5a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.178859 Aug 06 12:58:52.784756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1525/3042] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:52 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:52.909224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f2ed1484-bf59-4321-95f2-471b4b8a3381 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:52.917449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f2ed1484-bf59-4321-95f2-471b4b8a3381 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.173640 Aug 06 12:58:52.918096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1518/3043] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:53.679502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:53.680225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:53.687860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:53.688712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:53.689250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:53.690101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:53.690801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:53.691344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:53.757986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:53.762935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8610ec01-4e29-4017-a91c-f4d83974e8c1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:53.763676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8610ec01-4e29-4017-a91c-f4d83974e8c1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:53.770567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8610ec01-4e29-4017-a91c-f4d83974e8c1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:53.771155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8610ec01-4e29-4017-a91c-f4d83974e8c1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:53.771655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8610ec01-4e29-4017-a91c-f4d83974e8c1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:53.772449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8610ec01-4e29-4017-a91c-f4d83974e8c1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:53.773152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8610ec01-4e29-4017-a91c-f4d83974e8c1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:53.773794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8610ec01-4e29-4017-a91c-f4d83974e8c1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:53.775268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:53.777418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:53.778724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1b3490f1-5539-480b-aa20-8372b59bb24b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1338 microversion: 2.20 time: 0.103962 Aug 06 12:58:53.779629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1526/3044] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:53 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:58:53.807107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8f383f67-c869-4641-bd48-eba3d6ef2071 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:53.807789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8f383f67-c869-4641-bd48-eba3d6ef2071 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:53.814442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f383f67-c869-4641-bd48-eba3d6ef2071 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:53.815258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f383f67-c869-4641-bd48-eba3d6ef2071 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:53.815961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f383f67-c869-4641-bd48-eba3d6ef2071 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:53.816726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f383f67-c869-4641-bd48-eba3d6ef2071 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:53.817353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f383f67-c869-4641-bd48-eba3d6ef2071 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:53.817765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f383f67-c869-4641-bd48-eba3d6ef2071 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:53.878183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8610ec01-4e29-4017-a91c-f4d83974e8c1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:53.889139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8610ec01-4e29-4017-a91c-f4d83974e8c1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1301 microversion: 2.1 time: 0.130008 Aug 06 12:58:53.903189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1519/3045] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:53 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1301 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:53.938073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d1be3c55-16f7-4229-bff2-e84a25d03265 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:53.938773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d1be3c55-16f7-4229-bff2-e84a25d03265 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:53.949635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1be3c55-16f7-4229-bff2-e84a25d03265 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:53.950220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1be3c55-16f7-4229-bff2-e84a25d03265 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:53.950935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1be3c55-16f7-4229-bff2-e84a25d03265 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:53.951823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1be3c55-16f7-4229-bff2-e84a25d03265 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:53.952342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1be3c55-16f7-4229-bff2-e84a25d03265 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:53.952778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1be3c55-16f7-4229-bff2-e84a25d03265 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:53.985628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8f383f67-c869-4641-bd48-eba3d6ef2071 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:53.999618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8f383f67-c869-4641-bd48-eba3d6ef2071 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.196751 Aug 06 12:58:54.005283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1527/3046] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:53 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:54.232811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d1be3c55-16f7-4229-bff2-e84a25d03265 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:54.240655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d1be3c55-16f7-4229-bff2-e84a25d03265 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.306372 Aug 06 12:58:54.241222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1520/3047] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:54.802566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:54.803164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:54.809369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:54.809839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:54.810265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:54.810937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:54.811378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:54.811791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:54.910735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cb155943-dc2e-4938-a479-7e832595dcde tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:54.912142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cb155943-dc2e-4938-a479-7e832595dcde tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:54.918891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb155943-dc2e-4938-a479-7e832595dcde tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:54.919916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb155943-dc2e-4938-a479-7e832595dcde tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:54.919916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb155943-dc2e-4938-a479-7e832595dcde tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:54.920511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb155943-dc2e-4938-a479-7e832595dcde tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:54.921153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb155943-dc2e-4938-a479-7e832595dcde tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:54.921576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb155943-dc2e-4938-a479-7e832595dcde tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:54.956102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:54.964116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:54.965650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:54.966741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6b220258-fe00-4ebb-9e5f-d4920abad6f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1405 microversion: 2.20 time: 0.168664 Aug 06 12:58:54.967289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1528/3048] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:54 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:55.013647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cb155943-dc2e-4938-a479-7e832595dcde tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:55.022073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cb155943-dc2e-4938-a479-7e832595dcde tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1299 microversion: 2.1 time: 0.115553 Aug 06 12:58:55.022341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-529185b5-111b-486a-bf8f-99c37dc7f613 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:55.022883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1521/3049] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:54 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:55.023516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-529185b5-111b-486a-bf8f-99c37dc7f613 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:55.029803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-529185b5-111b-486a-bf8f-99c37dc7f613 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:55.030416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-529185b5-111b-486a-bf8f-99c37dc7f613 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:55.031055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-529185b5-111b-486a-bf8f-99c37dc7f613 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:55.031960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-529185b5-111b-486a-bf8f-99c37dc7f613 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:55.032515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-529185b5-111b-486a-bf8f-99c37dc7f613 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:55.033050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-529185b5-111b-486a-bf8f-99c37dc7f613 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:55.162918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-529185b5-111b-486a-bf8f-99c37dc7f613 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:55.171056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-529185b5-111b-486a-bf8f-99c37dc7f613 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152920 Aug 06 12:58:55.171742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1529/3050] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:55 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:55.262557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-86db80f0-5311-4da0-b7e0-1f6c80c39571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:55.263472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-86db80f0-5311-4da0-b7e0-1f6c80c39571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:55.276679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86db80f0-5311-4da0-b7e0-1f6c80c39571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:55.277190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86db80f0-5311-4da0-b7e0-1f6c80c39571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:55.277626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86db80f0-5311-4da0-b7e0-1f6c80c39571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:55.279143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86db80f0-5311-4da0-b7e0-1f6c80c39571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:55.280226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86db80f0-5311-4da0-b7e0-1f6c80c39571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:55.281197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-86db80f0-5311-4da0-b7e0-1f6c80c39571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:55.325611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-a30432fd-4aeb-4cc0-bf3a-cca820c563f2 req-cb1bbeb4-9cb9-4932-9dc9-9fdf6a18bafa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9511bf2-6616-4fd6-9739-6c901a1da341", "tag": "5653f9b3-1473-445f-9406-188160ed27ac"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:58:55.343452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a30432fd-4aeb-4cc0-bf3a-cca820c563f2 req-cb1bbeb4-9cb9-4932-9dc9-9fdf6a18bafa service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:55.344321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a30432fd-4aeb-4cc0-bf3a-cca820c563f2 req-cb1bbeb4-9cb9-4932-9dc9-9fdf6a18bafa service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:55.345049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a30432fd-4aeb-4cc0-bf3a-cca820c563f2 req-cb1bbeb4-9cb9-4932-9dc9-9fdf6a18bafa service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:55.359695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-a30432fd-4aeb-4cc0-bf3a-cca820c563f2 req-cb1bbeb4-9cb9-4932-9dc9-9fdf6a18bafa service nova] Creating event network-changed:5653f9b3-1473-445f-9406-188160ed27ac for instance e9511bf2-6616-4fd6-9739-6c901a1da341 on hv-cinder-85199 Aug 06 12:58:55.363340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR oslo.messaging._drivers.impl_rabbit [req-a30432fd-4aeb-4cc0-bf3a-cca820c563f2 req-cb1bbeb4-9cb9-4932-9dc9-9fdf6a18bafa service nova] [df166ca8-d168-4caa-9946-ed3e7267bc65] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 12:58:55.471193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-86db80f0-5311-4da0-b7e0-1f6c80c39571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:55.480156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-86db80f0-5311-4da0-b7e0-1f6c80c39571 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.222824 Aug 06 12:58:55.480764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1530/3051] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:55.989069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:55.990649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:55.997741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:55.998207 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:55.998735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:55.999672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:56.000574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:56.001214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:56.140616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:56.149856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:56.151348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:56.152549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3730f5f4-f1b6-4cdb-a1f0-bd325b6c2c08 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1405 microversion: 2.20 time: 0.167393 Aug 06 12:58:56.153110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1531/3052] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:55 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:58:56.157693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-34b38fc1-7fd9-4d01-93fc-14a3b600b7db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:56.158299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-34b38fc1-7fd9-4d01-93fc-14a3b600b7db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:56.164407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34b38fc1-7fd9-4d01-93fc-14a3b600b7db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:56.164969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34b38fc1-7fd9-4d01-93fc-14a3b600b7db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:56.165403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34b38fc1-7fd9-4d01-93fc-14a3b600b7db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:56.166094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34b38fc1-7fd9-4d01-93fc-14a3b600b7db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:56.166542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34b38fc1-7fd9-4d01-93fc-14a3b600b7db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:56.166965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34b38fc1-7fd9-4d01-93fc-14a3b600b7db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:56.306437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34b38fc1-7fd9-4d01-93fc-14a3b600b7db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:56.317779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-34b38fc1-7fd9-4d01-93fc-14a3b600b7db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1367 microversion: 2.1 time: 0.162937 Aug 06 12:58:56.318380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1532/3053] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:56 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:56.323485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-055b4033-9298-4f96-a025-5d732a3b3b23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:56.324020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-055b4033-9298-4f96-a025-5d732a3b3b23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:56.330296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-055b4033-9298-4f96-a025-5d732a3b3b23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:56.330783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-055b4033-9298-4f96-a025-5d732a3b3b23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:56.331211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-055b4033-9298-4f96-a025-5d732a3b3b23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:56.332105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-055b4033-9298-4f96-a025-5d732a3b3b23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:56.332586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-055b4033-9298-4f96-a025-5d732a3b3b23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:56.333006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-055b4033-9298-4f96-a025-5d732a3b3b23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:56.370087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [req-a30432fd-4aeb-4cc0-bf3a-cca820c563f2 req-cb1bbeb4-9cb9-4932-9dc9-9fdf6a18bafa service nova] [df166ca8-d168-4caa-9946-ed3e7267bc65] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46946. Aug 06 12:58:56.373843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-a30432fd-4aeb-4cc0-bf3a-cca820c563f2 req-cb1bbeb4-9cb9-4932-9dc9-9fdf6a18bafa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.153615 Aug 06 12:58:56.374712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1522/3054] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:58:56.465283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-055b4033-9298-4f96-a025-5d732a3b3b23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:56.473083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-055b4033-9298-4f96-a025-5d732a3b3b23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153594 Aug 06 12:58:56.473644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1533/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:56 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:56.501771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3314bef3-0a94-437f-b512-0352ec28b929 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:56.502457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3314bef3-0a94-437f-b512-0352ec28b929 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:56.509234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3314bef3-0a94-437f-b512-0352ec28b929 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:56.509908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3314bef3-0a94-437f-b512-0352ec28b929 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:56.510345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3314bef3-0a94-437f-b512-0352ec28b929 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:56.511031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3314bef3-0a94-437f-b512-0352ec28b929 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:56.511480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3314bef3-0a94-437f-b512-0352ec28b929 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:56.511899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3314bef3-0a94-437f-b512-0352ec28b929 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:56.642651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3314bef3-0a94-437f-b512-0352ec28b929 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:56.650405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3314bef3-0a94-437f-b512-0352ec28b929 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152924 Aug 06 12:58:56.650964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1523/3056] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:57.175616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:57.176219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:57.182696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:57.183175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:57.183603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:57.184277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:57.184746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:57.185164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:57.315528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:57.324392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:57.325892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:57.327003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d1b0d13d-e425-4510-a694-6f0b6fabcc93 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1405 microversion: 2.20 time: 0.155285 Aug 06 12:58:57.327556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1534/3057] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:57 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:57.338710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-da1f7c9e-f310-4e29-a77d-ca9ec4e95ea6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:57.339320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-da1f7c9e-f310-4e29-a77d-ca9ec4e95ea6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:57.345684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da1f7c9e-f310-4e29-a77d-ca9ec4e95ea6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:57.346162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da1f7c9e-f310-4e29-a77d-ca9ec4e95ea6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:57.346595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da1f7c9e-f310-4e29-a77d-ca9ec4e95ea6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:57.347281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da1f7c9e-f310-4e29-a77d-ca9ec4e95ea6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:57.347737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da1f7c9e-f310-4e29-a77d-ca9ec4e95ea6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:57.348694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da1f7c9e-f310-4e29-a77d-ca9ec4e95ea6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:57.475660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-da1f7c9e-f310-4e29-a77d-ca9ec4e95ea6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:57.483307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-da1f7c9e-f310-4e29-a77d-ca9ec4e95ea6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1367 microversion: 2.1 time: 0.148337 Aug 06 12:58:57.483867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1524/3058] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:57 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:57.495324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cc43d903-6b4e-4ef5-bdbd-d49dda3f8bda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:57.495959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cc43d903-6b4e-4ef5-bdbd-d49dda3f8bda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:57.501844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc43d903-6b4e-4ef5-bdbd-d49dda3f8bda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:57.502326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc43d903-6b4e-4ef5-bdbd-d49dda3f8bda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:57.502754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc43d903-6b4e-4ef5-bdbd-d49dda3f8bda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:57.503432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc43d903-6b4e-4ef5-bdbd-d49dda3f8bda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:57.503885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc43d903-6b4e-4ef5-bdbd-d49dda3f8bda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:57.504327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc43d903-6b4e-4ef5-bdbd-d49dda3f8bda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:57.631299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cc43d903-6b4e-4ef5-bdbd-d49dda3f8bda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:57.639447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cc43d903-6b4e-4ef5-bdbd-d49dda3f8bda tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147913 Aug 06 12:58:57.640008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1535/3059] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:57 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:57.670838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-18299f04-9e7f-4aa8-808f-3de233cf7c45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:57.674789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-18299f04-9e7f-4aa8-808f-3de233cf7c45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:57.681390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18299f04-9e7f-4aa8-808f-3de233cf7c45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:57.681878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18299f04-9e7f-4aa8-808f-3de233cf7c45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:57.682325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18299f04-9e7f-4aa8-808f-3de233cf7c45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:57.683017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18299f04-9e7f-4aa8-808f-3de233cf7c45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:57.683503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18299f04-9e7f-4aa8-808f-3de233cf7c45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:57.683932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18299f04-9e7f-4aa8-808f-3de233cf7c45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:57.813216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-18299f04-9e7f-4aa8-808f-3de233cf7c45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:57.821069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-18299f04-9e7f-4aa8-808f-3de233cf7c45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154119 Aug 06 12:58:57.821638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1525/3060] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:58.349299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:58.350074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:58.356798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:58.357538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:58.357975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:58.358667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:58.359129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:58.359544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:58.431997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-601f2d37-25a6-4614-a246-bf095781bc80 req-a3890d0c-f458-4d87-84aa-e974c09b3030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b858f51c-0983-4ec0-85a2-d955c78aff33", "tag": "dd9248b7-558b-4e95-8d9a-8f51f4c58eb8"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:58:58.441344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-601f2d37-25a6-4614-a246-bf095781bc80 req-a3890d0c-f458-4d87-84aa-e974c09b3030 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:58.442346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-601f2d37-25a6-4614-a246-bf095781bc80 req-a3890d0c-f458-4d87-84aa-e974c09b3030 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:58.442870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-601f2d37-25a6-4614-a246-bf095781bc80 req-a3890d0c-f458-4d87-84aa-e974c09b3030 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:58.453689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-601f2d37-25a6-4614-a246-bf095781bc80 req-a3890d0c-f458-4d87-84aa-e974c09b3030 service nova] Creating event network-changed:dd9248b7-558b-4e95-8d9a-8f51f4c58eb8 for instance b858f51c-0983-4ec0-85a2-d955c78aff33 on hv-cinder-85199 Aug 06 12:58:58.459143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-601f2d37-25a6-4614-a246-bf095781bc80 req-a3890d0c-f458-4d87-84aa-e974c09b3030 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030712 Aug 06 12:58:58.459733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1526/3061] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:58:58.495398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:58.497751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:58.505486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4bd83e8c-3bd4-4d5f-81fc-58d30f4ef4b3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:58.506189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4bd83e8c-3bd4-4d5f-81fc-58d30f4ef4b3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:58.506843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:58.508629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:58.509924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1188db5d-55a6-4e2a-b6e5-e43106601af7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1405 microversion: 2.20 time: 0.164495 Aug 06 12:58:58.510661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1536/3062] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:58 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:58.512509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bd83e8c-3bd4-4d5f-81fc-58d30f4ef4b3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:58.512992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bd83e8c-3bd4-4d5f-81fc-58d30f4ef4b3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:58.513429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bd83e8c-3bd4-4d5f-81fc-58d30f4ef4b3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:58.514120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bd83e8c-3bd4-4d5f-81fc-58d30f4ef4b3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:58.514573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bd83e8c-3bd4-4d5f-81fc-58d30f4ef4b3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:58.515016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bd83e8c-3bd4-4d5f-81fc-58d30f4ef4b3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:58.517741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:58.660261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dfd01ffb-067a-47f2-8a54-73c14ad49a35 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:58.660975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dfd01ffb-067a-47f2-8a54-73c14ad49a35 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:58.667628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfd01ffb-067a-47f2-8a54-73c14ad49a35 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:58.668113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfd01ffb-067a-47f2-8a54-73c14ad49a35 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:58.668583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfd01ffb-067a-47f2-8a54-73c14ad49a35 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:58.669276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfd01ffb-067a-47f2-8a54-73c14ad49a35 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:58.669728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfd01ffb-067a-47f2-8a54-73c14ad49a35 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:58.670147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dfd01ffb-067a-47f2-8a54-73c14ad49a35 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:58.792943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4bd83e8c-3bd4-4d5f-81fc-58d30f4ef4b3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:58.800663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4bd83e8c-3bd4-4d5f-81fc-58d30f4ef4b3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1367 microversion: 2.1 time: 0.299811 Aug 06 12:58:58.802079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1527/3063] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:58 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:58.806702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dfd01ffb-067a-47f2-8a54-73c14ad49a35 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:58.819158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dfd01ffb-067a-47f2-8a54-73c14ad49a35 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.162921 Aug 06 12:58:58.819950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1537/3064] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:58 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:58:58.842163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-421aaa2c-5ef7-4267-a7f7-6bcc4b5f5552 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:58.842798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-421aaa2c-5ef7-4267-a7f7-6bcc4b5f5552 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:58.849220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-421aaa2c-5ef7-4267-a7f7-6bcc4b5f5552 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:58.849838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-421aaa2c-5ef7-4267-a7f7-6bcc4b5f5552 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:58.850289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-421aaa2c-5ef7-4267-a7f7-6bcc4b5f5552 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:58.851025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-421aaa2c-5ef7-4267-a7f7-6bcc4b5f5552 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:58.851471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-421aaa2c-5ef7-4267-a7f7-6bcc4b5f5552 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:58.851900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-421aaa2c-5ef7-4267-a7f7-6bcc4b5f5552 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:59.145414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-421aaa2c-5ef7-4267-a7f7-6bcc4b5f5552 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:59.153822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-421aaa2c-5ef7-4267-a7f7-6bcc4b5f5552 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.315588 Aug 06 12:58:59.154390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1528/3065] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:59.532361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:59.532890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:59.539910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:59.540424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:59.540854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:59.541530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:59.541983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:59.542400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:59.667810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:59.675574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:59.677145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:59.678239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-153c0009-70dd-4239-aed4-d6f0acbbb960 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1405 microversion: 2.20 time: 0.149842 Aug 06 12:58:59.678791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1538/3066] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:58:59 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:58:59.821827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-46bd856f-893a-43a3-bc61-89dba0175b7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:59.822439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-46bd856f-893a-43a3-bc61-89dba0175b7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:59.829829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46bd856f-893a-43a3-bc61-89dba0175b7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:59.830315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46bd856f-893a-43a3-bc61-89dba0175b7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:59.830788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46bd856f-893a-43a3-bc61-89dba0175b7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:59.831483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46bd856f-893a-43a3-bc61-89dba0175b7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:59.831977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46bd856f-893a-43a3-bc61-89dba0175b7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:59.832994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46bd856f-893a-43a3-bc61-89dba0175b7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:59.844394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-45f507c5-4e05-479c-bf6a-06229ec27363 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:58:59.845000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-45f507c5-4e05-479c-bf6a-06229ec27363 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:58:59.846894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=8 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:58:59.852402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45f507c5-4e05-479c-bf6a-06229ec27363 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:59.852830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45f507c5-4e05-479c-bf6a-06229ec27363 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:59.853262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45f507c5-4e05-479c-bf6a-06229ec27363 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:59.853948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45f507c5-4e05-479c-bf6a-06229ec27363 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:58:59.854398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45f507c5-4e05-479c-bf6a-06229ec27363 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:58:59.854817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45f507c5-4e05-479c-bf6a-06229ec27363 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:58:59.960547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-46bd856f-893a-43a3-bc61-89dba0175b7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:59.967929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-46bd856f-893a-43a3-bc61-89dba0175b7f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1367 microversion: 2.1 time: 0.150019 Aug 06 12:58:59.968518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1529/3067] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:59 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:58:59.986381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-45f507c5-4e05-479c-bf6a-06229ec27363 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:58:59.994781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-45f507c5-4e05-479c-bf6a-06229ec27363 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154239 Aug 06 12:58:59.995339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1539/3068] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:58:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:00.175203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-59f329d5-6c41-4754-bf1c-3da5a6b9471f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:00.175725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-59f329d5-6c41-4754-bf1c-3da5a6b9471f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:00.182060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59f329d5-6c41-4754-bf1c-3da5a6b9471f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:00.182541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59f329d5-6c41-4754-bf1c-3da5a6b9471f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:00.182971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59f329d5-6c41-4754-bf1c-3da5a6b9471f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:00.183644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59f329d5-6c41-4754-bf1c-3da5a6b9471f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:00.184091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59f329d5-6c41-4754-bf1c-3da5a6b9471f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:00.184533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-59f329d5-6c41-4754-bf1c-3da5a6b9471f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:00.314005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-59f329d5-6c41-4754-bf1c-3da5a6b9471f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:00.322469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-59f329d5-6c41-4754-bf1c-3da5a6b9471f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151196 Aug 06 12:59:00.323025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1530/3069] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:00.704235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:00.704871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:00.712198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:00.712704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:00.713159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:00.713843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:00.714286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:00.714703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:00.842239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:00.850814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:00.852326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:00.853424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b5b335b6-601b-4dbb-a15f-ab3784fc1109 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1405 microversion: 2.20 time: 0.156285 Aug 06 12:59:00.853976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1540/3070] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:59:00 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:59:00.989000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-91183918-a242-4ae5-af12-b1288b3eb971 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:00.990405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-91183918-a242-4ae5-af12-b1288b3eb971 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:01.001425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91183918-a242-4ae5-af12-b1288b3eb971 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:01.002391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91183918-a242-4ae5-af12-b1288b3eb971 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:01.002391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91183918-a242-4ae5-af12-b1288b3eb971 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:01.003068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91183918-a242-4ae5-af12-b1288b3eb971 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:01.003516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91183918-a242-4ae5-af12-b1288b3eb971 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:01.003939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91183918-a242-4ae5-af12-b1288b3eb971 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:01.017483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6b4ffacb-8aec-4b41-82bd-86b44ba3afa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:01.018897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6b4ffacb-8aec-4b41-82bd-86b44ba3afa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:01.026982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b4ffacb-8aec-4b41-82bd-86b44ba3afa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:01.027601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b4ffacb-8aec-4b41-82bd-86b44ba3afa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:01.028137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b4ffacb-8aec-4b41-82bd-86b44ba3afa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:01.028955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b4ffacb-8aec-4b41-82bd-86b44ba3afa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:01.029508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b4ffacb-8aec-4b41-82bd-86b44ba3afa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:01.030049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b4ffacb-8aec-4b41-82bd-86b44ba3afa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:01.155493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-91183918-a242-4ae5-af12-b1288b3eb971 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:01.163082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-91183918-a242-4ae5-af12-b1288b3eb971 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1367 microversion: 2.1 time: 0.177986 Aug 06 12:59:01.163732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1531/3071] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:00 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:01.177006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6b4ffacb-8aec-4b41-82bd-86b44ba3afa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:01.184893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6b4ffacb-8aec-4b41-82bd-86b44ba3afa4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.171394 Aug 06 12:59:01.185446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1541/3072] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:01 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:01.342814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4e1fa1a7-0d40-41e1-90f0-ddd38046a509 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:01.343421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4e1fa1a7-0d40-41e1-90f0-ddd38046a509 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:01.349380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e1fa1a7-0d40-41e1-90f0-ddd38046a509 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:01.349904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e1fa1a7-0d40-41e1-90f0-ddd38046a509 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:01.350334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e1fa1a7-0d40-41e1-90f0-ddd38046a509 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:01.351011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e1fa1a7-0d40-41e1-90f0-ddd38046a509 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:01.351482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e1fa1a7-0d40-41e1-90f0-ddd38046a509 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:01.351905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e1fa1a7-0d40-41e1-90f0-ddd38046a509 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:01.482483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4e1fa1a7-0d40-41e1-90f0-ddd38046a509 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:01.491042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4e1fa1a7-0d40-41e1-90f0-ddd38046a509 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152046 Aug 06 12:59:01.491606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1532/3073] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:01 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:01.875034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:01.875594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:01.882037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:01.882545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:01.883092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:01.883811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:01.884261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:01.884822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:02.019612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:02.027678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:02.029484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:02.030648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1de4b450-eb01-4c79-86d0-23da1d5f7c54 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1405 microversion: 2.20 time: 0.159607 Aug 06 12:59:02.031427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1542/3074] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:59:01 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:59:02.183101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d15545f-17bc-4088-a43c-f7488f878349 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:02.183708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0d15545f-17bc-4088-a43c-f7488f878349 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:02.190019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d15545f-17bc-4088-a43c-f7488f878349 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:02.190494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d15545f-17bc-4088-a43c-f7488f878349 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:02.190926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d15545f-17bc-4088-a43c-f7488f878349 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:02.191631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d15545f-17bc-4088-a43c-f7488f878349 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:02.192077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d15545f-17bc-4088-a43c-f7488f878349 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:02.192523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d15545f-17bc-4088-a43c-f7488f878349 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:02.206451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e4d2ad1b-f516-4805-8f18-d1798716867e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:02.207060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e4d2ad1b-f516-4805-8f18-d1798716867e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:02.213401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4d2ad1b-f516-4805-8f18-d1798716867e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:02.213878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4d2ad1b-f516-4805-8f18-d1798716867e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:02.214306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4d2ad1b-f516-4805-8f18-d1798716867e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:02.214992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4d2ad1b-f516-4805-8f18-d1798716867e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:02.215444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4d2ad1b-f516-4805-8f18-d1798716867e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:02.215864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4d2ad1b-f516-4805-8f18-d1798716867e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:02.328042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0d15545f-17bc-4088-a43c-f7488f878349 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:02.336395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0d15545f-17bc-4088-a43c-f7488f878349 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1367 microversion: 2.1 time: 0.157003 Aug 06 12:59:02.336978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1533/3075] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:02 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:02.346768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e4d2ad1b-f516-4805-8f18-d1798716867e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:02.355359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e4d2ad1b-f516-4805-8f18-d1798716867e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152691 Aug 06 12:59:02.355910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1543/3076] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:02 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:02.511036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4330460d-e448-4eea-92d8-610af6be9ced tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:02.511590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4330460d-e448-4eea-92d8-610af6be9ced tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:02.513446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:02.519051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4330460d-e448-4eea-92d8-610af6be9ced tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:02.519527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4330460d-e448-4eea-92d8-610af6be9ced tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:02.520487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4330460d-e448-4eea-92d8-610af6be9ced tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:02.521163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4330460d-e448-4eea-92d8-610af6be9ced tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:02.521609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4330460d-e448-4eea-92d8-610af6be9ced tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:02.522047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4330460d-e448-4eea-92d8-610af6be9ced tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:02.647591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4330460d-e448-4eea-92d8-610af6be9ced tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:02.655447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4330460d-e448-4eea-92d8-610af6be9ced tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148269 Aug 06 12:59:02.656010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1534/3077] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:03.056873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:03.057476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:03.063835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:03.064321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:03.064760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:03.065456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:03.065890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:03.066304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:03.191322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=14 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:03.200055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:03.208907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:03.210002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:03.211225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ba2002d3-8876-470a-ad09-ad68b9f1dcdd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1405 microversion: 2.20 time: 0.158222 Aug 06 12:59:03.211778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1544/3078] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:59:03 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:59:03.256761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-4b684600-8ee7-4edc-99a7-3269ff8f6cf4 req-fd75d134-0f2d-451f-814a-60942eab4628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9511bf2-6616-4fd6-9739-6c901a1da341", "name": "network-vif-plugged", "status": "completed", "tag": "5653f9b3-1473-445f-9406-188160ed27ac"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:59:03.266169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-4b684600-8ee7-4edc-99a7-3269ff8f6cf4 req-fd75d134-0f2d-451f-814a-60942eab4628 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:03.266656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-4b684600-8ee7-4edc-99a7-3269ff8f6cf4 req-fd75d134-0f2d-451f-814a-60942eab4628 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:03.267618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-4b684600-8ee7-4edc-99a7-3269ff8f6cf4 req-fd75d134-0f2d-451f-814a-60942eab4628 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:03.278331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-4b684600-8ee7-4edc-99a7-3269ff8f6cf4 req-fd75d134-0f2d-451f-814a-60942eab4628 service nova] Creating event network-vif-plugged:5653f9b3-1473-445f-9406-188160ed27ac for instance e9511bf2-6616-4fd6-9739-6c901a1da341 on hv-cinder-85199 Aug 06 12:59:03.283463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-4b684600-8ee7-4edc-99a7-3269ff8f6cf4 req-fd75d134-0f2d-451f-814a-60942eab4628 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096909 Aug 06 12:59:03.284183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1535/3079] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:59:03.358705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7680e99a-7e88-4db2-87dd-a17b70e84759 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:03.359342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7680e99a-7e88-4db2-87dd-a17b70e84759 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:03.365974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7680e99a-7e88-4db2-87dd-a17b70e84759 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:03.366453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7680e99a-7e88-4db2-87dd-a17b70e84759 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:03.366908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7680e99a-7e88-4db2-87dd-a17b70e84759 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:03.367586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7680e99a-7e88-4db2-87dd-a17b70e84759 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:03.368061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7680e99a-7e88-4db2-87dd-a17b70e84759 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:03.368541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7680e99a-7e88-4db2-87dd-a17b70e84759 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:03.376076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d745cfd0-1190-4bca-b558-f64615eff4ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:03.376872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d745cfd0-1190-4bca-b558-f64615eff4ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:03.383122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d745cfd0-1190-4bca-b558-f64615eff4ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:03.383539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d745cfd0-1190-4bca-b558-f64615eff4ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:03.384157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d745cfd0-1190-4bca-b558-f64615eff4ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:03.384983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d745cfd0-1190-4bca-b558-f64615eff4ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:03.385527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d745cfd0-1190-4bca-b558-f64615eff4ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:03.385985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d745cfd0-1190-4bca-b558-f64615eff4ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:03.523480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7680e99a-7e88-4db2-87dd-a17b70e84759 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:03.530894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7680e99a-7e88-4db2-87dd-a17b70e84759 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1367 microversion: 2.1 time: 0.176217 Aug 06 12:59:03.531458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1545/3080] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:03 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:03.566297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d745cfd0-1190-4bca-b558-f64615eff4ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:03.574431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d745cfd0-1190-4bca-b558-f64615eff4ff tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.202488 Aug 06 12:59:03.574992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1536/3081] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:03 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:03.676769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e8720544-c0a6-4a6e-8037-219e7d445a63 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:03.677302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e8720544-c0a6-4a6e-8037-219e7d445a63 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:03.683126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8720544-c0a6-4a6e-8037-219e7d445a63 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:03.683594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8720544-c0a6-4a6e-8037-219e7d445a63 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:03.684018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8720544-c0a6-4a6e-8037-219e7d445a63 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:03.684707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8720544-c0a6-4a6e-8037-219e7d445a63 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:03.685152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8720544-c0a6-4a6e-8037-219e7d445a63 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:03.685568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8720544-c0a6-4a6e-8037-219e7d445a63 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:03.816362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e8720544-c0a6-4a6e-8037-219e7d445a63 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:03.824182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e8720544-c0a6-4a6e-8037-219e7d445a63 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151952 Aug 06 12:59:03.825004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1546/3082] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:04.233869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:04.234431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:04.240829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:04.241312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:04.241748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:04.242431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:04.242885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:04.243309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:04.368206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:04.376050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:04.377580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:04.378672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-343549bf-1d35-4885-85bd-86a4e3e84103 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1405 microversion: 2.20 time: 0.149129 Aug 06 12:59:04.379748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1537/3083] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:59:04 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:59:04.552168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3a28e2bd-cc41-4596-8961-0114a633b323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:04.552808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3a28e2bd-cc41-4596-8961-0114a633b323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:04.559274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a28e2bd-cc41-4596-8961-0114a633b323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:04.559753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a28e2bd-cc41-4596-8961-0114a633b323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:04.560188 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a28e2bd-cc41-4596-8961-0114a633b323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:04.560895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a28e2bd-cc41-4596-8961-0114a633b323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:04.561348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a28e2bd-cc41-4596-8961-0114a633b323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:04.561771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a28e2bd-cc41-4596-8961-0114a633b323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:04.595256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fd1bbc7f-3238-4173-8f83-802dfe8c512f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:04.595868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fd1bbc7f-3238-4173-8f83-802dfe8c512f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:04.601837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd1bbc7f-3238-4173-8f83-802dfe8c512f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:04.602325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd1bbc7f-3238-4173-8f83-802dfe8c512f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:04.602768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd1bbc7f-3238-4173-8f83-802dfe8c512f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:04.603463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd1bbc7f-3238-4173-8f83-802dfe8c512f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:04.603915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd1bbc7f-3238-4173-8f83-802dfe8c512f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:04.604359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd1bbc7f-3238-4173-8f83-802dfe8c512f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:04.689218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3a28e2bd-cc41-4596-8961-0114a633b323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:04.697518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3a28e2bd-cc41-4596-8961-0114a633b323 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1367 microversion: 2.1 time: 0.149657 Aug 06 12:59:04.698229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1547/3084] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:04 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:04.734534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd1bbc7f-3238-4173-8f83-802dfe8c512f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:04.742883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fd1bbc7f-3238-4173-8f83-802dfe8c512f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151407 Aug 06 12:59:04.743446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1538/3085] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:04 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:04.845234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3389b96f-1665-4cec-887b-6f8d4ca66099 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:04.845839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3389b96f-1665-4cec-887b-6f8d4ca66099 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:04.852178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3389b96f-1665-4cec-887b-6f8d4ca66099 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:04.852695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3389b96f-1665-4cec-887b-6f8d4ca66099 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:04.853139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3389b96f-1665-4cec-887b-6f8d4ca66099 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:04.853822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3389b96f-1665-4cec-887b-6f8d4ca66099 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:04.854276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3389b96f-1665-4cec-887b-6f8d4ca66099 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:04.854699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3389b96f-1665-4cec-887b-6f8d4ca66099 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:04.984863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3389b96f-1665-4cec-887b-6f8d4ca66099 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:04.993460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3389b96f-1665-4cec-887b-6f8d4ca66099 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152023 Aug 06 12:59:04.994033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1548/3086] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:05.297239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-425f11e3-87bb-4528-b92d-37ed85eb6128 req-b5c48119-cf4a-480d-9a6c-7365dcae514a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b858f51c-0983-4ec0-85a2-d955c78aff33", "name": "network-vif-plugged", "status": "completed", "tag": "dd9248b7-558b-4e95-8d9a-8f51f4c58eb8"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:59:05.307311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-425f11e3-87bb-4528-b92d-37ed85eb6128 req-b5c48119-cf4a-480d-9a6c-7365dcae514a service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:05.307745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-425f11e3-87bb-4528-b92d-37ed85eb6128 req-b5c48119-cf4a-480d-9a6c-7365dcae514a service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:05.308167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-425f11e3-87bb-4528-b92d-37ed85eb6128 req-b5c48119-cf4a-480d-9a6c-7365dcae514a service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:05.320720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-425f11e3-87bb-4528-b92d-37ed85eb6128 req-b5c48119-cf4a-480d-9a6c-7365dcae514a service nova] Creating event network-vif-plugged:dd9248b7-558b-4e95-8d9a-8f51f4c58eb8 for instance b858f51c-0983-4ec0-85a2-d955c78aff33 on hv-cinder-85199 Aug 06 12:59:05.325668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-425f11e3-87bb-4528-b92d-37ed85eb6128 req-b5c48119-cf4a-480d-9a6c-7365dcae514a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032154 Aug 06 12:59:05.326247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1539/3087] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:59:05.401641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:05.402211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:05.408210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:05.408716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:05.409150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:05.409857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:05.410873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:05.411303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:05.543957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:05.551852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:05.553374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:05.554473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-269d83b1-dbaf-459f-9e3c-34037c949666 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1405 microversion: 2.20 time: 0.156873 Aug 06 12:59:05.555023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1549/3088] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:59:05 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 12:59:05.718908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f81afaef-e1de-494b-9fb9-b77eed9fcaee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:05.719723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f81afaef-e1de-494b-9fb9-b77eed9fcaee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:05.727390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f81afaef-e1de-494b-9fb9-b77eed9fcaee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:05.727945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f81afaef-e1de-494b-9fb9-b77eed9fcaee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:05.728403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f81afaef-e1de-494b-9fb9-b77eed9fcaee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:05.729104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f81afaef-e1de-494b-9fb9-b77eed9fcaee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:05.729560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f81afaef-e1de-494b-9fb9-b77eed9fcaee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:05.729984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f81afaef-e1de-494b-9fb9-b77eed9fcaee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:05.764797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6bc1051b-e438-4907-bc75-29cdd0602f00 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:05.765482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6bc1051b-e438-4907-bc75-29cdd0602f00 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:05.772861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bc1051b-e438-4907-bc75-29cdd0602f00 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:05.773345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bc1051b-e438-4907-bc75-29cdd0602f00 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:05.773802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bc1051b-e438-4907-bc75-29cdd0602f00 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:05.774491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bc1051b-e438-4907-bc75-29cdd0602f00 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:05.774942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bc1051b-e438-4907-bc75-29cdd0602f00 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:05.775363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6bc1051b-e438-4907-bc75-29cdd0602f00 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:05.905562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6bc1051b-e438-4907-bc75-29cdd0602f00 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:05.913873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6bc1051b-e438-4907-bc75-29cdd0602f00 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152910 Aug 06 12:59:05.914779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1550/3089] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:05.931543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f81afaef-e1de-494b-9fb9-b77eed9fcaee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:05.939040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f81afaef-e1de-494b-9fb9-b77eed9fcaee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1367 microversion: 2.1 time: 0.224729 Aug 06 12:59:05.939602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1540/3090] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:05 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:06.014647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a998da35-c5cd-4707-8a9e-ad9a2b2ec4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:06.015243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a998da35-c5cd-4707-8a9e-ad9a2b2ec4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:06.021238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a998da35-c5cd-4707-8a9e-ad9a2b2ec4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:06.021720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a998da35-c5cd-4707-8a9e-ad9a2b2ec4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:06.022155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a998da35-c5cd-4707-8a9e-ad9a2b2ec4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:06.022833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a998da35-c5cd-4707-8a9e-ad9a2b2ec4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:06.023287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a998da35-c5cd-4707-8a9e-ad9a2b2ec4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:06.023708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a998da35-c5cd-4707-8a9e-ad9a2b2ec4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:06.152713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a998da35-c5cd-4707-8a9e-ad9a2b2ec4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:06.160697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a998da35-c5cd-4707-8a9e-ad9a2b2ec4a7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149968 Aug 06 12:59:06.161256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1551/3091] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:06.576873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:06.577456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:06.583849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:06.584344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:06.584778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:06.585457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:06.585902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:06.586320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:06.712637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:06.720493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:06.721969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:06.723765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-84229bac-21e6-4308-bcd2-4dea2f598b96 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1597 microversion: 2.20 time: 0.150775 Aug 06 12:59:06.724345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1541/3092] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 12:59:06 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1597 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 12:59:06.748777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-acca5e8c-e3d0-4b51-acb5-0951a40b70dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:06.749329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-acca5e8c-e3d0-4b51-acb5-0951a40b70dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:06.755499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acca5e8c-e3d0-4b51-acb5-0951a40b70dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:06.756100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acca5e8c-e3d0-4b51-acb5-0951a40b70dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:06.756937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acca5e8c-e3d0-4b51-acb5-0951a40b70dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:06.757696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acca5e8c-e3d0-4b51-acb5-0951a40b70dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:06.758152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acca5e8c-e3d0-4b51-acb5-0951a40b70dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:06.758576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acca5e8c-e3d0-4b51-acb5-0951a40b70dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:06.836842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-acca5e8c-e3d0-4b51-acb5-0951a40b70dd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092240 Aug 06 12:59:06.837431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1552/3093] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Aug 6 12:59:06 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 12:59:06.934959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0814c447-5096-47e1-ab00-bcbef276348e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:06.935564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0814c447-5096-47e1-ab00-bcbef276348e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:06.943668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0814c447-5096-47e1-ab00-bcbef276348e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:06.944151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0814c447-5096-47e1-ab00-bcbef276348e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:06.944638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0814c447-5096-47e1-ab00-bcbef276348e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:06.945344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0814c447-5096-47e1-ab00-bcbef276348e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:06.945790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0814c447-5096-47e1-ab00-bcbef276348e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:06.946210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0814c447-5096-47e1-ab00-bcbef276348e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:06.959945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d653b064-0ade-4d71-9587-498fc1b9b94c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:06.960602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d653b064-0ade-4d71-9587-498fc1b9b94c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:06.966718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d653b064-0ade-4d71-9587-498fc1b9b94c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:06.967419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d653b064-0ade-4d71-9587-498fc1b9b94c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:06.967983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d653b064-0ade-4d71-9587-498fc1b9b94c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:06.968712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d653b064-0ade-4d71-9587-498fc1b9b94c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:06.969159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d653b064-0ade-4d71-9587-498fc1b9b94c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:06.969643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d653b064-0ade-4d71-9587-498fc1b9b94c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:07.104995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0814c447-5096-47e1-ab00-bcbef276348e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:07.113413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0814c447-5096-47e1-ab00-bcbef276348e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.182211 Aug 06 12:59:07.114101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1542/3094] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:07.181175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-63f5ba9a-dee5-4e08-9f32-576d45b54fe2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:07.181946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-63f5ba9a-dee5-4e08-9f32-576d45b54fe2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:07.183978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:07.189423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63f5ba9a-dee5-4e08-9f32-576d45b54fe2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:07.189968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63f5ba9a-dee5-4e08-9f32-576d45b54fe2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:07.190401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63f5ba9a-dee5-4e08-9f32-576d45b54fe2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:07.191086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63f5ba9a-dee5-4e08-9f32-576d45b54fe2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:07.192087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63f5ba9a-dee5-4e08-9f32-576d45b54fe2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:07.192531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63f5ba9a-dee5-4e08-9f32-576d45b54fe2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:07.265746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d653b064-0ade-4d71-9587-498fc1b9b94c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:07.268059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:07.275262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d653b064-0ade-4d71-9587-498fc1b9b94c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1367 microversion: 2.1 time: 0.319982 Aug 06 12:59:07.275837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1553/3095] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:06 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:07.339034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-63f5ba9a-dee5-4e08-9f32-576d45b54fe2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:07.348671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-63f5ba9a-dee5-4e08-9f32-576d45b54fe2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.171180 Aug 06 12:59:07.349274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1543/3096] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:07.914762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-2c737fe8-f9ce-49ca-a943-9fd3f850eba3 req-94d39aeb-740e-4c8a-a04b-9e03ab6072f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9511bf2-6616-4fd6-9739-6c901a1da341", "tag": "5653f9b3-1473-445f-9406-188160ed27ac"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:59:07.924363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-2c737fe8-f9ce-49ca-a943-9fd3f850eba3 req-94d39aeb-740e-4c8a-a04b-9e03ab6072f9 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:07.924834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-2c737fe8-f9ce-49ca-a943-9fd3f850eba3 req-94d39aeb-740e-4c8a-a04b-9e03ab6072f9 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:07.925254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-2c737fe8-f9ce-49ca-a943-9fd3f850eba3 req-94d39aeb-740e-4c8a-a04b-9e03ab6072f9 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:07.936877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-2c737fe8-f9ce-49ca-a943-9fd3f850eba3 req-94d39aeb-740e-4c8a-a04b-9e03ab6072f9 service nova] Creating event network-changed:5653f9b3-1473-445f-9406-188160ed27ac for instance e9511bf2-6616-4fd6-9739-6c901a1da341 on hv-cinder-85199 Aug 06 12:59:07.941902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-2c737fe8-f9ce-49ca-a943-9fd3f850eba3 req-94d39aeb-740e-4c8a-a04b-9e03ab6072f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089717 Aug 06 12:59:07.942478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1554/3097] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:59:08.135202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3917f10a-199c-4854-943d-0060c809165f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:08.135953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3917f10a-199c-4854-943d-0060c809165f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:08.142613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3917f10a-199c-4854-943d-0060c809165f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:08.143225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3917f10a-199c-4854-943d-0060c809165f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:08.143767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3917f10a-199c-4854-943d-0060c809165f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:08.144624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3917f10a-199c-4854-943d-0060c809165f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:08.145181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3917f10a-199c-4854-943d-0060c809165f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:08.145846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3917f10a-199c-4854-943d-0060c809165f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:08.297330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e27defb8-8921-481d-9b5a-f13c6f477fa6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:08.298034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e27defb8-8921-481d-9b5a-f13c6f477fa6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:08.304678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e27defb8-8921-481d-9b5a-f13c6f477fa6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:08.305414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e27defb8-8921-481d-9b5a-f13c6f477fa6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:08.306156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e27defb8-8921-481d-9b5a-f13c6f477fa6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:08.307047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e27defb8-8921-481d-9b5a-f13c6f477fa6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:08.307661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e27defb8-8921-481d-9b5a-f13c6f477fa6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:08.308256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e27defb8-8921-481d-9b5a-f13c6f477fa6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:08.359391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3917f10a-199c-4854-943d-0060c809165f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:08.369986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3917f10a-199c-4854-943d-0060c809165f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.238373 Aug 06 12:59:08.384331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1544/3098] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:08.389482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0e44f258-cdde-4b67-b8e2-64e98d08dbdd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:08.390335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0e44f258-cdde-4b67-b8e2-64e98d08dbdd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:08.397495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e44f258-cdde-4b67-b8e2-64e98d08dbdd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:08.398231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e44f258-cdde-4b67-b8e2-64e98d08dbdd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:08.398854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e44f258-cdde-4b67-b8e2-64e98d08dbdd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:08.399753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e44f258-cdde-4b67-b8e2-64e98d08dbdd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:08.400404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e44f258-cdde-4b67-b8e2-64e98d08dbdd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:08.401040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e44f258-cdde-4b67-b8e2-64e98d08dbdd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:08.404311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:08.481980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e27defb8-8921-481d-9b5a-f13c6f477fa6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:08.495176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e27defb8-8921-481d-9b5a-f13c6f477fa6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1556 microversion: 2.1 time: 0.201906 Aug 06 12:59:08.496849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1555/3099] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:08 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1556 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:08.517295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de0e6842-00bd-4f8f-8470-d208b977f067 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:08.518114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-de0e6842-00bd-4f8f-8470-d208b977f067 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:08.526250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de0e6842-00bd-4f8f-8470-d208b977f067 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:08.527048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de0e6842-00bd-4f8f-8470-d208b977f067 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:08.527684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de0e6842-00bd-4f8f-8470-d208b977f067 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:08.528620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de0e6842-00bd-4f8f-8470-d208b977f067 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:08.529217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de0e6842-00bd-4f8f-8470-d208b977f067 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:08.529865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de0e6842-00bd-4f8f-8470-d208b977f067 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:08.617343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0e44f258-cdde-4b67-b8e2-64e98d08dbdd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:08.637834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0e44f258-cdde-4b67-b8e2-64e98d08dbdd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.252051 Aug 06 12:59:08.638631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1545/3100] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:08 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:08.830844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-de0e6842-00bd-4f8f-8470-d208b977f067 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.318431 Aug 06 12:59:08.832633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1556/3101] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Aug 6 12:59:08 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-interface => generated 284 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 12:59:09.391129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9169f1d4-7a0b-4ef4-953c-9d58b2802ba2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:09.391907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9169f1d4-7a0b-4ef4-953c-9d58b2802ba2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:09.398387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9169f1d4-7a0b-4ef4-953c-9d58b2802ba2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:09.398965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9169f1d4-7a0b-4ef4-953c-9d58b2802ba2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:09.399471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9169f1d4-7a0b-4ef4-953c-9d58b2802ba2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:09.400233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9169f1d4-7a0b-4ef4-953c-9d58b2802ba2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:09.400803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9169f1d4-7a0b-4ef4-953c-9d58b2802ba2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:09.401304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9169f1d4-7a0b-4ef4-953c-9d58b2802ba2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:09.530320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9169f1d4-7a0b-4ef4-953c-9d58b2802ba2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:09.538734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9169f1d4-7a0b-4ef4-953c-9d58b2802ba2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151506 Aug 06 12:59:09.539298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1546/3102] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:09.660998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b06ab3be-9162-4bcb-9e02-88449298800f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:09.661582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b06ab3be-9162-4bcb-9e02-88449298800f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:09.667372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b06ab3be-9162-4bcb-9e02-88449298800f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:09.667854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b06ab3be-9162-4bcb-9e02-88449298800f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:09.668284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b06ab3be-9162-4bcb-9e02-88449298800f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:09.668996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b06ab3be-9162-4bcb-9e02-88449298800f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:09.669444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b06ab3be-9162-4bcb-9e02-88449298800f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:09.669864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b06ab3be-9162-4bcb-9e02-88449298800f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:09.840584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b06ab3be-9162-4bcb-9e02-88449298800f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:09.849102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b06ab3be-9162-4bcb-9e02-88449298800f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.193262 Aug 06 12:59:09.849914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1557/3103] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:09.956325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-b222ea28-679a-42b9-8505-1e7e9102eefd req-3fc854fd-6665-470a-8a01-f45e3e4758c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b858f51c-0983-4ec0-85a2-d955c78aff33", "tag": "dd9248b7-558b-4e95-8d9a-8f51f4c58eb8"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 12:59:09.966189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-b222ea28-679a-42b9-8505-1e7e9102eefd req-3fc854fd-6665-470a-8a01-f45e3e4758c3 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:09.966688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-b222ea28-679a-42b9-8505-1e7e9102eefd req-3fc854fd-6665-470a-8a01-f45e3e4758c3 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:09.967096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-b222ea28-679a-42b9-8505-1e7e9102eefd req-3fc854fd-6665-470a-8a01-f45e3e4758c3 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:09.978388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-b222ea28-679a-42b9-8505-1e7e9102eefd req-3fc854fd-6665-470a-8a01-f45e3e4758c3 service nova] Creating event network-changed:dd9248b7-558b-4e95-8d9a-8f51f4c58eb8 for instance b858f51c-0983-4ec0-85a2-d955c78aff33 on hv-cinder-85199 Aug 06 12:59:09.983780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-b222ea28-679a-42b9-8505-1e7e9102eefd req-3fc854fd-6665-470a-8a01-f45e3e4758c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031196 Aug 06 12:59:09.984856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1547/3104] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 12:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 12:59:10.559694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aba00c46-a369-460f-aaba-fdb2bf715cf2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:10.560294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aba00c46-a369-460f-aaba-fdb2bf715cf2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:10.566940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aba00c46-a369-460f-aaba-fdb2bf715cf2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:10.567428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aba00c46-a369-460f-aaba-fdb2bf715cf2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:10.567862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aba00c46-a369-460f-aaba-fdb2bf715cf2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:10.568685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aba00c46-a369-460f-aaba-fdb2bf715cf2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:10.569115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aba00c46-a369-460f-aaba-fdb2bf715cf2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:10.569550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aba00c46-a369-460f-aaba-fdb2bf715cf2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:10.704908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aba00c46-a369-460f-aaba-fdb2bf715cf2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:10.712941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aba00c46-a369-460f-aaba-fdb2bf715cf2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.157123 Aug 06 12:59:10.713627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1558/3105] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:10.871913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cb6ac30b-3921-47f9-bb46-5719d29d7531 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:10.872675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cb6ac30b-3921-47f9-bb46-5719d29d7531 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:10.879326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb6ac30b-3921-47f9-bb46-5719d29d7531 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:10.879812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb6ac30b-3921-47f9-bb46-5719d29d7531 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:10.880247 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb6ac30b-3921-47f9-bb46-5719d29d7531 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:10.880962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb6ac30b-3921-47f9-bb46-5719d29d7531 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:10.881414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb6ac30b-3921-47f9-bb46-5719d29d7531 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:10.881838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb6ac30b-3921-47f9-bb46-5719d29d7531 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:11.014139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cb6ac30b-3921-47f9-bb46-5719d29d7531 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:11.022071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cb6ac30b-3921-47f9-bb46-5719d29d7531 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154375 Aug 06 12:59:11.022629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1548/3106] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:11.734485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2f44bb31-6155-460d-88a4-3102711b5420 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:11.735060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2f44bb31-6155-460d-88a4-3102711b5420 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:11.737498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:11.742714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f44bb31-6155-460d-88a4-3102711b5420 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:11.743191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f44bb31-6155-460d-88a4-3102711b5420 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:11.743617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f44bb31-6155-460d-88a4-3102711b5420 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:11.744339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f44bb31-6155-460d-88a4-3102711b5420 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:11.744789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f44bb31-6155-460d-88a4-3102711b5420 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:11.745212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f44bb31-6155-460d-88a4-3102711b5420 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:11.875009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2f44bb31-6155-460d-88a4-3102711b5420 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:11.883525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2f44bb31-6155-460d-88a4-3102711b5420 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153281 Aug 06 12:59:11.884081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1559/3107] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:12.042996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f7aad283-98f4-4361-b4e1-9a17d1427a22 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:12.043616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f7aad283-98f4-4361-b4e1-9a17d1427a22 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:12.050232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7aad283-98f4-4361-b4e1-9a17d1427a22 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:12.051224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7aad283-98f4-4361-b4e1-9a17d1427a22 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:12.051663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7aad283-98f4-4361-b4e1-9a17d1427a22 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:12.052383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7aad283-98f4-4361-b4e1-9a17d1427a22 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:12.052842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7aad283-98f4-4361-b4e1-9a17d1427a22 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:12.053279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7aad283-98f4-4361-b4e1-9a17d1427a22 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:12.182506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f7aad283-98f4-4361-b4e1-9a17d1427a22 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:12.190362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f7aad283-98f4-4361-b4e1-9a17d1427a22 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151256 Aug 06 12:59:12.190923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1549/3108] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:12.904907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4b2b61a6-4c39-42c0-8d52-45aa246bcee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:12.908232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4b2b61a6-4c39-42c0-8d52-45aa246bcee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:12.913236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b2b61a6-4c39-42c0-8d52-45aa246bcee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:12.913718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b2b61a6-4c39-42c0-8d52-45aa246bcee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:12.914144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b2b61a6-4c39-42c0-8d52-45aa246bcee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:12.914824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b2b61a6-4c39-42c0-8d52-45aa246bcee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:12.915270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b2b61a6-4c39-42c0-8d52-45aa246bcee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:12.915689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b2b61a6-4c39-42c0-8d52-45aa246bcee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:13.047718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4b2b61a6-4c39-42c0-8d52-45aa246bcee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:13.055570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4b2b61a6-4c39-42c0-8d52-45aa246bcee5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154498 Aug 06 12:59:13.056123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1560/3109] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:13.212367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-354e196a-2fb9-4b56-a45e-19d7929bc5ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:13.212981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-354e196a-2fb9-4b56-a45e-19d7929bc5ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:13.219483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-354e196a-2fb9-4b56-a45e-19d7929bc5ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:13.219967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-354e196a-2fb9-4b56-a45e-19d7929bc5ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:13.220450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-354e196a-2fb9-4b56-a45e-19d7929bc5ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:13.221131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-354e196a-2fb9-4b56-a45e-19d7929bc5ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:13.221590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-354e196a-2fb9-4b56-a45e-19d7929bc5ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:13.222020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-354e196a-2fb9-4b56-a45e-19d7929bc5ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:13.348849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-354e196a-2fb9-4b56-a45e-19d7929bc5ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:13.356739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-354e196a-2fb9-4b56-a45e-19d7929bc5ad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148248 Aug 06 12:59:13.357562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1550/3110] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:14.076657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b321d52b-f053-4af1-8b23-aa1ecee943f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:14.077262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b321d52b-f053-4af1-8b23-aa1ecee943f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:14.087180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b321d52b-f053-4af1-8b23-aa1ecee943f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:14.087966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b321d52b-f053-4af1-8b23-aa1ecee943f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:14.088732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b321d52b-f053-4af1-8b23-aa1ecee943f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:14.089588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b321d52b-f053-4af1-8b23-aa1ecee943f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:14.090052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b321d52b-f053-4af1-8b23-aa1ecee943f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:14.090486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b321d52b-f053-4af1-8b23-aa1ecee943f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:14.219465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b321d52b-f053-4af1-8b23-aa1ecee943f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:14.227926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b321d52b-f053-4af1-8b23-aa1ecee943f2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155100 Aug 06 12:59:14.228512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1561/3111] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:14.377383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-01c9f18b-2c48-4d2b-a1c4-2b2157e9d1da tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:14.377990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-01c9f18b-2c48-4d2b-a1c4-2b2157e9d1da tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:14.384383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01c9f18b-2c48-4d2b-a1c4-2b2157e9d1da tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:14.384864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01c9f18b-2c48-4d2b-a1c4-2b2157e9d1da tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:14.385297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01c9f18b-2c48-4d2b-a1c4-2b2157e9d1da tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:14.385975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01c9f18b-2c48-4d2b-a1c4-2b2157e9d1da tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:14.386426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01c9f18b-2c48-4d2b-a1c4-2b2157e9d1da tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:14.386848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01c9f18b-2c48-4d2b-a1c4-2b2157e9d1da tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:14.521097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-01c9f18b-2c48-4d2b-a1c4-2b2157e9d1da tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:14.529216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-01c9f18b-2c48-4d2b-a1c4-2b2157e9d1da tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.156127 Aug 06 12:59:14.529784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1551/3112] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:15.249316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1e5e3718-176c-4242-b721-4c60ecbd29e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:15.249866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1e5e3718-176c-4242-b721-4c60ecbd29e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:15.256162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e5e3718-176c-4242-b721-4c60ecbd29e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:15.256666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e5e3718-176c-4242-b721-4c60ecbd29e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:15.257098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e5e3718-176c-4242-b721-4c60ecbd29e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:15.257774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e5e3718-176c-4242-b721-4c60ecbd29e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:15.258222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e5e3718-176c-4242-b721-4c60ecbd29e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:15.258641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e5e3718-176c-4242-b721-4c60ecbd29e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:15.387657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e5e3718-176c-4242-b721-4c60ecbd29e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:15.399281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1e5e3718-176c-4242-b721-4c60ecbd29e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153562 Aug 06 12:59:15.400369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1562/3113] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:15.550639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5d2f4f1-d51d-404c-a7de-2ccc2a1e60f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:15.551251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5d2f4f1-d51d-404c-a7de-2ccc2a1e60f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:15.557635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5d2f4f1-d51d-404c-a7de-2ccc2a1e60f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:15.558115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5d2f4f1-d51d-404c-a7de-2ccc2a1e60f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:15.558548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5d2f4f1-d51d-404c-a7de-2ccc2a1e60f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:15.559234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5d2f4f1-d51d-404c-a7de-2ccc2a1e60f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:15.559689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5d2f4f1-d51d-404c-a7de-2ccc2a1e60f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:15.560116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5d2f4f1-d51d-404c-a7de-2ccc2a1e60f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:15.685047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5d2f4f1-d51d-404c-a7de-2ccc2a1e60f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:15.694113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5d2f4f1-d51d-404c-a7de-2ccc2a1e60f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147370 Aug 06 12:59:15.694686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1552/3114] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:15 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:16.425705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8ee3579b-adcc-48e3-972c-1968ecc33c30 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:16.426917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8ee3579b-adcc-48e3-972c-1968ecc33c30 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:16.432852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ee3579b-adcc-48e3-972c-1968ecc33c30 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:16.433329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ee3579b-adcc-48e3-972c-1968ecc33c30 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:16.433760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ee3579b-adcc-48e3-972c-1968ecc33c30 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:16.434441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ee3579b-adcc-48e3-972c-1968ecc33c30 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:16.434889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ee3579b-adcc-48e3-972c-1968ecc33c30 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:16.435307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8ee3579b-adcc-48e3-972c-1968ecc33c30 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:16.559160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8ee3579b-adcc-48e3-972c-1968ecc33c30 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:16.566975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8ee3579b-adcc-48e3-972c-1968ecc33c30 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145252 Aug 06 12:59:16.567528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1563/3115] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:16.715148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ab2ed966-4d8a-40f1-a341-4dd015841620 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:16.715719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ab2ed966-4d8a-40f1-a341-4dd015841620 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:16.722072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2ed966-4d8a-40f1-a341-4dd015841620 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:16.722554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2ed966-4d8a-40f1-a341-4dd015841620 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:16.723952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2ed966-4d8a-40f1-a341-4dd015841620 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:16.724666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2ed966-4d8a-40f1-a341-4dd015841620 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:16.725123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2ed966-4d8a-40f1-a341-4dd015841620 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:16.725551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ab2ed966-4d8a-40f1-a341-4dd015841620 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:16.852960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ab2ed966-4d8a-40f1-a341-4dd015841620 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:16.860945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ab2ed966-4d8a-40f1-a341-4dd015841620 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149676 Aug 06 12:59:16.861517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1553/3116] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:17.587824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a97245e5-5e49-466a-8ed5-c3243adef173 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:17.588473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a97245e5-5e49-466a-8ed5-c3243adef173 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:17.594804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a97245e5-5e49-466a-8ed5-c3243adef173 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:17.595274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a97245e5-5e49-466a-8ed5-c3243adef173 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:17.595697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a97245e5-5e49-466a-8ed5-c3243adef173 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:17.596402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a97245e5-5e49-466a-8ed5-c3243adef173 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:17.596848 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a97245e5-5e49-466a-8ed5-c3243adef173 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:17.597261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a97245e5-5e49-466a-8ed5-c3243adef173 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:17.729180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a97245e5-5e49-466a-8ed5-c3243adef173 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:17.737407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a97245e5-5e49-466a-8ed5-c3243adef173 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153379 Aug 06 12:59:17.737964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1564/3117] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:17.881468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-efb7245a-53cc-454c-90bf-e5c32da902cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:17.882069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-efb7245a-53cc-454c-90bf-e5c32da902cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:17.888463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efb7245a-53cc-454c-90bf-e5c32da902cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:17.888945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efb7245a-53cc-454c-90bf-e5c32da902cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:17.889377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efb7245a-53cc-454c-90bf-e5c32da902cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:17.890060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efb7245a-53cc-454c-90bf-e5c32da902cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:17.890513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efb7245a-53cc-454c-90bf-e5c32da902cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:17.890936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-efb7245a-53cc-454c-90bf-e5c32da902cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:18.017987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-efb7245a-53cc-454c-90bf-e5c32da902cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:18.026369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-efb7245a-53cc-454c-90bf-e5c32da902cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148731 Aug 06 12:59:18.026936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1554/3118] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:18.758956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-59a6d002-628e-48fb-9e01-d939ed7514e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:18.759542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-59a6d002-628e-48fb-9e01-d939ed7514e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:18.765877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59a6d002-628e-48fb-9e01-d939ed7514e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:18.766352 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59a6d002-628e-48fb-9e01-d939ed7514e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:18.766774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59a6d002-628e-48fb-9e01-d939ed7514e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:18.767441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59a6d002-628e-48fb-9e01-d939ed7514e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:18.767886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59a6d002-628e-48fb-9e01-d939ed7514e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:18.768319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59a6d002-628e-48fb-9e01-d939ed7514e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:18.898817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-59a6d002-628e-48fb-9e01-d939ed7514e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:18.906661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-59a6d002-628e-48fb-9e01-d939ed7514e1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151550 Aug 06 12:59:18.907224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1565/3119] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:18 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:19.046939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d070ca6-0e3d-46f7-b02e-7bfa068dac3c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:19.047580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d070ca6-0e3d-46f7-b02e-7bfa068dac3c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:19.054008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d070ca6-0e3d-46f7-b02e-7bfa068dac3c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:19.054485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d070ca6-0e3d-46f7-b02e-7bfa068dac3c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:19.054920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d070ca6-0e3d-46f7-b02e-7bfa068dac3c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:19.055594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d070ca6-0e3d-46f7-b02e-7bfa068dac3c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:19.056042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d070ca6-0e3d-46f7-b02e-7bfa068dac3c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:19.056500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d070ca6-0e3d-46f7-b02e-7bfa068dac3c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:19.186162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d070ca6-0e3d-46f7-b02e-7bfa068dac3c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:19.195828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d070ca6-0e3d-46f7-b02e-7bfa068dac3c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152701 Aug 06 12:59:19.196409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1555/3120] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:19.929558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c120087d-2ed5-4362-a8c6-5f9520877ee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:19.930161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c120087d-2ed5-4362-a8c6-5f9520877ee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:19.936678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c120087d-2ed5-4362-a8c6-5f9520877ee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:19.937152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c120087d-2ed5-4362-a8c6-5f9520877ee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:19.937612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c120087d-2ed5-4362-a8c6-5f9520877ee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:19.938290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c120087d-2ed5-4362-a8c6-5f9520877ee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:19.938765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c120087d-2ed5-4362-a8c6-5f9520877ee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:19.939177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c120087d-2ed5-4362-a8c6-5f9520877ee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:20.069209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c120087d-2ed5-4362-a8c6-5f9520877ee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:20.077028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c120087d-2ed5-4362-a8c6-5f9520877ee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152005 Aug 06 12:59:20.077590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1566/3121] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:20.217486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-108e12c9-b9ca-4ab0-94cd-99f9eef77575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:20.218355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-108e12c9-b9ca-4ab0-94cd-99f9eef77575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:20.225954 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-108e12c9-b9ca-4ab0-94cd-99f9eef77575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:20.226436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-108e12c9-b9ca-4ab0-94cd-99f9eef77575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:20.226865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-108e12c9-b9ca-4ab0-94cd-99f9eef77575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:20.227540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-108e12c9-b9ca-4ab0-94cd-99f9eef77575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:20.227988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-108e12c9-b9ca-4ab0-94cd-99f9eef77575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:20.228439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-108e12c9-b9ca-4ab0-94cd-99f9eef77575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:20.362232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-108e12c9-b9ca-4ab0-94cd-99f9eef77575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:20.370065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-108e12c9-b9ca-4ab0-94cd-99f9eef77575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.156379 Aug 06 12:59:20.370928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1556/3122] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:21.097244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eeafce7b-03ec-4d1c-9b13-767149b66ade tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:21.097849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eeafce7b-03ec-4d1c-9b13-767149b66ade tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:21.104463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeafce7b-03ec-4d1c-9b13-767149b66ade tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:21.104945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeafce7b-03ec-4d1c-9b13-767149b66ade tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:21.105377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeafce7b-03ec-4d1c-9b13-767149b66ade tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:21.106062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeafce7b-03ec-4d1c-9b13-767149b66ade tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:21.106513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeafce7b-03ec-4d1c-9b13-767149b66ade tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:21.106938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeafce7b-03ec-4d1c-9b13-767149b66ade tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:21.234929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eeafce7b-03ec-4d1c-9b13-767149b66ade tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:21.243332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eeafce7b-03ec-4d1c-9b13-767149b66ade tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149937 Aug 06 12:59:21.243892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1567/3123] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:21 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:21.390907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-55d54779-a5d7-44b5-838b-75205a9b7013 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:21.391415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-55d54779-a5d7-44b5-838b-75205a9b7013 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:21.397734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55d54779-a5d7-44b5-838b-75205a9b7013 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:21.398210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55d54779-a5d7-44b5-838b-75205a9b7013 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:21.398641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55d54779-a5d7-44b5-838b-75205a9b7013 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:21.399314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55d54779-a5d7-44b5-838b-75205a9b7013 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:21.399759 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55d54779-a5d7-44b5-838b-75205a9b7013 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:21.400178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55d54779-a5d7-44b5-838b-75205a9b7013 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:21.524290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-55d54779-a5d7-44b5-838b-75205a9b7013 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:21.532103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-55d54779-a5d7-44b5-838b-75205a9b7013 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145139 Aug 06 12:59:21.532698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1557/3124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:21 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:22.265066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8d5adf5f-38f8-4985-b48b-b1b9abfc69eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:22.265644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8d5adf5f-38f8-4985-b48b-b1b9abfc69eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:22.272581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5adf5f-38f8-4985-b48b-b1b9abfc69eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:22.273059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5adf5f-38f8-4985-b48b-b1b9abfc69eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:22.273483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5adf5f-38f8-4985-b48b-b1b9abfc69eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:22.274157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5adf5f-38f8-4985-b48b-b1b9abfc69eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:22.274603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5adf5f-38f8-4985-b48b-b1b9abfc69eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:22.275021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5adf5f-38f8-4985-b48b-b1b9abfc69eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:22.401798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8d5adf5f-38f8-4985-b48b-b1b9abfc69eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:22.409570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8d5adf5f-38f8-4985-b48b-b1b9abfc69eb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148484 Aug 06 12:59:22.410124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1568/3125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:22 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:22.553671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5aa585a6-a068-4a15-9597-44bcd84b7deb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:22.554275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5aa585a6-a068-4a15-9597-44bcd84b7deb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:22.560607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa585a6-a068-4a15-9597-44bcd84b7deb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:22.561085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa585a6-a068-4a15-9597-44bcd84b7deb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:22.561515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa585a6-a068-4a15-9597-44bcd84b7deb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:22.562196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa585a6-a068-4a15-9597-44bcd84b7deb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:22.562645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa585a6-a068-4a15-9597-44bcd84b7deb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:22.563063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5aa585a6-a068-4a15-9597-44bcd84b7deb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:22.694402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5aa585a6-a068-4a15-9597-44bcd84b7deb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:22.702301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5aa585a6-a068-4a15-9597-44bcd84b7deb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152919 Aug 06 12:59:22.702856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1558/3126] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:23.430533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-528fcd18-0931-4579-9d5a-3a8ddd6178b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:23.431134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-528fcd18-0931-4579-9d5a-3a8ddd6178b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:23.437452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-528fcd18-0931-4579-9d5a-3a8ddd6178b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:23.437922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-528fcd18-0931-4579-9d5a-3a8ddd6178b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:23.438348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-528fcd18-0931-4579-9d5a-3a8ddd6178b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:23.439015 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-528fcd18-0931-4579-9d5a-3a8ddd6178b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:23.439458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-528fcd18-0931-4579-9d5a-3a8ddd6178b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:23.439874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-528fcd18-0931-4579-9d5a-3a8ddd6178b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:23.568213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-528fcd18-0931-4579-9d5a-3a8ddd6178b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:23.575983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-528fcd18-0931-4579-9d5a-3a8ddd6178b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149339 Aug 06 12:59:23.576563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1569/3127] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:23 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:23.722901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fd90248e-608c-4249-bc4b-0bc1ef780fad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:23.723445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fd90248e-608c-4249-bc4b-0bc1ef780fad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:23.729911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd90248e-608c-4249-bc4b-0bc1ef780fad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:23.730394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd90248e-608c-4249-bc4b-0bc1ef780fad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:23.730830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd90248e-608c-4249-bc4b-0bc1ef780fad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:23.731511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd90248e-608c-4249-bc4b-0bc1ef780fad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:23.732220 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd90248e-608c-4249-bc4b-0bc1ef780fad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:23.732668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd90248e-608c-4249-bc4b-0bc1ef780fad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:23.856392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd90248e-608c-4249-bc4b-0bc1ef780fad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:23.864516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fd90248e-608c-4249-bc4b-0bc1ef780fad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145515 Aug 06 12:59:23.865082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1559/3128] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:24.663841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ca42b327-5723-4d10-8827-ce2be6646547 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:24.664479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ca42b327-5723-4d10-8827-ce2be6646547 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:24.670301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca42b327-5723-4d10-8827-ce2be6646547 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:24.670773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca42b327-5723-4d10-8827-ce2be6646547 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:24.671199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca42b327-5723-4d10-8827-ce2be6646547 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:24.671869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca42b327-5723-4d10-8827-ce2be6646547 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:24.672323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca42b327-5723-4d10-8827-ce2be6646547 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:24.672753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ca42b327-5723-4d10-8827-ce2be6646547 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:24.798328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ca42b327-5723-4d10-8827-ce2be6646547 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:24.806194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ca42b327-5723-4d10-8827-ce2be6646547 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.213197 Aug 06 12:59:24.806743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1570/3129] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:24 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:24.885336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bc585081-e40b-405f-837c-454d9f24e0c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:24.885880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bc585081-e40b-405f-837c-454d9f24e0c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:24.892105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc585081-e40b-405f-837c-454d9f24e0c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:24.892618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc585081-e40b-405f-837c-454d9f24e0c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:24.893053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc585081-e40b-405f-837c-454d9f24e0c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:24.893737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc585081-e40b-405f-837c-454d9f24e0c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:24.894192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc585081-e40b-405f-837c-454d9f24e0c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:24.894622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc585081-e40b-405f-837c-454d9f24e0c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:25.021333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bc585081-e40b-405f-837c-454d9f24e0c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:25.029145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bc585081-e40b-405f-837c-454d9f24e0c3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147711 Aug 06 12:59:25.029714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1560/3130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:25.826435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ee053e85-75d4-4476-a976-4a4fab9783a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:25.827033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ee053e85-75d4-4476-a976-4a4fab9783a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:25.833433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee053e85-75d4-4476-a976-4a4fab9783a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:25.833911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee053e85-75d4-4476-a976-4a4fab9783a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:25.834336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee053e85-75d4-4476-a976-4a4fab9783a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:25.835006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee053e85-75d4-4476-a976-4a4fab9783a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:25.835450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee053e85-75d4-4476-a976-4a4fab9783a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:25.835863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee053e85-75d4-4476-a976-4a4fab9783a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:25.850621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:25.966152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ee053e85-75d4-4476-a976-4a4fab9783a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:25.974465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ee053e85-75d4-4476-a976-4a4fab9783a7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151915 Aug 06 12:59:25.975022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1571/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:25 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:26.049611 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0f64a10e-9fbe-4b91-8d4c-6db62d0bd91e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:26.050219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0f64a10e-9fbe-4b91-8d4c-6db62d0bd91e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:26.057211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f64a10e-9fbe-4b91-8d4c-6db62d0bd91e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:26.057688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f64a10e-9fbe-4b91-8d4c-6db62d0bd91e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:26.058117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f64a10e-9fbe-4b91-8d4c-6db62d0bd91e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:26.058795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f64a10e-9fbe-4b91-8d4c-6db62d0bd91e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:26.059245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f64a10e-9fbe-4b91-8d4c-6db62d0bd91e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:26.059665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f64a10e-9fbe-4b91-8d4c-6db62d0bd91e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:26.190960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0f64a10e-9fbe-4b91-8d4c-6db62d0bd91e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:26.200937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0f64a10e-9fbe-4b91-8d4c-6db62d0bd91e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154934 Aug 06 12:59:26.201752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1561/3132] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:26.995749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b6e8acd6-6548-4d68-8066-0bd739803718 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:26.996378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b6e8acd6-6548-4d68-8066-0bd739803718 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:27.002744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6e8acd6-6548-4d68-8066-0bd739803718 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:27.003229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6e8acd6-6548-4d68-8066-0bd739803718 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:27.003661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6e8acd6-6548-4d68-8066-0bd739803718 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:27.005030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6e8acd6-6548-4d68-8066-0bd739803718 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:27.005482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6e8acd6-6548-4d68-8066-0bd739803718 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:27.005902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6e8acd6-6548-4d68-8066-0bd739803718 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:27.132790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b6e8acd6-6548-4d68-8066-0bd739803718 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:27.140639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b6e8acd6-6548-4d68-8066-0bd739803718 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148725 Aug 06 12:59:27.141201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1572/3133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:26 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:27.222062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4beb6494-0065-4ca6-bf95-68642e335689 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:27.222673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4beb6494-0065-4ca6-bf95-68642e335689 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:27.229184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4beb6494-0065-4ca6-bf95-68642e335689 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:27.229666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4beb6494-0065-4ca6-bf95-68642e335689 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:27.230099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4beb6494-0065-4ca6-bf95-68642e335689 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:27.230786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4beb6494-0065-4ca6-bf95-68642e335689 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:27.231261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4beb6494-0065-4ca6-bf95-68642e335689 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:27.231686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4beb6494-0065-4ca6-bf95-68642e335689 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:27.249158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:27.359177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4beb6494-0065-4ca6-bf95-68642e335689 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:27.367639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4beb6494-0065-4ca6-bf95-68642e335689 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149426 Aug 06 12:59:27.368200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1562/3134] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:28.161618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4931485-16da-4ee8-b139-43edf24819b1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:28.162229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d4931485-16da-4ee8-b139-43edf24819b1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:28.168559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4931485-16da-4ee8-b139-43edf24819b1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:28.169055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4931485-16da-4ee8-b139-43edf24819b1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:28.169469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4931485-16da-4ee8-b139-43edf24819b1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:28.170143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4931485-16da-4ee8-b139-43edf24819b1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:28.170594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4931485-16da-4ee8-b139-43edf24819b1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:28.171012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4931485-16da-4ee8-b139-43edf24819b1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:28.303316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d4931485-16da-4ee8-b139-43edf24819b1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:28.311193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d4931485-16da-4ee8-b139-43edf24819b1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153442 Aug 06 12:59:28.311751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1573/3135] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:28 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:28.387972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f3530331-cadc-4ddf-9322-cc445325e25e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:28.388596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f3530331-cadc-4ddf-9322-cc445325e25e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:28.395951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3530331-cadc-4ddf-9322-cc445325e25e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:28.396453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3530331-cadc-4ddf-9322-cc445325e25e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:28.396886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3530331-cadc-4ddf-9322-cc445325e25e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:28.397565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3530331-cadc-4ddf-9322-cc445325e25e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:28.398011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3530331-cadc-4ddf-9322-cc445325e25e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:28.398432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3530331-cadc-4ddf-9322-cc445325e25e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:28.528513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f3530331-cadc-4ddf-9322-cc445325e25e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:28.536317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f3530331-cadc-4ddf-9322-cc445325e25e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152159 Aug 06 12:59:28.536870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1563/3136] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:28 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:29.336234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-149121d5-b7b1-4499-9b63-a1508dd06ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:29.336875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-149121d5-b7b1-4499-9b63-a1508dd06ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:29.343173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149121d5-b7b1-4499-9b63-a1508dd06ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:29.343648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149121d5-b7b1-4499-9b63-a1508dd06ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:29.344076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149121d5-b7b1-4499-9b63-a1508dd06ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:29.344779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149121d5-b7b1-4499-9b63-a1508dd06ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:29.345226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149121d5-b7b1-4499-9b63-a1508dd06ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:29.345647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-149121d5-b7b1-4499-9b63-a1508dd06ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:29.475839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-149121d5-b7b1-4499-9b63-a1508dd06ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:29.485168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-149121d5-b7b1-4499-9b63-a1508dd06ebc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153241 Aug 06 12:59:29.485719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1574/3137] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:29 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:29.557545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-df40aae6-f035-4279-b6e4-aff0f716614a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:29.558157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df40aae6-f035-4279-b6e4-aff0f716614a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:29.564598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df40aae6-f035-4279-b6e4-aff0f716614a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:29.565077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df40aae6-f035-4279-b6e4-aff0f716614a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:29.565512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df40aae6-f035-4279-b6e4-aff0f716614a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:29.566196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df40aae6-f035-4279-b6e4-aff0f716614a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:29.567145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df40aae6-f035-4279-b6e4-aff0f716614a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:29.567573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df40aae6-f035-4279-b6e4-aff0f716614a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:29.692188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df40aae6-f035-4279-b6e4-aff0f716614a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:29.700073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-df40aae6-f035-4279-b6e4-aff0f716614a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146364 Aug 06 12:59:29.700669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1564/3138] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:30.506419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c0b3070c-1ae6-4828-8674-d9b9b43b9126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:30.507061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c0b3070c-1ae6-4828-8674-d9b9b43b9126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:30.513460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0b3070c-1ae6-4828-8674-d9b9b43b9126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:30.513942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0b3070c-1ae6-4828-8674-d9b9b43b9126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:30.514408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0b3070c-1ae6-4828-8674-d9b9b43b9126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:30.515091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0b3070c-1ae6-4828-8674-d9b9b43b9126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:30.515544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0b3070c-1ae6-4828-8674-d9b9b43b9126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:30.515967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0b3070c-1ae6-4828-8674-d9b9b43b9126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:30.641643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c0b3070c-1ae6-4828-8674-d9b9b43b9126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:30.649423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c0b3070c-1ae6-4828-8674-d9b9b43b9126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146853 Aug 06 12:59:30.650017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1575/3139] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:30 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:30.721650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b9cede37-bc0e-4fdf-9633-7419d4789269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:30.722271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b9cede37-bc0e-4fdf-9633-7419d4789269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:30.729974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b9cede37-bc0e-4fdf-9633-7419d4789269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:30.730489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b9cede37-bc0e-4fdf-9633-7419d4789269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:30.730918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b9cede37-bc0e-4fdf-9633-7419d4789269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:30.731603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b9cede37-bc0e-4fdf-9633-7419d4789269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:30.732447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b9cede37-bc0e-4fdf-9633-7419d4789269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:30.733018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b9cede37-bc0e-4fdf-9633-7419d4789269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:30.861775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b9cede37-bc0e-4fdf-9633-7419d4789269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:30.869696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b9cede37-bc0e-4fdf-9633-7419d4789269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152070 Aug 06 12:59:30.870267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1565/3140] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:31.671297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-50887331-91f6-4189-a194-aa1afcd9b758 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:31.671901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-50887331-91f6-4189-a194-aa1afcd9b758 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:31.678876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50887331-91f6-4189-a194-aa1afcd9b758 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:31.679355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50887331-91f6-4189-a194-aa1afcd9b758 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:31.679784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50887331-91f6-4189-a194-aa1afcd9b758 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:31.680499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50887331-91f6-4189-a194-aa1afcd9b758 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:31.680952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50887331-91f6-4189-a194-aa1afcd9b758 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:31.681369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50887331-91f6-4189-a194-aa1afcd9b758 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:31.810216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-50887331-91f6-4189-a194-aa1afcd9b758 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:31.818113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-50887331-91f6-4189-a194-aa1afcd9b758 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150941 Aug 06 12:59:31.818665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1576/3141] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:31 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:31.890737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-682c3555-ce39-4f98-8857-328555273e37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:31.891406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-682c3555-ce39-4f98-8857-328555273e37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:31.897708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-682c3555-ce39-4f98-8857-328555273e37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:31.898193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-682c3555-ce39-4f98-8857-328555273e37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:31.898630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-682c3555-ce39-4f98-8857-328555273e37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:31.899308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-682c3555-ce39-4f98-8857-328555273e37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:31.899760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-682c3555-ce39-4f98-8857-328555273e37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:31.900179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-682c3555-ce39-4f98-8857-328555273e37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:32.025992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-682c3555-ce39-4f98-8857-328555273e37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:32.033971 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-682c3555-ce39-4f98-8857-328555273e37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147439 Aug 06 12:59:32.034534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1566/3142] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:32.839195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f5c8a9a1-9a4c-49a6-b8cb-fb8a2ea75405 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:32.839788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f5c8a9a1-9a4c-49a6-b8cb-fb8a2ea75405 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:32.846192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5c8a9a1-9a4c-49a6-b8cb-fb8a2ea75405 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:32.846659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5c8a9a1-9a4c-49a6-b8cb-fb8a2ea75405 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:32.847083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5c8a9a1-9a4c-49a6-b8cb-fb8a2ea75405 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:32.847774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5c8a9a1-9a4c-49a6-b8cb-fb8a2ea75405 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:32.848241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5c8a9a1-9a4c-49a6-b8cb-fb8a2ea75405 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:32.848800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5c8a9a1-9a4c-49a6-b8cb-fb8a2ea75405 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:32.973164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f5c8a9a1-9a4c-49a6-b8cb-fb8a2ea75405 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:32.981824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f5c8a9a1-9a4c-49a6-b8cb-fb8a2ea75405 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146410 Aug 06 12:59:32.982641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1577/3143] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:32 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:33.055286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2e547bc2-665c-4f7f-afb5-6ae86f008385 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:33.055900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2e547bc2-665c-4f7f-afb5-6ae86f008385 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:33.062015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e547bc2-665c-4f7f-afb5-6ae86f008385 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:33.062498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e547bc2-665c-4f7f-afb5-6ae86f008385 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:33.062936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e547bc2-665c-4f7f-afb5-6ae86f008385 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:33.063620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e547bc2-665c-4f7f-afb5-6ae86f008385 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:33.064074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e547bc2-665c-4f7f-afb5-6ae86f008385 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:33.064530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e547bc2-665c-4f7f-afb5-6ae86f008385 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:33.190552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2e547bc2-665c-4f7f-afb5-6ae86f008385 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:33.199035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2e547bc2-665c-4f7f-afb5-6ae86f008385 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148183 Aug 06 12:59:33.199597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1567/3144] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:34.003046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b2131497-8265-44ac-844f-753228885c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:34.003672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b2131497-8265-44ac-844f-753228885c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:34.010047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2131497-8265-44ac-844f-753228885c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:34.010517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2131497-8265-44ac-844f-753228885c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:34.010940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2131497-8265-44ac-844f-753228885c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:34.011608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2131497-8265-44ac-844f-753228885c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:34.012053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2131497-8265-44ac-844f-753228885c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:34.012500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2131497-8265-44ac-844f-753228885c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:34.141488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b2131497-8265-44ac-844f-753228885c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:34.150013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b2131497-8265-44ac-844f-753228885c01 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150775 Aug 06 12:59:34.150569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1578/3145] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:33 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:34.220605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1474066b-c809-4099-b642-868737c3bb30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:34.221158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1474066b-c809-4099-b642-868737c3bb30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:34.227571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1474066b-c809-4099-b642-868737c3bb30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:34.228050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1474066b-c809-4099-b642-868737c3bb30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:34.228520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1474066b-c809-4099-b642-868737c3bb30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:34.229205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1474066b-c809-4099-b642-868737c3bb30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:34.229657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1474066b-c809-4099-b642-868737c3bb30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:34.230083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1474066b-c809-4099-b642-868737c3bb30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:34.359877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1474066b-c809-4099-b642-868737c3bb30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:34.368386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1474066b-c809-4099-b642-868737c3bb30 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151673 Aug 06 12:59:34.368951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1568/3146] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:35.170950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8c91860f-b6bf-40bb-a4dd-0f9fdb722167 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:35.171555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8c91860f-b6bf-40bb-a4dd-0f9fdb722167 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:35.178004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c91860f-b6bf-40bb-a4dd-0f9fdb722167 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:35.178482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c91860f-b6bf-40bb-a4dd-0f9fdb722167 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:35.178911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c91860f-b6bf-40bb-a4dd-0f9fdb722167 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:35.179582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c91860f-b6bf-40bb-a4dd-0f9fdb722167 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:35.180029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c91860f-b6bf-40bb-a4dd-0f9fdb722167 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:35.180478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c91860f-b6bf-40bb-a4dd-0f9fdb722167 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:35.306172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8c91860f-b6bf-40bb-a4dd-0f9fdb722167 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:35.314038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8c91860f-b6bf-40bb-a4dd-0f9fdb722167 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146907 Aug 06 12:59:35.314602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1579/3147] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:35 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:35.389888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6b7245a2-565d-4102-8c8e-02b4cc621949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:35.390494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6b7245a2-565d-4102-8c8e-02b4cc621949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:35.397327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7245a2-565d-4102-8c8e-02b4cc621949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:35.397802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7245a2-565d-4102-8c8e-02b4cc621949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:35.398232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7245a2-565d-4102-8c8e-02b4cc621949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:35.398909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7245a2-565d-4102-8c8e-02b4cc621949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:35.399355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7245a2-565d-4102-8c8e-02b4cc621949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:35.399782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b7245a2-565d-4102-8c8e-02b4cc621949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:35.528946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6b7245a2-565d-4102-8c8e-02b4cc621949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:35.536755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6b7245a2-565d-4102-8c8e-02b4cc621949 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150661 Aug 06 12:59:35.537317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1569/3148] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:35 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:36.335214 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-995c4468-d963-4997-9a9b-95f04ea3b657 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:36.335796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-995c4468-d963-4997-9a9b-95f04ea3b657 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:36.342133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-995c4468-d963-4997-9a9b-95f04ea3b657 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:36.342610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-995c4468-d963-4997-9a9b-95f04ea3b657 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:36.343038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-995c4468-d963-4997-9a9b-95f04ea3b657 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:36.343707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-995c4468-d963-4997-9a9b-95f04ea3b657 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:36.344147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-995c4468-d963-4997-9a9b-95f04ea3b657 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:36.344583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-995c4468-d963-4997-9a9b-95f04ea3b657 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:36.475361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-995c4468-d963-4997-9a9b-95f04ea3b657 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:36.483448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-995c4468-d963-4997-9a9b-95f04ea3b657 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152103 Aug 06 12:59:36.484029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1580/3149] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:36 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:36.557713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d7cd2ff6-56f2-45b5-bb40-33baca9bd833 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:36.558346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d7cd2ff6-56f2-45b5-bb40-33baca9bd833 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:36.564661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7cd2ff6-56f2-45b5-bb40-33baca9bd833 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:36.565133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7cd2ff6-56f2-45b5-bb40-33baca9bd833 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:36.565561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7cd2ff6-56f2-45b5-bb40-33baca9bd833 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:36.566231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7cd2ff6-56f2-45b5-bb40-33baca9bd833 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:36.566677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7cd2ff6-56f2-45b5-bb40-33baca9bd833 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:36.567094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7cd2ff6-56f2-45b5-bb40-33baca9bd833 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:36.693294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d7cd2ff6-56f2-45b5-bb40-33baca9bd833 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:36.701073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d7cd2ff6-56f2-45b5-bb40-33baca9bd833 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147259 Aug 06 12:59:36.701633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1570/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:37.504802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6c3cbcaf-19d5-4c2a-8a86-bf6d62e10c27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:37.505425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6c3cbcaf-19d5-4c2a-8a86-bf6d62e10c27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:37.512522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c3cbcaf-19d5-4c2a-8a86-bf6d62e10c27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:37.512992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c3cbcaf-19d5-4c2a-8a86-bf6d62e10c27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:37.513414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c3cbcaf-19d5-4c2a-8a86-bf6d62e10c27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:37.514082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c3cbcaf-19d5-4c2a-8a86-bf6d62e10c27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:37.514524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c3cbcaf-19d5-4c2a-8a86-bf6d62e10c27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:37.514937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c3cbcaf-19d5-4c2a-8a86-bf6d62e10c27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:37.645718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6c3cbcaf-19d5-4c2a-8a86-bf6d62e10c27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:37.653640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6c3cbcaf-19d5-4c2a-8a86-bf6d62e10c27 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152629 Aug 06 12:59:37.654211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1581/3151] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:37 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:37.721674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f44c82d6-8002-4f15-a363-126055739732 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:37.722303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f44c82d6-8002-4f15-a363-126055739732 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:37.724568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=56 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:37.729998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f44c82d6-8002-4f15-a363-126055739732 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:37.730484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f44c82d6-8002-4f15-a363-126055739732 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:37.730924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f44c82d6-8002-4f15-a363-126055739732 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:37.731614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f44c82d6-8002-4f15-a363-126055739732 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:37.732350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f44c82d6-8002-4f15-a363-126055739732 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:37.732779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f44c82d6-8002-4f15-a363-126055739732 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:37.860238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f44c82d6-8002-4f15-a363-126055739732 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:37.868139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f44c82d6-8002-4f15-a363-126055739732 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150377 Aug 06 12:59:37.868733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1571/3152] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:37 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:38.674608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b05fbacb-003f-4d72-9fd8-85d69f8d0dee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:38.675150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b05fbacb-003f-4d72-9fd8-85d69f8d0dee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:38.681451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b05fbacb-003f-4d72-9fd8-85d69f8d0dee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:38.681926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b05fbacb-003f-4d72-9fd8-85d69f8d0dee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:38.682353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b05fbacb-003f-4d72-9fd8-85d69f8d0dee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:38.683020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b05fbacb-003f-4d72-9fd8-85d69f8d0dee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:38.683464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b05fbacb-003f-4d72-9fd8-85d69f8d0dee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:38.683885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b05fbacb-003f-4d72-9fd8-85d69f8d0dee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:38.810492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b05fbacb-003f-4d72-9fd8-85d69f8d0dee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:38.818832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b05fbacb-003f-4d72-9fd8-85d69f8d0dee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147661 Aug 06 12:59:38.819384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1582/3153] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:38 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:38.889765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-14eabea7-edf9-4c21-9ae5-f55d839c197b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:38.890400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-14eabea7-edf9-4c21-9ae5-f55d839c197b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:38.896754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14eabea7-edf9-4c21-9ae5-f55d839c197b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:38.897239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14eabea7-edf9-4c21-9ae5-f55d839c197b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:38.897677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14eabea7-edf9-4c21-9ae5-f55d839c197b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:38.898361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14eabea7-edf9-4c21-9ae5-f55d839c197b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:38.898821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14eabea7-edf9-4c21-9ae5-f55d839c197b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:38.899249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14eabea7-edf9-4c21-9ae5-f55d839c197b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:39.024931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-14eabea7-edf9-4c21-9ae5-f55d839c197b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:39.033003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-14eabea7-edf9-4c21-9ae5-f55d839c197b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147077 Aug 06 12:59:39.033599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1572/3154] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:39.839554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-169a1cff-f577-41b7-b7e1-1f0f550281cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:39.840218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-169a1cff-f577-41b7-b7e1-1f0f550281cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:39.846528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-169a1cff-f577-41b7-b7e1-1f0f550281cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:39.847005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-169a1cff-f577-41b7-b7e1-1f0f550281cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:39.847437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-169a1cff-f577-41b7-b7e1-1f0f550281cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:39.848113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-169a1cff-f577-41b7-b7e1-1f0f550281cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:39.848587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-169a1cff-f577-41b7-b7e1-1f0f550281cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:39.849012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-169a1cff-f577-41b7-b7e1-1f0f550281cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:39.979628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-169a1cff-f577-41b7-b7e1-1f0f550281cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:39.987748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-169a1cff-f577-41b7-b7e1-1f0f550281cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152035 Aug 06 12:59:39.988322 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1583/3155] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:39 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:40.053597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2af50389-2e75-4889-adb8-9ac0d2f986bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:40.054198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2af50389-2e75-4889-adb8-9ac0d2f986bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:40.060629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2af50389-2e75-4889-adb8-9ac0d2f986bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:40.061107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2af50389-2e75-4889-adb8-9ac0d2f986bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:40.061538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2af50389-2e75-4889-adb8-9ac0d2f986bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:40.062862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2af50389-2e75-4889-adb8-9ac0d2f986bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:40.063322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2af50389-2e75-4889-adb8-9ac0d2f986bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:40.063933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2af50389-2e75-4889-adb8-9ac0d2f986bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:40.194618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2af50389-2e75-4889-adb8-9ac0d2f986bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:40.202651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2af50389-2e75-4889-adb8-9ac0d2f986bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152867 Aug 06 12:59:40.203223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1573/3156] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:41.009219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-23391a16-5e1a-4eba-96cc-8e7c4bd0ce6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:41.009822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-23391a16-5e1a-4eba-96cc-8e7c4bd0ce6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:41.016127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23391a16-5e1a-4eba-96cc-8e7c4bd0ce6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:41.016633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23391a16-5e1a-4eba-96cc-8e7c4bd0ce6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:41.017064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23391a16-5e1a-4eba-96cc-8e7c4bd0ce6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:41.017740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23391a16-5e1a-4eba-96cc-8e7c4bd0ce6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:41.018191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23391a16-5e1a-4eba-96cc-8e7c4bd0ce6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:41.018611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23391a16-5e1a-4eba-96cc-8e7c4bd0ce6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:41.142765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23391a16-5e1a-4eba-96cc-8e7c4bd0ce6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:41.151107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-23391a16-5e1a-4eba-96cc-8e7c4bd0ce6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145823 Aug 06 12:59:41.151662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1584/3157] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:41 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:41.223262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bc020a5d-5bff-4a83-ac84-79965f16698b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:41.223866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bc020a5d-5bff-4a83-ac84-79965f16698b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:41.231116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc020a5d-5bff-4a83-ac84-79965f16698b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:41.231586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc020a5d-5bff-4a83-ac84-79965f16698b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:41.232287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc020a5d-5bff-4a83-ac84-79965f16698b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:41.233085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc020a5d-5bff-4a83-ac84-79965f16698b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:41.233537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc020a5d-5bff-4a83-ac84-79965f16698b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:41.233956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc020a5d-5bff-4a83-ac84-79965f16698b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:41.358175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bc020a5d-5bff-4a83-ac84-79965f16698b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:41.365994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bc020a5d-5bff-4a83-ac84-79965f16698b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146549 Aug 06 12:59:41.366550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1574/3158] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:41 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:42.172660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9c2ed7c7-bff4-4973-9ece-acd00ad5a869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:42.173305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9c2ed7c7-bff4-4973-9ece-acd00ad5a869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:42.175649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=52 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:42.181851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c2ed7c7-bff4-4973-9ece-acd00ad5a869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:42.182323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c2ed7c7-bff4-4973-9ece-acd00ad5a869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:42.182759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c2ed7c7-bff4-4973-9ece-acd00ad5a869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:42.183444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c2ed7c7-bff4-4973-9ece-acd00ad5a869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:42.185156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c2ed7c7-bff4-4973-9ece-acd00ad5a869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:42.185590 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c2ed7c7-bff4-4973-9ece-acd00ad5a869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:42.316011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9c2ed7c7-bff4-4973-9ece-acd00ad5a869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:42.324012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9c2ed7c7-bff4-4973-9ece-acd00ad5a869 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155279 Aug 06 12:59:42.324601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1585/3159] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:42 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:42.386993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-86b548a3-2e41-4465-826e-52ac97d8606e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:42.387601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-86b548a3-2e41-4465-826e-52ac97d8606e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:42.393919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-86b548a3-2e41-4465-826e-52ac97d8606e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:42.394397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-86b548a3-2e41-4465-826e-52ac97d8606e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:42.394830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-86b548a3-2e41-4465-826e-52ac97d8606e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:42.395504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-86b548a3-2e41-4465-826e-52ac97d8606e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:42.395952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-86b548a3-2e41-4465-826e-52ac97d8606e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:42.396395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-86b548a3-2e41-4465-826e-52ac97d8606e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:42.527002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-86b548a3-2e41-4465-826e-52ac97d8606e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:42.534882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-86b548a3-2e41-4465-826e-52ac97d8606e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151783 Aug 06 12:59:42.535445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1575/3160] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:42 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:43.345153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a7d744c8-6005-4691-b171-1994ce3efa10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:43.345777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a7d744c8-6005-4691-b171-1994ce3efa10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:43.352361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7d744c8-6005-4691-b171-1994ce3efa10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:43.352842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7d744c8-6005-4691-b171-1994ce3efa10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:43.353269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7d744c8-6005-4691-b171-1994ce3efa10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:43.353945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7d744c8-6005-4691-b171-1994ce3efa10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:43.354393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7d744c8-6005-4691-b171-1994ce3efa10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:43.354810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a7d744c8-6005-4691-b171-1994ce3efa10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:43.478951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a7d744c8-6005-4691-b171-1994ce3efa10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:43.487046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a7d744c8-6005-4691-b171-1994ce3efa10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145694 Aug 06 12:59:43.487599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1586/3161] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:43 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:43.556910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-72070650-1037-4245-9707-a0f74f49fdbf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:43.557520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-72070650-1037-4245-9707-a0f74f49fdbf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:43.563876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72070650-1037-4245-9707-a0f74f49fdbf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:43.564393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72070650-1037-4245-9707-a0f74f49fdbf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:43.564834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72070650-1037-4245-9707-a0f74f49fdbf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:43.565519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72070650-1037-4245-9707-a0f74f49fdbf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:43.565972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72070650-1037-4245-9707-a0f74f49fdbf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:43.566397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72070650-1037-4245-9707-a0f74f49fdbf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:43.691038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-72070650-1037-4245-9707-a0f74f49fdbf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:43.699525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-72070650-1037-4245-9707-a0f74f49fdbf tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147041 Aug 06 12:59:43.700088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1576/3162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:44.509037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9ae233dd-a349-4923-a7b0-742b0016cd66 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:44.509625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9ae233dd-a349-4923-a7b0-742b0016cd66 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:44.516013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ae233dd-a349-4923-a7b0-742b0016cd66 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:44.516525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ae233dd-a349-4923-a7b0-742b0016cd66 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:44.516956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ae233dd-a349-4923-a7b0-742b0016cd66 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:44.517630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ae233dd-a349-4923-a7b0-742b0016cd66 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:44.518078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ae233dd-a349-4923-a7b0-742b0016cd66 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:44.518496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ae233dd-a349-4923-a7b0-742b0016cd66 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:44.643579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9ae233dd-a349-4923-a7b0-742b0016cd66 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:44.652178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9ae233dd-a349-4923-a7b0-742b0016cd66 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147473 Aug 06 12:59:44.652868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1587/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:44 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:44.720019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-463db7bc-2ea7-4150-9232-cd95d3d75d3a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:44.720723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-463db7bc-2ea7-4150-9232-cd95d3d75d3a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:44.727127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-463db7bc-2ea7-4150-9232-cd95d3d75d3a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:44.727601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-463db7bc-2ea7-4150-9232-cd95d3d75d3a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:44.728026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-463db7bc-2ea7-4150-9232-cd95d3d75d3a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:44.728720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-463db7bc-2ea7-4150-9232-cd95d3d75d3a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:44.729167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-463db7bc-2ea7-4150-9232-cd95d3d75d3a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:44.729586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-463db7bc-2ea7-4150-9232-cd95d3d75d3a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:44.858599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-463db7bc-2ea7-4150-9232-cd95d3d75d3a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:44.866974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-463db7bc-2ea7-4150-9232-cd95d3d75d3a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150745 Aug 06 12:59:44.867540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1577/3164] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:45.673341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bf22d6a6-b3ae-4ba5-9426-8c4615c83253 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:45.673946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bf22d6a6-b3ae-4ba5-9426-8c4615c83253 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:45.679894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf22d6a6-b3ae-4ba5-9426-8c4615c83253 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:45.680403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf22d6a6-b3ae-4ba5-9426-8c4615c83253 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:45.680837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf22d6a6-b3ae-4ba5-9426-8c4615c83253 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:45.681514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf22d6a6-b3ae-4ba5-9426-8c4615c83253 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:45.681965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf22d6a6-b3ae-4ba5-9426-8c4615c83253 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:45.682383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf22d6a6-b3ae-4ba5-9426-8c4615c83253 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:45.686199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:45.813345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bf22d6a6-b3ae-4ba5-9426-8c4615c83253 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:45.821287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bf22d6a6-b3ae-4ba5-9426-8c4615c83253 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151896 Aug 06 12:59:45.821852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1588/3165] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:45 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:45.889387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff02913f-474d-434d-aec7-dd9b4aca1b9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:45.889992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ff02913f-474d-434d-aec7-dd9b4aca1b9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:45.896806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff02913f-474d-434d-aec7-dd9b4aca1b9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:45.897277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff02913f-474d-434d-aec7-dd9b4aca1b9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:45.897704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff02913f-474d-434d-aec7-dd9b4aca1b9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:45.898378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff02913f-474d-434d-aec7-dd9b4aca1b9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:45.898825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff02913f-474d-434d-aec7-dd9b4aca1b9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:45.899244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff02913f-474d-434d-aec7-dd9b4aca1b9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:46.027453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ff02913f-474d-434d-aec7-dd9b4aca1b9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:46.036225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff02913f-474d-434d-aec7-dd9b4aca1b9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150681 Aug 06 12:59:46.036814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1578/3166] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:46.842956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d0a2ce6a-bb23-4fb9-985f-5a4748bc6efd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:46.843566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d0a2ce6a-bb23-4fb9-985f-5a4748bc6efd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:46.850429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a2ce6a-bb23-4fb9-985f-5a4748bc6efd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:46.850901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a2ce6a-bb23-4fb9-985f-5a4748bc6efd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:46.851326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a2ce6a-bb23-4fb9-985f-5a4748bc6efd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:46.852024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a2ce6a-bb23-4fb9-985f-5a4748bc6efd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:46.852496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a2ce6a-bb23-4fb9-985f-5a4748bc6efd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:46.852912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d0a2ce6a-bb23-4fb9-985f-5a4748bc6efd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:46.979100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d0a2ce6a-bb23-4fb9-985f-5a4748bc6efd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:46.987088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d0a2ce6a-bb23-4fb9-985f-5a4748bc6efd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147962 Aug 06 12:59:46.987637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1589/3167] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:46 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:47.057139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8f2252fa-a734-4a0b-b749-e870e9b90bcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:47.057816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8f2252fa-a734-4a0b-b749-e870e9b90bcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:47.065880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f2252fa-a734-4a0b-b749-e870e9b90bcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:47.066362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f2252fa-a734-4a0b-b749-e870e9b90bcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:47.066796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f2252fa-a734-4a0b-b749-e870e9b90bcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:47.067478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f2252fa-a734-4a0b-b749-e870e9b90bcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:47.067962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f2252fa-a734-4a0b-b749-e870e9b90bcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:47.068409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f2252fa-a734-4a0b-b749-e870e9b90bcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:47.070976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 12:59:47.196331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8f2252fa-a734-4a0b-b749-e870e9b90bcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:47.204069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8f2252fa-a734-4a0b-b749-e870e9b90bcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151497 Aug 06 12:59:47.204669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1579/3168] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:48.009716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fdc456d5-fe9b-430a-b3f9-0d3d0a4f0e24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:48.010323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fdc456d5-fe9b-430a-b3f9-0d3d0a4f0e24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:48.016849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fdc456d5-fe9b-430a-b3f9-0d3d0a4f0e24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:48.017326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fdc456d5-fe9b-430a-b3f9-0d3d0a4f0e24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:48.017758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fdc456d5-fe9b-430a-b3f9-0d3d0a4f0e24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:48.018437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fdc456d5-fe9b-430a-b3f9-0d3d0a4f0e24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:48.018887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fdc456d5-fe9b-430a-b3f9-0d3d0a4f0e24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:48.019307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fdc456d5-fe9b-430a-b3f9-0d3d0a4f0e24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:48.148369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fdc456d5-fe9b-430a-b3f9-0d3d0a4f0e24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:48.156384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fdc456d5-fe9b-430a-b3f9-0d3d0a4f0e24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151100 Aug 06 12:59:48.156944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1590/3169] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:48 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:48.225638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5ded915f-fb25-402e-b709-d1e6467d4c8d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:48.226242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5ded915f-fb25-402e-b709-d1e6467d4c8d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:48.232851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ded915f-fb25-402e-b709-d1e6467d4c8d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:48.233325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ded915f-fb25-402e-b709-d1e6467d4c8d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:48.233760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ded915f-fb25-402e-b709-d1e6467d4c8d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:48.234434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ded915f-fb25-402e-b709-d1e6467d4c8d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:48.234881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ded915f-fb25-402e-b709-d1e6467d4c8d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:48.235298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ded915f-fb25-402e-b709-d1e6467d4c8d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:48.365686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5ded915f-fb25-402e-b709-d1e6467d4c8d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:48.373541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5ded915f-fb25-402e-b709-d1e6467d4c8d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151701 Aug 06 12:59:48.374100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1580/3170] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:49.177593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c78d55e2-b6de-450a-b2ee-c2f56b041499 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:49.178127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c78d55e2-b6de-450a-b2ee-c2f56b041499 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:49.186204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c78d55e2-b6de-450a-b2ee-c2f56b041499 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:49.186990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c78d55e2-b6de-450a-b2ee-c2f56b041499 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:49.187633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c78d55e2-b6de-450a-b2ee-c2f56b041499 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:49.188553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c78d55e2-b6de-450a-b2ee-c2f56b041499 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:49.189175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c78d55e2-b6de-450a-b2ee-c2f56b041499 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:49.189768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c78d55e2-b6de-450a-b2ee-c2f56b041499 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:49.320883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c78d55e2-b6de-450a-b2ee-c2f56b041499 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:49.328946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c78d55e2-b6de-450a-b2ee-c2f56b041499 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155333 Aug 06 12:59:49.329492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1591/3171] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:49 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:49.394077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-97c8620e-a616-4601-9ad7-41c1bd232653 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:49.394675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-97c8620e-a616-4601-9ad7-41c1bd232653 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:49.401034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97c8620e-a616-4601-9ad7-41c1bd232653 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:49.401506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97c8620e-a616-4601-9ad7-41c1bd232653 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:49.401931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97c8620e-a616-4601-9ad7-41c1bd232653 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:49.402608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97c8620e-a616-4601-9ad7-41c1bd232653 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:49.403053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97c8620e-a616-4601-9ad7-41c1bd232653 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:49.404827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97c8620e-a616-4601-9ad7-41c1bd232653 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:49.533612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-97c8620e-a616-4601-9ad7-41c1bd232653 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:49.542102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-97c8620e-a616-4601-9ad7-41c1bd232653 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151863 Aug 06 12:59:49.542665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1581/3172] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:50.349690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e406f8dc-5616-4b4b-acb4-14397495a07c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:50.350323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e406f8dc-5616-4b4b-acb4-14397495a07c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:50.356636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e406f8dc-5616-4b4b-acb4-14397495a07c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:50.357353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e406f8dc-5616-4b4b-acb4-14397495a07c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:50.357776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e406f8dc-5616-4b4b-acb4-14397495a07c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:50.358441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e406f8dc-5616-4b4b-acb4-14397495a07c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:50.358886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e406f8dc-5616-4b4b-acb4-14397495a07c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:50.359300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e406f8dc-5616-4b4b-acb4-14397495a07c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:50.485957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e406f8dc-5616-4b4b-acb4-14397495a07c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:50.494290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e406f8dc-5616-4b4b-acb4-14397495a07c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148455 Aug 06 12:59:50.494849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1592/3173] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:50 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:50.562717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5dec6e82-86bd-43ef-83cc-ab7af0c9fb2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:50.563319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5dec6e82-86bd-43ef-83cc-ab7af0c9fb2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:50.569667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dec6e82-86bd-43ef-83cc-ab7af0c9fb2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:50.570135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dec6e82-86bd-43ef-83cc-ab7af0c9fb2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:50.570561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dec6e82-86bd-43ef-83cc-ab7af0c9fb2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:50.571237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dec6e82-86bd-43ef-83cc-ab7af0c9fb2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:50.571681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dec6e82-86bd-43ef-83cc-ab7af0c9fb2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:50.572097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5dec6e82-86bd-43ef-83cc-ab7af0c9fb2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:50.957497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5dec6e82-86bd-43ef-83cc-ab7af0c9fb2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:50.965810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5dec6e82-86bd-43ef-83cc-ab7af0c9fb2d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.406890 Aug 06 12:59:50.966363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1582/3174] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:51.516342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f86c2789-c502-4aee-a7b7-bc6a835a87c1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:51.516935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f86c2789-c502-4aee-a7b7-bc6a835a87c1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:51.524453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f86c2789-c502-4aee-a7b7-bc6a835a87c1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:51.525033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f86c2789-c502-4aee-a7b7-bc6a835a87c1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:51.525476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f86c2789-c502-4aee-a7b7-bc6a835a87c1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:51.526175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f86c2789-c502-4aee-a7b7-bc6a835a87c1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:51.526952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f86c2789-c502-4aee-a7b7-bc6a835a87c1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:51.527384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f86c2789-c502-4aee-a7b7-bc6a835a87c1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:51.655789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f86c2789-c502-4aee-a7b7-bc6a835a87c1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:51.663640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f86c2789-c502-4aee-a7b7-bc6a835a87c1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151167 Aug 06 12:59:51.664200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1593/3175] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:51 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 12:59:51.987187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a233a7a5-0b0b-4d79-bd2c-7dbd45b2c35a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:51.987803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a233a7a5-0b0b-4d79-bd2c-7dbd45b2c35a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:51.994757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a233a7a5-0b0b-4d79-bd2c-7dbd45b2c35a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:51.995242 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a233a7a5-0b0b-4d79-bd2c-7dbd45b2c35a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:51.995678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a233a7a5-0b0b-4d79-bd2c-7dbd45b2c35a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:51.996394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a233a7a5-0b0b-4d79-bd2c-7dbd45b2c35a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:51.996852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a233a7a5-0b0b-4d79-bd2c-7dbd45b2c35a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:51.997276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a233a7a5-0b0b-4d79-bd2c-7dbd45b2c35a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:52.122795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a233a7a5-0b0b-4d79-bd2c-7dbd45b2c35a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:52.130697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a233a7a5-0b0b-4d79-bd2c-7dbd45b2c35a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147352 Aug 06 12:59:52.131264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1583/3176] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:52.684543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2f656a1a-77b0-4c3a-99b6-3a77be83a7ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:52.685139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2f656a1a-77b0-4c3a-99b6-3a77be83a7ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:52.691467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f656a1a-77b0-4c3a-99b6-3a77be83a7ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:52.691940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f656a1a-77b0-4c3a-99b6-3a77be83a7ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:52.692390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f656a1a-77b0-4c3a-99b6-3a77be83a7ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:52.693089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f656a1a-77b0-4c3a-99b6-3a77be83a7ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:52.693529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f656a1a-77b0-4c3a-99b6-3a77be83a7ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:52.693943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f656a1a-77b0-4c3a-99b6-3a77be83a7ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:52.823529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2f656a1a-77b0-4c3a-99b6-3a77be83a7ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:52.831420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2f656a1a-77b0-4c3a-99b6-3a77be83a7ee tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150797 Aug 06 12:59:52.831967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1594/3177] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:52 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:53.150996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ce7386b5-fac1-4290-8071-714d8075ce49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:53.151636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ce7386b5-fac1-4290-8071-714d8075ce49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:53.158095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7386b5-fac1-4290-8071-714d8075ce49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:53.158574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7386b5-fac1-4290-8071-714d8075ce49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:53.159006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7386b5-fac1-4290-8071-714d8075ce49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:53.159721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7386b5-fac1-4290-8071-714d8075ce49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:53.160173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7386b5-fac1-4290-8071-714d8075ce49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:53.160628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7386b5-fac1-4290-8071-714d8075ce49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:53.288545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ce7386b5-fac1-4290-8071-714d8075ce49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:53.296510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ce7386b5-fac1-4290-8071-714d8075ce49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149404 Aug 06 12:59:53.297076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1584/3178] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:53.853507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bd939ab0-4fa1-410f-9a04-19fde44f672a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:53.854107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bd939ab0-4fa1-410f-9a04-19fde44f672a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:53.860915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd939ab0-4fa1-410f-9a04-19fde44f672a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:53.861399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd939ab0-4fa1-410f-9a04-19fde44f672a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:53.861828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd939ab0-4fa1-410f-9a04-19fde44f672a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:53.862513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd939ab0-4fa1-410f-9a04-19fde44f672a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:53.862984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd939ab0-4fa1-410f-9a04-19fde44f672a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:53.863404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd939ab0-4fa1-410f-9a04-19fde44f672a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:53.992158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd939ab0-4fa1-410f-9a04-19fde44f672a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:54.000164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bd939ab0-4fa1-410f-9a04-19fde44f672a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150443 Aug 06 12:59:54.000760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1595/3179] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:53 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:54.316807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e427b7ec-6394-425e-b8e4-1ce59234ba38 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:54.317412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e427b7ec-6394-425e-b8e4-1ce59234ba38 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:54.324258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e427b7ec-6394-425e-b8e4-1ce59234ba38 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:54.324760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e427b7ec-6394-425e-b8e4-1ce59234ba38 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:54.325189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e427b7ec-6394-425e-b8e4-1ce59234ba38 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:54.325897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e427b7ec-6394-425e-b8e4-1ce59234ba38 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:54.326347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e427b7ec-6394-425e-b8e4-1ce59234ba38 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:54.326763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e427b7ec-6394-425e-b8e4-1ce59234ba38 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:54.452667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e427b7ec-6394-425e-b8e4-1ce59234ba38 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:54.461151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e427b7ec-6394-425e-b8e4-1ce59234ba38 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148138 Aug 06 12:59:54.461730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1585/3180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:55.022026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d67999ef-1130-4894-a3ba-ec492101dd39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:55.022654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d67999ef-1130-4894-a3ba-ec492101dd39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:55.028992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d67999ef-1130-4894-a3ba-ec492101dd39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:55.029466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d67999ef-1130-4894-a3ba-ec492101dd39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:55.029888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d67999ef-1130-4894-a3ba-ec492101dd39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:55.030556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d67999ef-1130-4894-a3ba-ec492101dd39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:55.031055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d67999ef-1130-4894-a3ba-ec492101dd39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:55.031472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d67999ef-1130-4894-a3ba-ec492101dd39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:55.155517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d67999ef-1130-4894-a3ba-ec492101dd39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:55.163556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d67999ef-1130-4894-a3ba-ec492101dd39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146042 Aug 06 12:59:55.164121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1596/3181] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:55 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:55.482174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8776b39d-598f-4131-ac04-46d3c54b4eff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:55.482802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8776b39d-598f-4131-ac04-46d3c54b4eff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:55.489236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8776b39d-598f-4131-ac04-46d3c54b4eff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:55.490205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8776b39d-598f-4131-ac04-46d3c54b4eff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:55.490636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8776b39d-598f-4131-ac04-46d3c54b4eff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:55.491315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8776b39d-598f-4131-ac04-46d3c54b4eff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:55.491766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8776b39d-598f-4131-ac04-46d3c54b4eff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:55.492188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8776b39d-598f-4131-ac04-46d3c54b4eff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:55.615192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8776b39d-598f-4131-ac04-46d3c54b4eff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:55.622984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8776b39d-598f-4131-ac04-46d3c54b4eff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145010 Aug 06 12:59:55.623555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1586/3182] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:56.185275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ec38c7b6-0ed0-4339-9745-1636439d6997 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:56.185901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ec38c7b6-0ed0-4339-9745-1636439d6997 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:56.192165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec38c7b6-0ed0-4339-9745-1636439d6997 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:56.192667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec38c7b6-0ed0-4339-9745-1636439d6997 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:56.193094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec38c7b6-0ed0-4339-9745-1636439d6997 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:56.193766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec38c7b6-0ed0-4339-9745-1636439d6997 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:56.194211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec38c7b6-0ed0-4339-9745-1636439d6997 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:56.194626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec38c7b6-0ed0-4339-9745-1636439d6997 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:56.323424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ec38c7b6-0ed0-4339-9745-1636439d6997 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:56.331152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ec38c7b6-0ed0-4339-9745-1636439d6997 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149747 Aug 06 12:59:56.331710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1597/3183] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:56 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:56.644463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6d803c3a-da49-45c6-88b9-74f97a92b6dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:56.645096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6d803c3a-da49-45c6-88b9-74f97a92b6dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:56.652039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d803c3a-da49-45c6-88b9-74f97a92b6dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:56.652545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d803c3a-da49-45c6-88b9-74f97a92b6dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:56.652978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d803c3a-da49-45c6-88b9-74f97a92b6dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:56.653650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d803c3a-da49-45c6-88b9-74f97a92b6dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:56.654097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d803c3a-da49-45c6-88b9-74f97a92b6dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:56.654514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d803c3a-da49-45c6-88b9-74f97a92b6dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:56.783408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6d803c3a-da49-45c6-88b9-74f97a92b6dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:56.791647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6d803c3a-da49-45c6-88b9-74f97a92b6dc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150995 Aug 06 12:59:56.792227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1587/3184] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:57.353116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-684c22a5-95b5-452e-b4fb-5634de3b5d24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:57.353713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-684c22a5-95b5-452e-b4fb-5634de3b5d24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:57.360276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-684c22a5-95b5-452e-b4fb-5634de3b5d24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:57.360773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-684c22a5-95b5-452e-b4fb-5634de3b5d24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:57.361195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-684c22a5-95b5-452e-b4fb-5634de3b5d24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:57.361860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-684c22a5-95b5-452e-b4fb-5634de3b5d24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:57.362306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-684c22a5-95b5-452e-b4fb-5634de3b5d24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:57.362722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-684c22a5-95b5-452e-b4fb-5634de3b5d24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:57.487389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-684c22a5-95b5-452e-b4fb-5634de3b5d24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:57.496047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-684c22a5-95b5-452e-b4fb-5634de3b5d24 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147255 Aug 06 12:59:57.496623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1598/3185] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:57 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:57.813329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0540b9c-9e3c-47a8-9408-b41a987a871e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:57.813922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0540b9c-9e3c-47a8-9408-b41a987a871e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:57.820448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0540b9c-9e3c-47a8-9408-b41a987a871e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:57.820928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0540b9c-9e3c-47a8-9408-b41a987a871e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:57.821362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0540b9c-9e3c-47a8-9408-b41a987a871e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:57.822045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0540b9c-9e3c-47a8-9408-b41a987a871e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:57.822497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0540b9c-9e3c-47a8-9408-b41a987a871e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:57.822921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0540b9c-9e3c-47a8-9408-b41a987a871e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:57.949744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0540b9c-9e3c-47a8-9408-b41a987a871e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:57.957543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0540b9c-9e3c-47a8-9408-b41a987a871e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148110 Aug 06 12:59:57.958621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1588/3186] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:58.516700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5e33b6c9-d984-4684-a110-3c3d71fc0e4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:58.517297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5e33b6c9-d984-4684-a110-3c3d71fc0e4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:58.523665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e33b6c9-d984-4684-a110-3c3d71fc0e4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:58.524135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e33b6c9-d984-4684-a110-3c3d71fc0e4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:58.524595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e33b6c9-d984-4684-a110-3c3d71fc0e4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:58.525263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e33b6c9-d984-4684-a110-3c3d71fc0e4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:58.525706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e33b6c9-d984-4684-a110-3c3d71fc0e4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:58.526123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5e33b6c9-d984-4684-a110-3c3d71fc0e4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:58.650427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5e33b6c9-d984-4684-a110-3c3d71fc0e4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:58.658209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5e33b6c9-d984-4684-a110-3c3d71fc0e4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145346 Aug 06 12:59:58.658763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1599/3187] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:58 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:58.979390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-643180f5-bd91-4e3c-a30a-fbf0438f1217 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:58.979982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-643180f5-bd91-4e3c-a30a-fbf0438f1217 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:58.986678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-643180f5-bd91-4e3c-a30a-fbf0438f1217 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:58.987158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-643180f5-bd91-4e3c-a30a-fbf0438f1217 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:58.987587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-643180f5-bd91-4e3c-a30a-fbf0438f1217 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:58.988261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-643180f5-bd91-4e3c-a30a-fbf0438f1217 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:58.988739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-643180f5-bd91-4e3c-a30a-fbf0438f1217 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:58.989193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-643180f5-bd91-4e3c-a30a-fbf0438f1217 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:59.117885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-643180f5-bd91-4e3c-a30a-fbf0438f1217 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:59.125979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-643180f5-bd91-4e3c-a30a-fbf0438f1217 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150423 Aug 06 12:59:59.126557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1589/3188] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 12:59:59.679027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a50780e5-f418-4f1f-9bb0-abb136ed09c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 12:59:59.679631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a50780e5-f418-4f1f-9bb0-abb136ed09c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 12:59:59.685982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a50780e5-f418-4f1f-9bb0-abb136ed09c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:59.686454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a50780e5-f418-4f1f-9bb0-abb136ed09c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:59.686881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a50780e5-f418-4f1f-9bb0-abb136ed09c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:59.687555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a50780e5-f418-4f1f-9bb0-abb136ed09c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 12:59:59.688000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a50780e5-f418-4f1f-9bb0-abb136ed09c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 12:59:59.688465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a50780e5-f418-4f1f-9bb0-abb136ed09c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 12:59:59.819895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a50780e5-f418-4f1f-9bb0-abb136ed09c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 12:59:59.827777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a50780e5-f418-4f1f-9bb0-abb136ed09c3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152633 Aug 06 12:59:59.828348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1600/3189] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 12:59:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:00.146921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-df0db6c8-e22f-4166-92de-958858008e5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:00.147460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df0db6c8-e22f-4166-92de-958858008e5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:00.153789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df0db6c8-e22f-4166-92de-958858008e5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:00.154272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df0db6c8-e22f-4166-92de-958858008e5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:00.154712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df0db6c8-e22f-4166-92de-958858008e5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:00.155394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df0db6c8-e22f-4166-92de-958858008e5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:00.155852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df0db6c8-e22f-4166-92de-958858008e5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:00.156279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df0db6c8-e22f-4166-92de-958858008e5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:00.288083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df0db6c8-e22f-4166-92de-958858008e5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:00.295876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-df0db6c8-e22f-4166-92de-958858008e5f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152901 Aug 06 13:00:00.296460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1590/3190] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:00.849078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-896af87a-cd98-42c6-af14-0943f61818a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:00.850365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-896af87a-cd98-42c6-af14-0943f61818a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:00.856949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-896af87a-cd98-42c6-af14-0943f61818a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:00.857461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-896af87a-cd98-42c6-af14-0943f61818a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:00.857890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-896af87a-cd98-42c6-af14-0943f61818a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:00.858572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-896af87a-cd98-42c6-af14-0943f61818a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:00.859021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-896af87a-cd98-42c6-af14-0943f61818a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:00.859444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-896af87a-cd98-42c6-af14-0943f61818a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:00.984470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-896af87a-cd98-42c6-af14-0943f61818a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:00.992367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-896af87a-cd98-42c6-af14-0943f61818a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147118 Aug 06 13:00:00.992931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1601/3191] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:00 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:01.318741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9be00772-d1e7-4e74-8b9c-e921d99566b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:01.319341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9be00772-d1e7-4e74-8b9c-e921d99566b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:01.325750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9be00772-d1e7-4e74-8b9c-e921d99566b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:01.326223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9be00772-d1e7-4e74-8b9c-e921d99566b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:01.326651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9be00772-d1e7-4e74-8b9c-e921d99566b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:01.327331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9be00772-d1e7-4e74-8b9c-e921d99566b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:01.327775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9be00772-d1e7-4e74-8b9c-e921d99566b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:01.328195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9be00772-d1e7-4e74-8b9c-e921d99566b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:01.457294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9be00772-d1e7-4e74-8b9c-e921d99566b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:01.465246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9be00772-d1e7-4e74-8b9c-e921d99566b1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150785 Aug 06 13:00:01.465821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1591/3192] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:01 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:02.013298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-346c0821-8bfc-4391-9273-a2ba421a647d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:02.013911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-346c0821-8bfc-4391-9273-a2ba421a647d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:02.020334 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-346c0821-8bfc-4391-9273-a2ba421a647d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:02.020880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-346c0821-8bfc-4391-9273-a2ba421a647d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:02.021271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-346c0821-8bfc-4391-9273-a2ba421a647d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:02.021960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-346c0821-8bfc-4391-9273-a2ba421a647d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:02.022414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-346c0821-8bfc-4391-9273-a2ba421a647d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:02.022838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-346c0821-8bfc-4391-9273-a2ba421a647d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:02.170720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-346c0821-8bfc-4391-9273-a2ba421a647d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:02.178662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-346c0821-8bfc-4391-9273-a2ba421a647d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.169222 Aug 06 13:00:02.179232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1602/3193] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:02 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:02.487969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8a4c332d-8b51-4155-91b9-067de52e8fd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:02.488601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8a4c332d-8b51-4155-91b9-067de52e8fd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:02.495005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a4c332d-8b51-4155-91b9-067de52e8fd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:02.495485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a4c332d-8b51-4155-91b9-067de52e8fd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:02.495921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a4c332d-8b51-4155-91b9-067de52e8fd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:02.496635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a4c332d-8b51-4155-91b9-067de52e8fd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:02.497090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a4c332d-8b51-4155-91b9-067de52e8fd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:02.497513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a4c332d-8b51-4155-91b9-067de52e8fd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:02.624155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8a4c332d-8b51-4155-91b9-067de52e8fd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:02.632501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8a4c332d-8b51-4155-91b9-067de52e8fd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148383 Aug 06 13:00:02.633075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1592/3194] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:03.199544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d43ecdab-b987-4f19-b5d5-e03417eae5c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:03.200193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d43ecdab-b987-4f19-b5d5-e03417eae5c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:03.206691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d43ecdab-b987-4f19-b5d5-e03417eae5c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:03.207168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d43ecdab-b987-4f19-b5d5-e03417eae5c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:03.207597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d43ecdab-b987-4f19-b5d5-e03417eae5c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:03.208272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d43ecdab-b987-4f19-b5d5-e03417eae5c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:03.208748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d43ecdab-b987-4f19-b5d5-e03417eae5c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:03.209167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d43ecdab-b987-4f19-b5d5-e03417eae5c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:03.334878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d43ecdab-b987-4f19-b5d5-e03417eae5c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:03.342882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d43ecdab-b987-4f19-b5d5-e03417eae5c4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147218 Aug 06 13:00:03.343437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1603/3195] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:03 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:03.653418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc5289ed-4b90-4d60-aa7b-dd29d69c0801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:03.653960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cc5289ed-4b90-4d60-aa7b-dd29d69c0801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:03.659912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc5289ed-4b90-4d60-aa7b-dd29d69c0801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:03.660422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc5289ed-4b90-4d60-aa7b-dd29d69c0801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:03.660861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc5289ed-4b90-4d60-aa7b-dd29d69c0801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:03.661546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc5289ed-4b90-4d60-aa7b-dd29d69c0801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:03.662614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc5289ed-4b90-4d60-aa7b-dd29d69c0801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:03.663041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc5289ed-4b90-4d60-aa7b-dd29d69c0801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:03.789539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc5289ed-4b90-4d60-aa7b-dd29d69c0801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:03.797366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc5289ed-4b90-4d60-aa7b-dd29d69c0801 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147981 Aug 06 13:00:03.797924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1593/3196] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:04.365527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8652d9bf-c65b-4f35-8574-62b079568f2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:04.366106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8652d9bf-c65b-4f35-8574-62b079568f2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:04.372430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8652d9bf-c65b-4f35-8574-62b079568f2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:04.372903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8652d9bf-c65b-4f35-8574-62b079568f2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:04.373329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8652d9bf-c65b-4f35-8574-62b079568f2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:04.373999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8652d9bf-c65b-4f35-8574-62b079568f2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:04.374443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8652d9bf-c65b-4f35-8574-62b079568f2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:04.374857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8652d9bf-c65b-4f35-8574-62b079568f2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:04.499063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8652d9bf-c65b-4f35-8574-62b079568f2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:04.501255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:00:04.508756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8652d9bf-c65b-4f35-8574-62b079568f2d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147612 Aug 06 13:00:04.509316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1604/3197] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:04 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:04.817914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3de74c8f-69bd-44da-ab35-99ad0b8e4dd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:04.818520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3de74c8f-69bd-44da-ab35-99ad0b8e4dd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:04.824856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3de74c8f-69bd-44da-ab35-99ad0b8e4dd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:04.825350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3de74c8f-69bd-44da-ab35-99ad0b8e4dd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:04.825763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3de74c8f-69bd-44da-ab35-99ad0b8e4dd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:04.826438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3de74c8f-69bd-44da-ab35-99ad0b8e4dd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:04.826884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3de74c8f-69bd-44da-ab35-99ad0b8e4dd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:04.827302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3de74c8f-69bd-44da-ab35-99ad0b8e4dd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:04.957084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3de74c8f-69bd-44da-ab35-99ad0b8e4dd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:04.964930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3de74c8f-69bd-44da-ab35-99ad0b8e4dd4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150870 Aug 06 13:00:04.965484 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1594/3198] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:05.529820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5ee0d60f-0a36-4ca1-b227-39220a4446cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:05.530421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5ee0d60f-0a36-4ca1-b227-39220a4446cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:05.536771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee0d60f-0a36-4ca1-b227-39220a4446cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:05.537242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee0d60f-0a36-4ca1-b227-39220a4446cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:05.537671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee0d60f-0a36-4ca1-b227-39220a4446cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:05.538345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee0d60f-0a36-4ca1-b227-39220a4446cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:05.538819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee0d60f-0a36-4ca1-b227-39220a4446cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:05.539268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ee0d60f-0a36-4ca1-b227-39220a4446cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:05.666152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5ee0d60f-0a36-4ca1-b227-39220a4446cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:05.673916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5ee0d60f-0a36-4ca1-b227-39220a4446cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148207 Aug 06 13:00:05.674412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1605/3199] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:05.986752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b7ae3945-ed0a-4232-b05b-3277b25dc0b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:05.987316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b7ae3945-ed0a-4232-b05b-3277b25dc0b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:05.994393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7ae3945-ed0a-4232-b05b-3277b25dc0b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:05.994880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7ae3945-ed0a-4232-b05b-3277b25dc0b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:05.995326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7ae3945-ed0a-4232-b05b-3277b25dc0b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:05.996028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7ae3945-ed0a-4232-b05b-3277b25dc0b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:05.996516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7ae3945-ed0a-4232-b05b-3277b25dc0b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:05.996949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7ae3945-ed0a-4232-b05b-3277b25dc0b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:06.126700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b7ae3945-ed0a-4232-b05b-3277b25dc0b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:06.128907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:00:06.136421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b7ae3945-ed0a-4232-b05b-3277b25dc0b4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153644 Aug 06 13:00:06.136986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1595/3200] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:06.694751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e616910a-97a1-45f1-83b8-3b37a6af7bec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:06.695348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e616910a-97a1-45f1-83b8-3b37a6af7bec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:06.701680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e616910a-97a1-45f1-83b8-3b37a6af7bec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:06.702153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e616910a-97a1-45f1-83b8-3b37a6af7bec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:06.702580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e616910a-97a1-45f1-83b8-3b37a6af7bec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:06.703246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e616910a-97a1-45f1-83b8-3b37a6af7bec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:06.703693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e616910a-97a1-45f1-83b8-3b37a6af7bec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:06.704108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e616910a-97a1-45f1-83b8-3b37a6af7bec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:06.828680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e616910a-97a1-45f1-83b8-3b37a6af7bec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:06.836941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e616910a-97a1-45f1-83b8-3b37a6af7bec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146066 Aug 06 13:00:06.837496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1606/3201] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:07.158877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-78d5de5d-75a9-4c85-bcf6-a65989f78e91 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:07.159514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-78d5de5d-75a9-4c85-bcf6-a65989f78e91 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:07.165935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78d5de5d-75a9-4c85-bcf6-a65989f78e91 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:07.166411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78d5de5d-75a9-4c85-bcf6-a65989f78e91 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:07.166846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78d5de5d-75a9-4c85-bcf6-a65989f78e91 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:07.167526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78d5de5d-75a9-4c85-bcf6-a65989f78e91 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:07.167979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78d5de5d-75a9-4c85-bcf6-a65989f78e91 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:07.168429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78d5de5d-75a9-4c85-bcf6-a65989f78e91 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:07.294849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-78d5de5d-75a9-4c85-bcf6-a65989f78e91 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:07.302697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-78d5de5d-75a9-4c85-bcf6-a65989f78e91 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147650 Aug 06 13:00:07.303254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1596/3202] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:07.858487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0854a043-f43c-4b63-9f45-724c39a5566d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:07.859086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0854a043-f43c-4b63-9f45-724c39a5566d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:07.866146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0854a043-f43c-4b63-9f45-724c39a5566d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:07.866622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0854a043-f43c-4b63-9f45-724c39a5566d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:07.867049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0854a043-f43c-4b63-9f45-724c39a5566d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:07.867723 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0854a043-f43c-4b63-9f45-724c39a5566d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:07.868200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0854a043-f43c-4b63-9f45-724c39a5566d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:07.868640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0854a043-f43c-4b63-9f45-724c39a5566d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:07.999947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0854a043-f43c-4b63-9f45-724c39a5566d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:08.007773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0854a043-f43c-4b63-9f45-724c39a5566d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153397 Aug 06 13:00:08.008356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1607/3203] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:07 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:08.323060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fcc9b5ee-5a77-4627-ad8f-584c136a9b61 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:08.323664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fcc9b5ee-5a77-4627-ad8f-584c136a9b61 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:08.325987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=52 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:00:08.331338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcc9b5ee-5a77-4627-ad8f-584c136a9b61 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:08.331821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcc9b5ee-5a77-4627-ad8f-584c136a9b61 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:08.332259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcc9b5ee-5a77-4627-ad8f-584c136a9b61 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:08.332980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcc9b5ee-5a77-4627-ad8f-584c136a9b61 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:08.333933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcc9b5ee-5a77-4627-ad8f-584c136a9b61 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:08.334365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fcc9b5ee-5a77-4627-ad8f-584c136a9b61 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:08.462486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fcc9b5ee-5a77-4627-ad8f-584c136a9b61 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:08.470254 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fcc9b5ee-5a77-4627-ad8f-584c136a9b61 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151162 Aug 06 13:00:08.470816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1597/3204] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:08 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:09.028858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-07d5a645-6235-4736-923a-d1fbc80ba10b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:09.029458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-07d5a645-6235-4736-923a-d1fbc80ba10b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:09.035713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07d5a645-6235-4736-923a-d1fbc80ba10b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:09.036185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07d5a645-6235-4736-923a-d1fbc80ba10b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:09.036647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07d5a645-6235-4736-923a-d1fbc80ba10b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:09.037317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07d5a645-6235-4736-923a-d1fbc80ba10b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:09.037760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07d5a645-6235-4736-923a-d1fbc80ba10b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:09.038174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07d5a645-6235-4736-923a-d1fbc80ba10b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:09.162920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-07d5a645-6235-4736-923a-d1fbc80ba10b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:09.170678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-07d5a645-6235-4736-923a-d1fbc80ba10b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145676 Aug 06 13:00:09.171236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1608/3205] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:09.492525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3df5ae58-f15b-477a-b671-de67b4252696 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:09.493163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3df5ae58-f15b-477a-b671-de67b4252696 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:09.499552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3df5ae58-f15b-477a-b671-de67b4252696 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:09.500032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3df5ae58-f15b-477a-b671-de67b4252696 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:09.500495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3df5ae58-f15b-477a-b671-de67b4252696 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:09.501180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3df5ae58-f15b-477a-b671-de67b4252696 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:09.501639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3df5ae58-f15b-477a-b671-de67b4252696 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:09.502060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3df5ae58-f15b-477a-b671-de67b4252696 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:09.626149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3df5ae58-f15b-477a-b671-de67b4252696 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:09.633901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3df5ae58-f15b-477a-b671-de67b4252696 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146004 Aug 06 13:00:09.634461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1598/3206] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:00:10.191664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e010f353-9d45-47dc-b357-06a80de765ac tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:10.192287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e010f353-9d45-47dc-b357-06a80de765ac tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:10.199117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e010f353-9d45-47dc-b357-06a80de765ac tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:10.199588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e010f353-9d45-47dc-b357-06a80de765ac tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:10.200012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e010f353-9d45-47dc-b357-06a80de765ac tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:10.200710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e010f353-9d45-47dc-b357-06a80de765ac tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:10.201152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e010f353-9d45-47dc-b357-06a80de765ac tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:10.201566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e010f353-9d45-47dc-b357-06a80de765ac tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:10.331412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e010f353-9d45-47dc-b357-06a80de765ac tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:10.339768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e010f353-9d45-47dc-b357-06a80de765ac tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151982 Aug 06 13:00:10.340342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1609/3207] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:10.655013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5a18f186-7950-4f60-a72c-3c93efd9af93 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:10.655649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5a18f186-7950-4f60-a72c-3c93efd9af93 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:10.661999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a18f186-7950-4f60-a72c-3c93efd9af93 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:10.662481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a18f186-7950-4f60-a72c-3c93efd9af93 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:10.662918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a18f186-7950-4f60-a72c-3c93efd9af93 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:10.663606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a18f186-7950-4f60-a72c-3c93efd9af93 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:10.664061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a18f186-7950-4f60-a72c-3c93efd9af93 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:10.664513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a18f186-7950-4f60-a72c-3c93efd9af93 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:10.796168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5a18f186-7950-4f60-a72c-3c93efd9af93 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:10.804722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5a18f186-7950-4f60-a72c-3c93efd9af93 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153567 Aug 06 13:00:10.805290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1599/3208] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:11.360797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-44413483-f9f8-43ff-9048-3d911a251387 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:11.361403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-44413483-f9f8-43ff-9048-3d911a251387 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:11.367857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44413483-f9f8-43ff-9048-3d911a251387 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:11.368371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44413483-f9f8-43ff-9048-3d911a251387 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:11.368805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44413483-f9f8-43ff-9048-3d911a251387 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:11.369488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44413483-f9f8-43ff-9048-3d911a251387 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:11.369942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44413483-f9f8-43ff-9048-3d911a251387 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:11.370364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-44413483-f9f8-43ff-9048-3d911a251387 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:11.494205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-44413483-f9f8-43ff-9048-3d911a251387 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:11.502033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-44413483-f9f8-43ff-9048-3d911a251387 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145343 Aug 06 13:00:11.502591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1610/3209] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:11.825640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-33fab218-4dd1-4685-a962-18e2a10a5af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:11.826251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-33fab218-4dd1-4685-a962-18e2a10a5af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:11.832658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33fab218-4dd1-4685-a962-18e2a10a5af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:11.833136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33fab218-4dd1-4685-a962-18e2a10a5af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:11.834181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33fab218-4dd1-4685-a962-18e2a10a5af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:11.834859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33fab218-4dd1-4685-a962-18e2a10a5af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:11.835348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33fab218-4dd1-4685-a962-18e2a10a5af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:11.835774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33fab218-4dd1-4685-a962-18e2a10a5af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:11.960975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-33fab218-4dd1-4685-a962-18e2a10a5af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:11.968783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-33fab218-4dd1-4685-a962-18e2a10a5af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147016 Aug 06 13:00:11.969387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1600/3210] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:12.523800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c0d217dc-68a5-4de9-bd76-f74dfe2310bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:12.524455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c0d217dc-68a5-4de9-bd76-f74dfe2310bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:12.526781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=52 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:00:12.532500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0d217dc-68a5-4de9-bd76-f74dfe2310bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:12.532989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0d217dc-68a5-4de9-bd76-f74dfe2310bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:12.533427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0d217dc-68a5-4de9-bd76-f74dfe2310bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:12.534132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0d217dc-68a5-4de9-bd76-f74dfe2310bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:12.534588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0d217dc-68a5-4de9-bd76-f74dfe2310bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:12.535014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0d217dc-68a5-4de9-bd76-f74dfe2310bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:12.667804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c0d217dc-68a5-4de9-bd76-f74dfe2310bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:12.675621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c0d217dc-68a5-4de9-bd76-f74dfe2310bc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155698 Aug 06 13:00:12.676180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1611/3211] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:12.989404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7401c9a-e9ee-4f70-aaac-ebdb66bb5563 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:12.990180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7401c9a-e9ee-4f70-aaac-ebdb66bb5563 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:12.996695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7401c9a-e9ee-4f70-aaac-ebdb66bb5563 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:12.997178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7401c9a-e9ee-4f70-aaac-ebdb66bb5563 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:12.997609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7401c9a-e9ee-4f70-aaac-ebdb66bb5563 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:12.998294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7401c9a-e9ee-4f70-aaac-ebdb66bb5563 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:12.998740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7401c9a-e9ee-4f70-aaac-ebdb66bb5563 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:12.999159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7401c9a-e9ee-4f70-aaac-ebdb66bb5563 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:13.136682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7401c9a-e9ee-4f70-aaac-ebdb66bb5563 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:13.146495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7401c9a-e9ee-4f70-aaac-ebdb66bb5563 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.160339 Aug 06 13:00:13.147049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1601/3212] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:00:13.699873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-efada299-0013-4ba2-b7a2-b0242d8eef14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:13.700897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-efada299-0013-4ba2-b7a2-b0242d8eef14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:13.709985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efada299-0013-4ba2-b7a2-b0242d8eef14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:13.710719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efada299-0013-4ba2-b7a2-b0242d8eef14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:13.711398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efada299-0013-4ba2-b7a2-b0242d8eef14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:13.712479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efada299-0013-4ba2-b7a2-b0242d8eef14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:13.713172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efada299-0013-4ba2-b7a2-b0242d8eef14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:13.713799 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efada299-0013-4ba2-b7a2-b0242d8eef14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:14.049734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-efada299-0013-4ba2-b7a2-b0242d8eef14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:14.058220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-efada299-0013-4ba2-b7a2-b0242d8eef14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.365246 Aug 06 13:00:14.058775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1612/3213] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:13 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:14.168375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7832e44d-5a8e-4653-af51-9e04ec25e39a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:14.168967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7832e44d-5a8e-4653-af51-9e04ec25e39a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:14.175375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7832e44d-5a8e-4653-af51-9e04ec25e39a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:14.175849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7832e44d-5a8e-4653-af51-9e04ec25e39a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:14.176277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7832e44d-5a8e-4653-af51-9e04ec25e39a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:14.176986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7832e44d-5a8e-4653-af51-9e04ec25e39a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:14.177431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7832e44d-5a8e-4653-af51-9e04ec25e39a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:14.177846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7832e44d-5a8e-4653-af51-9e04ec25e39a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:14.306302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7832e44d-5a8e-4653-af51-9e04ec25e39a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:14.314228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7832e44d-5a8e-4653-af51-9e04ec25e39a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149877 Aug 06 13:00:14.314822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1602/3214] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:15.079049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cbd14c39-a141-4a5b-ab4f-5550030ae122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:15.079651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cbd14c39-a141-4a5b-ab4f-5550030ae122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:15.086022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cbd14c39-a141-4a5b-ab4f-5550030ae122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:15.086501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cbd14c39-a141-4a5b-ab4f-5550030ae122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:15.086970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cbd14c39-a141-4a5b-ab4f-5550030ae122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:15.087938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cbd14c39-a141-4a5b-ab4f-5550030ae122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:15.088460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cbd14c39-a141-4a5b-ab4f-5550030ae122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:15.088894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cbd14c39-a141-4a5b-ab4f-5550030ae122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:15.222477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cbd14c39-a141-4a5b-ab4f-5550030ae122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:15.230975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cbd14c39-a141-4a5b-ab4f-5550030ae122 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155774 Aug 06 13:00:15.231792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1613/3215] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:15.334990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4069844-1496-4984-934d-61d0d0f6df7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:15.335595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4069844-1496-4984-934d-61d0d0f6df7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:15.341990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4069844-1496-4984-934d-61d0d0f6df7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:15.342471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4069844-1496-4984-934d-61d0d0f6df7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:15.342905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4069844-1496-4984-934d-61d0d0f6df7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:15.343587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4069844-1496-4984-934d-61d0d0f6df7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:15.344039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4069844-1496-4984-934d-61d0d0f6df7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:15.344494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4069844-1496-4984-934d-61d0d0f6df7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:15.470425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b4069844-1496-4984-934d-61d0d0f6df7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:15.479036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4069844-1496-4984-934d-61d0d0f6df7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147887 Aug 06 13:00:15.479608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1603/3216] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:15 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:16.253954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2d9a33e0-7bec-4d87-a637-57845bbfac70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:16.254520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2d9a33e0-7bec-4d87-a637-57845bbfac70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:16.260458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d9a33e0-7bec-4d87-a637-57845bbfac70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:16.260931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d9a33e0-7bec-4d87-a637-57845bbfac70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:16.261362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d9a33e0-7bec-4d87-a637-57845bbfac70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:16.262068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d9a33e0-7bec-4d87-a637-57845bbfac70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:16.262514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d9a33e0-7bec-4d87-a637-57845bbfac70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:16.262930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d9a33e0-7bec-4d87-a637-57845bbfac70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:16.391315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2d9a33e0-7bec-4d87-a637-57845bbfac70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:16.399689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2d9a33e0-7bec-4d87-a637-57845bbfac70 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150190 Aug 06 13:00:16.400248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1614/3217] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:00:16.501704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4503ddda-e36e-4bf2-a475-c0b9f064ff26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:16.502461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4503ddda-e36e-4bf2-a475-c0b9f064ff26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:16.509712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4503ddda-e36e-4bf2-a475-c0b9f064ff26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:16.510128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4503ddda-e36e-4bf2-a475-c0b9f064ff26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:16.510560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4503ddda-e36e-4bf2-a475-c0b9f064ff26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:16.511249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4503ddda-e36e-4bf2-a475-c0b9f064ff26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:16.511697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4503ddda-e36e-4bf2-a475-c0b9f064ff26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:16.512121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4503ddda-e36e-4bf2-a475-c0b9f064ff26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:16.649080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4503ddda-e36e-4bf2-a475-c0b9f064ff26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:16.656998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4503ddda-e36e-4bf2-a475-c0b9f064ff26 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.159842 Aug 06 13:00:16.657562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1604/3218] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:17.422348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5d9fa1fe-0e7e-4279-b8af-365b3658df6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:17.422960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5d9fa1fe-0e7e-4279-b8af-365b3658df6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:17.429919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d9fa1fe-0e7e-4279-b8af-365b3658df6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:17.430401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d9fa1fe-0e7e-4279-b8af-365b3658df6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:17.430867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d9fa1fe-0e7e-4279-b8af-365b3658df6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:17.431605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d9fa1fe-0e7e-4279-b8af-365b3658df6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:17.432127 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d9fa1fe-0e7e-4279-b8af-365b3658df6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:17.432584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d9fa1fe-0e7e-4279-b8af-365b3658df6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:17.570677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5d9fa1fe-0e7e-4279-b8af-365b3658df6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:17.578378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5d9fa1fe-0e7e-4279-b8af-365b3658df6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.161115 Aug 06 13:00:17.578928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1615/3219] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:17.679479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cb039c00-ea73-4f9a-8780-356fe4873150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:17.680021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cb039c00-ea73-4f9a-8780-356fe4873150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:17.686393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb039c00-ea73-4f9a-8780-356fe4873150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:17.686883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb039c00-ea73-4f9a-8780-356fe4873150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:17.687318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb039c00-ea73-4f9a-8780-356fe4873150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:17.688004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb039c00-ea73-4f9a-8780-356fe4873150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:17.688495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb039c00-ea73-4f9a-8780-356fe4873150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:17.688922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb039c00-ea73-4f9a-8780-356fe4873150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:17.822766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cb039c00-ea73-4f9a-8780-356fe4873150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:17.830616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cb039c00-ea73-4f9a-8780-356fe4873150 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.155630 Aug 06 13:00:17.831188 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1605/3220] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:18.598904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a0bc0aa1-42fe-4c28-a271-551649b0f417 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:18.599533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a0bc0aa1-42fe-4c28-a271-551649b0f417 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:18.606119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0bc0aa1-42fe-4c28-a271-551649b0f417 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:18.606877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0bc0aa1-42fe-4c28-a271-551649b0f417 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:18.607304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0bc0aa1-42fe-4c28-a271-551649b0f417 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:18.607980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0bc0aa1-42fe-4c28-a271-551649b0f417 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:18.608454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0bc0aa1-42fe-4c28-a271-551649b0f417 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:18.608871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0bc0aa1-42fe-4c28-a271-551649b0f417 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:18.736668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a0bc0aa1-42fe-4c28-a271-551649b0f417 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:18.744857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a0bc0aa1-42fe-4c28-a271-551649b0f417 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149796 Aug 06 13:00:18.745411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1616/3221] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:18 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:18.851694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f1d1212c-177f-4e9b-b125-4d14b227059b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:18.852265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f1d1212c-177f-4e9b-b125-4d14b227059b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:18.858893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d1212c-177f-4e9b-b125-4d14b227059b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:18.859375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d1212c-177f-4e9b-b125-4d14b227059b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:18.859810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d1212c-177f-4e9b-b125-4d14b227059b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:18.860526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d1212c-177f-4e9b-b125-4d14b227059b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:18.860980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d1212c-177f-4e9b-b125-4d14b227059b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:18.861401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d1212c-177f-4e9b-b125-4d14b227059b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:18.993656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1d1212c-177f-4e9b-b125-4d14b227059b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:19.001634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f1d1212c-177f-4e9b-b125-4d14b227059b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153884 Aug 06 13:00:19.002228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1606/3222] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:18 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:19.766443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bd4c17e2-4a1f-4d03-8746-8ef012462653 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:19.766970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bd4c17e2-4a1f-4d03-8746-8ef012462653 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:19.773945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd4c17e2-4a1f-4d03-8746-8ef012462653 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:19.774417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd4c17e2-4a1f-4d03-8746-8ef012462653 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:19.774849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd4c17e2-4a1f-4d03-8746-8ef012462653 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:19.775519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd4c17e2-4a1f-4d03-8746-8ef012462653 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:19.775964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd4c17e2-4a1f-4d03-8746-8ef012462653 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:19.776402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bd4c17e2-4a1f-4d03-8746-8ef012462653 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:19.901070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bd4c17e2-4a1f-4d03-8746-8ef012462653 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:19.908971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bd4c17e2-4a1f-4d03-8746-8ef012462653 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146444 Aug 06 13:00:19.909536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1617/3223] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:20.023172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-54a11828-3c76-4b82-80b2-2fec00a6275d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:20.023726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-54a11828-3c76-4b82-80b2-2fec00a6275d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:20.030210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54a11828-3c76-4b82-80b2-2fec00a6275d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:20.030691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54a11828-3c76-4b82-80b2-2fec00a6275d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:20.031124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54a11828-3c76-4b82-80b2-2fec00a6275d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:20.031809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54a11828-3c76-4b82-80b2-2fec00a6275d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:20.032263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54a11828-3c76-4b82-80b2-2fec00a6275d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:20.032714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54a11828-3c76-4b82-80b2-2fec00a6275d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:20.158322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-54a11828-3c76-4b82-80b2-2fec00a6275d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:20.166274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-54a11828-3c76-4b82-80b2-2fec00a6275d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147595 Aug 06 13:00:20.166851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1607/3224] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:20.930253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d890e350-0976-4f85-8271-4d24986f33cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:20.930786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d890e350-0976-4f85-8271-4d24986f33cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:20.937312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d890e350-0976-4f85-8271-4d24986f33cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:20.937784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d890e350-0976-4f85-8271-4d24986f33cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:20.938210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d890e350-0976-4f85-8271-4d24986f33cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:20.939230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d890e350-0976-4f85-8271-4d24986f33cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:20.939676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d890e350-0976-4f85-8271-4d24986f33cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:20.940091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d890e350-0976-4f85-8271-4d24986f33cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:21.065675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d890e350-0976-4f85-8271-4d24986f33cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:21.073493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d890e350-0976-4f85-8271-4d24986f33cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147110 Aug 06 13:00:21.074034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1618/3225] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:21.094189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:00:21.094363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 13:00:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:00:21.186844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-60fc3770-6e6e-4927-ba86-ecfe6c0e992f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:21.187405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-60fc3770-6e6e-4927-ba86-ecfe6c0e992f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:21.193731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60fc3770-6e6e-4927-ba86-ecfe6c0e992f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:21.194203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60fc3770-6e6e-4927-ba86-ecfe6c0e992f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:21.194632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60fc3770-6e6e-4927-ba86-ecfe6c0e992f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:21.195301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60fc3770-6e6e-4927-ba86-ecfe6c0e992f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:21.195748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60fc3770-6e6e-4927-ba86-ecfe6c0e992f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:21.196167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60fc3770-6e6e-4927-ba86-ecfe6c0e992f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:21.326329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-60fc3770-6e6e-4927-ba86-ecfe6c0e992f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:21.334745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-60fc3770-6e6e-4927-ba86-ecfe6c0e992f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151802 Aug 06 13:00:21.335300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1608/3226] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:21 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:22.096348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a95c31f-136e-452b-9563-dae235163291 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:22.097332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a95c31f-136e-452b-9563-dae235163291 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:22.105773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a95c31f-136e-452b-9563-dae235163291 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:22.106255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a95c31f-136e-452b-9563-dae235163291 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:22.106936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a95c31f-136e-452b-9563-dae235163291 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:22.107615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a95c31f-136e-452b-9563-dae235163291 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:22.108057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a95c31f-136e-452b-9563-dae235163291 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:22.108495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a95c31f-136e-452b-9563-dae235163291 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:22.236714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a95c31f-136e-452b-9563-dae235163291 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:22.244494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a95c31f-136e-452b-9563-dae235163291 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151991 Aug 06 13:00:22.245039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1619/3227] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:22 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:22.355401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3e3b0cb1-c8e1-4f1a-acfe-b238025ac42c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:22.355940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3e3b0cb1-c8e1-4f1a-acfe-b238025ac42c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:22.362552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e3b0cb1-c8e1-4f1a-acfe-b238025ac42c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:22.363034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e3b0cb1-c8e1-4f1a-acfe-b238025ac42c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:22.363475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e3b0cb1-c8e1-4f1a-acfe-b238025ac42c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:22.364695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e3b0cb1-c8e1-4f1a-acfe-b238025ac42c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:22.365157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e3b0cb1-c8e1-4f1a-acfe-b238025ac42c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:22.365585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e3b0cb1-c8e1-4f1a-acfe-b238025ac42c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:22.495005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3e3b0cb1-c8e1-4f1a-acfe-b238025ac42c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:22.503934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3e3b0cb1-c8e1-4f1a-acfe-b238025ac42c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152572 Aug 06 13:00:22.504526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1609/3228] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:22.526597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-71f87739-c452-4057-aeb2-25e615290f1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:22.527086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-71f87739-c452-4057-aeb2-25e615290f1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:22.532946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71f87739-c452-4057-aeb2-25e615290f1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:22.533431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71f87739-c452-4057-aeb2-25e615290f1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:22.533864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71f87739-c452-4057-aeb2-25e615290f1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:22.534546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71f87739-c452-4057-aeb2-25e615290f1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:22.535004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71f87739-c452-4057-aeb2-25e615290f1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:22.535427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71f87739-c452-4057-aeb2-25e615290f1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:22.560258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-71f87739-c452-4057-aeb2-25e615290f1b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/ips" status: 200 len: 149 microversion: 2.1 time: 0.037560 Aug 06 13:00:22.560826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1620/3229] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Aug 6 13:00:22 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:00:22.885033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-418cd4dd-a512-4c79-a396-c1678887250a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:22.885528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-418cd4dd-a512-4c79-a396-c1678887250a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:22.891503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-418cd4dd-a512-4c79-a396-c1678887250a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:22.891989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-418cd4dd-a512-4c79-a396-c1678887250a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:22.892455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-418cd4dd-a512-4c79-a396-c1678887250a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:22.893167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-418cd4dd-a512-4c79-a396-c1678887250a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:22.893624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-418cd4dd-a512-4c79-a396-c1678887250a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:22.894049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-418cd4dd-a512-4c79-a396-c1678887250a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:22.916894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-418cd4dd-a512-4c79-a396-c1678887250a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/ips" status: 200 len: 150 microversion: 2.20 time: 0.035767 Aug 06 13:00:22.917443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1610/3230] 10.222.0.20 () {60 vars in 1289 bytes} [Sat Aug 6 13:00:22 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 13:00:23.266081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4ccd1eb7-8cd0-4c12-b86c-016b29891d67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:23.266631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4ccd1eb7-8cd0-4c12-b86c-016b29891d67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:23.273371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ccd1eb7-8cd0-4c12-b86c-016b29891d67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:23.273849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ccd1eb7-8cd0-4c12-b86c-016b29891d67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:23.274275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ccd1eb7-8cd0-4c12-b86c-016b29891d67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:23.274948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ccd1eb7-8cd0-4c12-b86c-016b29891d67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:23.275385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ccd1eb7-8cd0-4c12-b86c-016b29891d67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:23.275797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ccd1eb7-8cd0-4c12-b86c-016b29891d67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:23.402192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4ccd1eb7-8cd0-4c12-b86c-016b29891d67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:23.404706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:00:23.412581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4ccd1eb7-8cd0-4c12-b86c-016b29891d67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150354 Aug 06 13:00:23.413129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1621/3231] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:23 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:23.525848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8bfb77cf-9a46-4e7b-89f3-32ddbbd3abb4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:23.526422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8bfb77cf-9a46-4e7b-89f3-32ddbbd3abb4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:23.532845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfb77cf-9a46-4e7b-89f3-32ddbbd3abb4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:23.533329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfb77cf-9a46-4e7b-89f3-32ddbbd3abb4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:23.533767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfb77cf-9a46-4e7b-89f3-32ddbbd3abb4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:23.534452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfb77cf-9a46-4e7b-89f3-32ddbbd3abb4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:23.534907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfb77cf-9a46-4e7b-89f3-32ddbbd3abb4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:23.535332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bfb77cf-9a46-4e7b-89f3-32ddbbd3abb4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:23.659622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8bfb77cf-9a46-4e7b-89f3-32ddbbd3abb4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:23.667370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8bfb77cf-9a46-4e7b-89f3-32ddbbd3abb4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145420 Aug 06 13:00:23.667936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1611/3232] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:24.433498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ed68ae1b-a497-4036-8791-ec613d36b365 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:24.434092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ed68ae1b-a497-4036-8791-ec613d36b365 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:24.440480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed68ae1b-a497-4036-8791-ec613d36b365 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:24.440955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed68ae1b-a497-4036-8791-ec613d36b365 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:24.441380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed68ae1b-a497-4036-8791-ec613d36b365 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:24.442044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed68ae1b-a497-4036-8791-ec613d36b365 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:24.442488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed68ae1b-a497-4036-8791-ec613d36b365 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:24.442901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed68ae1b-a497-4036-8791-ec613d36b365 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:24.572457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ed68ae1b-a497-4036-8791-ec613d36b365 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:24.580217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ed68ae1b-a497-4036-8791-ec613d36b365 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150502 Aug 06 13:00:24.580803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1622/3233] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:24 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:24.688094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-57cc06b3-5cc6-454d-b92f-74803f99151e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:24.688695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-57cc06b3-5cc6-454d-b92f-74803f99151e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:24.695072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57cc06b3-5cc6-454d-b92f-74803f99151e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:24.695551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57cc06b3-5cc6-454d-b92f-74803f99151e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:24.695979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57cc06b3-5cc6-454d-b92f-74803f99151e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:24.696685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57cc06b3-5cc6-454d-b92f-74803f99151e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:24.697133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57cc06b3-5cc6-454d-b92f-74803f99151e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:24.697553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57cc06b3-5cc6-454d-b92f-74803f99151e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:24.826032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57cc06b3-5cc6-454d-b92f-74803f99151e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:24.828217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:00:24.835583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-57cc06b3-5cc6-454d-b92f-74803f99151e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151391 Aug 06 13:00:24.836219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1612/3234] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:25.601954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fcc366c4-78dc-4b4c-907d-9c27d7c646ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:25.602559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fcc366c4-78dc-4b4c-907d-9c27d7c646ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:25.609180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc366c4-78dc-4b4c-907d-9c27d7c646ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:25.609661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc366c4-78dc-4b4c-907d-9c27d7c646ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:25.610094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc366c4-78dc-4b4c-907d-9c27d7c646ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:25.610772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc366c4-78dc-4b4c-907d-9c27d7c646ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:25.611221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc366c4-78dc-4b4c-907d-9c27d7c646ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:25.611641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fcc366c4-78dc-4b4c-907d-9c27d7c646ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:25.736959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fcc366c4-78dc-4b4c-907d-9c27d7c646ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:25.745471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fcc366c4-78dc-4b4c-907d-9c27d7c646ec tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147412 Aug 06 13:00:25.745961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1623/3235] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:25 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:25.856168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-35438405-3a69-406a-bb9d-162d4f7e926c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:25.857099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-35438405-3a69-406a-bb9d-162d4f7e926c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:25.863557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35438405-3a69-406a-bb9d-162d4f7e926c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:25.864755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35438405-3a69-406a-bb9d-162d4f7e926c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:25.865195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35438405-3a69-406a-bb9d-162d4f7e926c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:25.865920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35438405-3a69-406a-bb9d-162d4f7e926c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:25.866380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35438405-3a69-406a-bb9d-162d4f7e926c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:25.866807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-35438405-3a69-406a-bb9d-162d4f7e926c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:26.001375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-35438405-3a69-406a-bb9d-162d4f7e926c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:26.009952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-35438405-3a69-406a-bb9d-162d4f7e926c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.157566 Aug 06 13:00:26.010606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1613/3236] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:26.766226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9f383552-dd9a-433a-bba9-a7e0a239b1dc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:26.766811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9f383552-dd9a-433a-bba9-a7e0a239b1dc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:26.773844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f383552-dd9a-433a-bba9-a7e0a239b1dc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:26.774320 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f383552-dd9a-433a-bba9-a7e0a239b1dc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:26.774750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f383552-dd9a-433a-bba9-a7e0a239b1dc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:26.775425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f383552-dd9a-433a-bba9-a7e0a239b1dc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:26.775873 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f383552-dd9a-433a-bba9-a7e0a239b1dc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:26.776293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f383552-dd9a-433a-bba9-a7e0a239b1dc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:26.902090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9f383552-dd9a-433a-bba9-a7e0a239b1dc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:26.909940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9f383552-dd9a-433a-bba9-a7e0a239b1dc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147516 Aug 06 13:00:26.910498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1624/3237] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:26 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:27.030944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-de94b225-a0d7-4d03-8388-063d5deeb11e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:27.031495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-de94b225-a0d7-4d03-8388-063d5deeb11e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:27.038010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de94b225-a0d7-4d03-8388-063d5deeb11e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:27.038488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de94b225-a0d7-4d03-8388-063d5deeb11e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:27.038926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de94b225-a0d7-4d03-8388-063d5deeb11e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:27.039612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de94b225-a0d7-4d03-8388-063d5deeb11e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:27.040063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de94b225-a0d7-4d03-8388-063d5deeb11e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:27.040526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de94b225-a0d7-4d03-8388-063d5deeb11e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:27.169457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-de94b225-a0d7-4d03-8388-063d5deeb11e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:27.177790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-de94b225-a0d7-4d03-8388-063d5deeb11e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150681 Aug 06 13:00:27.178367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1614/3238] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:27.930933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b84220d2-26c7-4245-9f5b-db8c02f39e63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:27.931531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b84220d2-26c7-4245-9f5b-db8c02f39e63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:27.937827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b84220d2-26c7-4245-9f5b-db8c02f39e63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:27.938296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b84220d2-26c7-4245-9f5b-db8c02f39e63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:27.938720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b84220d2-26c7-4245-9f5b-db8c02f39e63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:27.939389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b84220d2-26c7-4245-9f5b-db8c02f39e63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:27.939833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b84220d2-26c7-4245-9f5b-db8c02f39e63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:27.940247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b84220d2-26c7-4245-9f5b-db8c02f39e63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:28.072230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b84220d2-26c7-4245-9f5b-db8c02f39e63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:28.080024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b84220d2-26c7-4245-9f5b-db8c02f39e63 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152914 Aug 06 13:00:28.080666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1625/3239] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:27 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:28.198532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bb949c2a-86c0-4270-822c-6807e3912562 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:28.199120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bb949c2a-86c0-4270-822c-6807e3912562 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:28.205493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb949c2a-86c0-4270-822c-6807e3912562 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:28.205963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb949c2a-86c0-4270-822c-6807e3912562 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:28.206396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb949c2a-86c0-4270-822c-6807e3912562 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:28.207071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb949c2a-86c0-4270-822c-6807e3912562 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:28.208156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb949c2a-86c0-4270-822c-6807e3912562 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:28.208605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb949c2a-86c0-4270-822c-6807e3912562 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:28.336649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bb949c2a-86c0-4270-822c-6807e3912562 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:28.344533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bb949c2a-86c0-4270-822c-6807e3912562 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150142 Aug 06 13:00:28.345096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1615/3240] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:28 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:29.102340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-877b2618-a726-401d-bc21-214c8bfc383e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:29.102945 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-877b2618-a726-401d-bc21-214c8bfc383e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:29.109582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-877b2618-a726-401d-bc21-214c8bfc383e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:29.110064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-877b2618-a726-401d-bc21-214c8bfc383e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:29.110497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-877b2618-a726-401d-bc21-214c8bfc383e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:29.111181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-877b2618-a726-401d-bc21-214c8bfc383e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:29.111630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-877b2618-a726-401d-bc21-214c8bfc383e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:29.112052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-877b2618-a726-401d-bc21-214c8bfc383e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:29.242273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-877b2618-a726-401d-bc21-214c8bfc383e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:29.250199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-877b2618-a726-401d-bc21-214c8bfc383e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152447 Aug 06 13:00:29.250692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1626/3241] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:29 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:29.365401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8cddc3e7-fcd6-43b1-bda9-8c45216af475 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:29.366007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8cddc3e7-fcd6-43b1-bda9-8c45216af475 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:29.372268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8cddc3e7-fcd6-43b1-bda9-8c45216af475 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:29.372769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8cddc3e7-fcd6-43b1-bda9-8c45216af475 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:29.373196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8cddc3e7-fcd6-43b1-bda9-8c45216af475 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:29.373865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8cddc3e7-fcd6-43b1-bda9-8c45216af475 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:29.374310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8cddc3e7-fcd6-43b1-bda9-8c45216af475 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:29.374727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8cddc3e7-fcd6-43b1-bda9-8c45216af475 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:29.502978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8cddc3e7-fcd6-43b1-bda9-8c45216af475 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:29.511851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8cddc3e7-fcd6-43b1-bda9-8c45216af475 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150181 Aug 06 13:00:29.512458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1616/3242] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:30.271054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c7d172dc-7a85-41dd-a9b3-ad069fb6cd9b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:30.271608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c7d172dc-7a85-41dd-a9b3-ad069fb6cd9b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:30.277995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d172dc-7a85-41dd-a9b3-ad069fb6cd9b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:30.278472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d172dc-7a85-41dd-a9b3-ad069fb6cd9b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:30.278908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d172dc-7a85-41dd-a9b3-ad069fb6cd9b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:30.279589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d172dc-7a85-41dd-a9b3-ad069fb6cd9b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:30.280042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d172dc-7a85-41dd-a9b3-ad069fb6cd9b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:30.280497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7d172dc-7a85-41dd-a9b3-ad069fb6cd9b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:30.408008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c7d172dc-7a85-41dd-a9b3-ad069fb6cd9b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:30.416517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c7d172dc-7a85-41dd-a9b3-ad069fb6cd9b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149380 Aug 06 13:00:30.417074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1627/3243] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:30 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:30.532820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-221ed88d-49ec-49e3-b67b-e38a57a51523 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:30.533354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-221ed88d-49ec-49e3-b67b-e38a57a51523 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:30.540184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221ed88d-49ec-49e3-b67b-e38a57a51523 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:30.540880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221ed88d-49ec-49e3-b67b-e38a57a51523 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:30.541523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221ed88d-49ec-49e3-b67b-e38a57a51523 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:30.542879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221ed88d-49ec-49e3-b67b-e38a57a51523 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:30.543340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221ed88d-49ec-49e3-b67b-e38a57a51523 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:30.543770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-221ed88d-49ec-49e3-b67b-e38a57a51523 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:30.672339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-221ed88d-49ec-49e3-b67b-e38a57a51523 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:30.680150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-221ed88d-49ec-49e3-b67b-e38a57a51523 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151210 Aug 06 13:00:30.680940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1617/3244] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:31.438304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cb254f91-5d1d-4ec1-9424-4ce8b91b1ffd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:31.438913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cb254f91-5d1d-4ec1-9424-4ce8b91b1ffd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:31.445141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254f91-5d1d-4ec1-9424-4ce8b91b1ffd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:31.445616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254f91-5d1d-4ec1-9424-4ce8b91b1ffd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:31.446041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254f91-5d1d-4ec1-9424-4ce8b91b1ffd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:31.446712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254f91-5d1d-4ec1-9424-4ce8b91b1ffd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:31.447158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254f91-5d1d-4ec1-9424-4ce8b91b1ffd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:31.447571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254f91-5d1d-4ec1-9424-4ce8b91b1ffd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:31.576622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cb254f91-5d1d-4ec1-9424-4ce8b91b1ffd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:31.584962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cb254f91-5d1d-4ec1-9424-4ce8b91b1ffd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150524 Aug 06 13:00:31.585524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1628/3245] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:31 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:31.701329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2be5dbd3-45fc-48eb-abd4-84ce439df6c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:31.701900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2be5dbd3-45fc-48eb-abd4-84ce439df6c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:31.708725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd3-45fc-48eb-abd4-84ce439df6c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:31.709200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd3-45fc-48eb-abd4-84ce439df6c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:31.709633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd3-45fc-48eb-abd4-84ce439df6c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:31.710342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd3-45fc-48eb-abd4-84ce439df6c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:31.710794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd3-45fc-48eb-abd4-84ce439df6c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:31.711212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be5dbd3-45fc-48eb-abd4-84ce439df6c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:31.843193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2be5dbd3-45fc-48eb-abd4-84ce439df6c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:31.851163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2be5dbd3-45fc-48eb-abd4-84ce439df6c1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153708 Aug 06 13:00:31.851730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1618/3246] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:32.605825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1f16358a-155e-4347-81e9-b49628ebcfa9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:32.606661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f16358a-155e-4347-81e9-b49628ebcfa9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:32.613091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f16358a-155e-4347-81e9-b49628ebcfa9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:32.614252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f16358a-155e-4347-81e9-b49628ebcfa9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:32.614686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f16358a-155e-4347-81e9-b49628ebcfa9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:32.615363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f16358a-155e-4347-81e9-b49628ebcfa9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:32.615814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f16358a-155e-4347-81e9-b49628ebcfa9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:32.616236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f16358a-155e-4347-81e9-b49628ebcfa9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:32.746609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1f16358a-155e-4347-81e9-b49628ebcfa9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:32.754418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1f16358a-155e-4347-81e9-b49628ebcfa9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152384 Aug 06 13:00:32.754976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1629/3247] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:32 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:32.871568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-be507a4b-4f4a-423d-a59b-e9e897415c31 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:32.872097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-be507a4b-4f4a-423d-a59b-e9e897415c31 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:32.878432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be507a4b-4f4a-423d-a59b-e9e897415c31 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:32.878906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be507a4b-4f4a-423d-a59b-e9e897415c31 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:32.879375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be507a4b-4f4a-423d-a59b-e9e897415c31 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:32.880208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be507a4b-4f4a-423d-a59b-e9e897415c31 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:32.880688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be507a4b-4f4a-423d-a59b-e9e897415c31 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:32.881109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be507a4b-4f4a-423d-a59b-e9e897415c31 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:33.009723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-be507a4b-4f4a-423d-a59b-e9e897415c31 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:33.017641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-be507a4b-4f4a-423d-a59b-e9e897415c31 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149962 Aug 06 13:00:33.018204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1619/3248] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:33.775439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9bbf1c5f-aea6-4f8a-950e-1fef0c7c5752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:33.775992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9bbf1c5f-aea6-4f8a-950e-1fef0c7c5752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:33.782443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bbf1c5f-aea6-4f8a-950e-1fef0c7c5752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:33.782923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bbf1c5f-aea6-4f8a-950e-1fef0c7c5752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:33.783358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bbf1c5f-aea6-4f8a-950e-1fef0c7c5752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:33.784043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bbf1c5f-aea6-4f8a-950e-1fef0c7c5752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:33.784524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bbf1c5f-aea6-4f8a-950e-1fef0c7c5752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:33.784947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9bbf1c5f-aea6-4f8a-950e-1fef0c7c5752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:33.911699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9bbf1c5f-aea6-4f8a-950e-1fef0c7c5752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:33.920732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9bbf1c5f-aea6-4f8a-950e-1fef0c7c5752 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149222 Aug 06 13:00:33.921299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1630/3249] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:33 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:34.039282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1ebaf2c7-df26-4f1a-9615-70bf8c728e74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:34.039911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1ebaf2c7-df26-4f1a-9615-70bf8c728e74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:34.046245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ebaf2c7-df26-4f1a-9615-70bf8c728e74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:34.046719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ebaf2c7-df26-4f1a-9615-70bf8c728e74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:34.047149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ebaf2c7-df26-4f1a-9615-70bf8c728e74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:34.047823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ebaf2c7-df26-4f1a-9615-70bf8c728e74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:34.048266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ebaf2c7-df26-4f1a-9615-70bf8c728e74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:34.048707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ebaf2c7-df26-4f1a-9615-70bf8c728e74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:34.181712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1ebaf2c7-df26-4f1a-9615-70bf8c728e74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:34.189613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1ebaf2c7-df26-4f1a-9615-70bf8c728e74 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154650 Aug 06 13:00:34.190180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1620/3250] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:34.942838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0cd5ac6f-b443-4dc5-82d1-59acb2a50fd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:34.943435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0cd5ac6f-b443-4dc5-82d1-59acb2a50fd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:34.949729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cd5ac6f-b443-4dc5-82d1-59acb2a50fd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:34.950199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cd5ac6f-b443-4dc5-82d1-59acb2a50fd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:34.950621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cd5ac6f-b443-4dc5-82d1-59acb2a50fd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:34.951290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cd5ac6f-b443-4dc5-82d1-59acb2a50fd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:34.951741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cd5ac6f-b443-4dc5-82d1-59acb2a50fd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:34.952156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cd5ac6f-b443-4dc5-82d1-59acb2a50fd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:35.077082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0cd5ac6f-b443-4dc5-82d1-59acb2a50fd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:35.085597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0cd5ac6f-b443-4dc5-82d1-59acb2a50fd3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147050 Aug 06 13:00:35.086160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1631/3251] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:34 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:35.210222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-886286be-c202-47e0-9ad3-a1bd1eadc82b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:35.210805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-886286be-c202-47e0-9ad3-a1bd1eadc82b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:35.217119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-886286be-c202-47e0-9ad3-a1bd1eadc82b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:35.217591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-886286be-c202-47e0-9ad3-a1bd1eadc82b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:35.218019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-886286be-c202-47e0-9ad3-a1bd1eadc82b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:35.218690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-886286be-c202-47e0-9ad3-a1bd1eadc82b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:35.219135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-886286be-c202-47e0-9ad3-a1bd1eadc82b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:35.219553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-886286be-c202-47e0-9ad3-a1bd1eadc82b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:35.348912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-886286be-c202-47e0-9ad3-a1bd1eadc82b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:35.357312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-886286be-c202-47e0-9ad3-a1bd1eadc82b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150990 Aug 06 13:00:35.357873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1621/3252] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:35 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:36.106806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d70e4c8a-9363-40ee-b87f-6f0421cc6262 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:36.107350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d70e4c8a-9363-40ee-b87f-6f0421cc6262 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:36.113748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70e4c8a-9363-40ee-b87f-6f0421cc6262 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:36.114235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70e4c8a-9363-40ee-b87f-6f0421cc6262 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:36.114658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70e4c8a-9363-40ee-b87f-6f0421cc6262 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:36.115331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70e4c8a-9363-40ee-b87f-6f0421cc6262 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:36.115781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70e4c8a-9363-40ee-b87f-6f0421cc6262 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:36.116200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70e4c8a-9363-40ee-b87f-6f0421cc6262 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:36.243310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d70e4c8a-9363-40ee-b87f-6f0421cc6262 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:36.251154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d70e4c8a-9363-40ee-b87f-6f0421cc6262 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148464 Aug 06 13:00:36.251711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1632/3253] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:36 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:36.378799 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90365521-9de0-41b5-bcbd-78ee2d8b4a01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:36.379367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90365521-9de0-41b5-bcbd-78ee2d8b4a01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:36.386150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90365521-9de0-41b5-bcbd-78ee2d8b4a01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:36.386620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90365521-9de0-41b5-bcbd-78ee2d8b4a01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:36.387045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90365521-9de0-41b5-bcbd-78ee2d8b4a01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:36.387722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90365521-9de0-41b5-bcbd-78ee2d8b4a01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:36.388165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90365521-9de0-41b5-bcbd-78ee2d8b4a01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:36.388615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90365521-9de0-41b5-bcbd-78ee2d8b4a01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:36.515967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90365521-9de0-41b5-bcbd-78ee2d8b4a01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:36.524804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90365521-9de0-41b5-bcbd-78ee2d8b4a01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149878 Aug 06 13:00:36.525362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1622/3254] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:37.272683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac384964-9826-4eb0-9c22-72ae040cf7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:37.273292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac384964-9826-4eb0-9c22-72ae040cf7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:37.279622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac384964-9826-4eb0-9c22-72ae040cf7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:37.280102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac384964-9826-4eb0-9c22-72ae040cf7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:37.280556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac384964-9826-4eb0-9c22-72ae040cf7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:37.281248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac384964-9826-4eb0-9c22-72ae040cf7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:37.281698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac384964-9826-4eb0-9c22-72ae040cf7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:37.282117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac384964-9826-4eb0-9c22-72ae040cf7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:37.412619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ac384964-9826-4eb0-9c22-72ae040cf7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:37.420521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac384964-9826-4eb0-9c22-72ae040cf7b6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151624 Aug 06 13:00:37.421399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1633/3255] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:37 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:37.545744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4708e338-ae22-4baa-bed2-8da0eb8fa62b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:37.546378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4708e338-ae22-4baa-bed2-8da0eb8fa62b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:37.552890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4708e338-ae22-4baa-bed2-8da0eb8fa62b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:37.553367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4708e338-ae22-4baa-bed2-8da0eb8fa62b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:37.553795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4708e338-ae22-4baa-bed2-8da0eb8fa62b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:37.554474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4708e338-ae22-4baa-bed2-8da0eb8fa62b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:37.554923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4708e338-ae22-4baa-bed2-8da0eb8fa62b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:37.555349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4708e338-ae22-4baa-bed2-8da0eb8fa62b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:37.680649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4708e338-ae22-4baa-bed2-8da0eb8fa62b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:37.688404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4708e338-ae22-4baa-bed2-8da0eb8fa62b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146501 Aug 06 13:00:37.688969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1623/3256] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:37 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:38.443539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-53daba72-0ca4-4853-bff2-01f858327d6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:38.444173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-53daba72-0ca4-4853-bff2-01f858327d6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:38.450665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53daba72-0ca4-4853-bff2-01f858327d6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:38.451139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53daba72-0ca4-4853-bff2-01f858327d6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:38.451568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53daba72-0ca4-4853-bff2-01f858327d6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:38.452245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53daba72-0ca4-4853-bff2-01f858327d6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:38.452721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53daba72-0ca4-4853-bff2-01f858327d6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:38.453144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53daba72-0ca4-4853-bff2-01f858327d6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:38.587957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-53daba72-0ca4-4853-bff2-01f858327d6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:38.595914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-53daba72-0ca4-4853-bff2-01f858327d6d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.156840 Aug 06 13:00:38.596494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1634/3257] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:38 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:38.709710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f87cd927-9ed9-45af-b1c2-2f612d12e49f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:38.710230 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f87cd927-9ed9-45af-b1c2-2f612d12e49f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:38.712549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=54 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:00:38.717711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87cd927-9ed9-45af-b1c2-2f612d12e49f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:38.718191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87cd927-9ed9-45af-b1c2-2f612d12e49f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:38.718621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87cd927-9ed9-45af-b1c2-2f612d12e49f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:38.719303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87cd927-9ed9-45af-b1c2-2f612d12e49f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:38.719756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87cd927-9ed9-45af-b1c2-2f612d12e49f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:38.720178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f87cd927-9ed9-45af-b1c2-2f612d12e49f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:38.855222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f87cd927-9ed9-45af-b1c2-2f612d12e49f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:38.864151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f87cd927-9ed9-45af-b1c2-2f612d12e49f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.158354 Aug 06 13:00:38.864788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1624/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:39.618333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-55996cf4-1611-4de2-acc6-65f4fe883b58 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:39.618953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-55996cf4-1611-4de2-acc6-65f4fe883b58 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:39.625301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55996cf4-1611-4de2-acc6-65f4fe883b58 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:39.625801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55996cf4-1611-4de2-acc6-65f4fe883b58 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:39.626223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55996cf4-1611-4de2-acc6-65f4fe883b58 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:39.626894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55996cf4-1611-4de2-acc6-65f4fe883b58 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:39.627335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55996cf4-1611-4de2-acc6-65f4fe883b58 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:39.627747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-55996cf4-1611-4de2-acc6-65f4fe883b58 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:39.754380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-55996cf4-1611-4de2-acc6-65f4fe883b58 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:39.762895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-55996cf4-1611-4de2-acc6-65f4fe883b58 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148959 Aug 06 13:00:39.763456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1635/3259] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:39 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:39.885796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aab73491-d993-41cf-ab4b-c24689ee538d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:39.886403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aab73491-d993-41cf-ab4b-c24689ee538d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:39.892843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aab73491-d993-41cf-ab4b-c24689ee538d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:39.893325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aab73491-d993-41cf-ab4b-c24689ee538d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:39.893755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aab73491-d993-41cf-ab4b-c24689ee538d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:39.894441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aab73491-d993-41cf-ab4b-c24689ee538d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:39.894890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aab73491-d993-41cf-ab4b-c24689ee538d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:39.895311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aab73491-d993-41cf-ab4b-c24689ee538d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:40.024584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aab73491-d993-41cf-ab4b-c24689ee538d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:40.032528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aab73491-d993-41cf-ab4b-c24689ee538d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150693 Aug 06 13:00:40.033097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1625/3260] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:40.783120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3263de87-7d1b-4283-a67e-ba8200b7d345 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:40.783728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3263de87-7d1b-4283-a67e-ba8200b7d345 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:40.790516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3263de87-7d1b-4283-a67e-ba8200b7d345 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:40.790993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3263de87-7d1b-4283-a67e-ba8200b7d345 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:40.791422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3263de87-7d1b-4283-a67e-ba8200b7d345 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:40.792099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3263de87-7d1b-4283-a67e-ba8200b7d345 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:40.792577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3263de87-7d1b-4283-a67e-ba8200b7d345 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:40.792999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3263de87-7d1b-4283-a67e-ba8200b7d345 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:40.919654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3263de87-7d1b-4283-a67e-ba8200b7d345 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:40.928088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3263de87-7d1b-4283-a67e-ba8200b7d345 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148865 Aug 06 13:00:40.928686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1636/3261] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:40 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:41.053812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-af6dc5c7-c09b-4cf2-a3a1-79d78cb39152 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:41.054421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-af6dc5c7-c09b-4cf2-a3a1-79d78cb39152 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:41.060804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af6dc5c7-c09b-4cf2-a3a1-79d78cb39152 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:41.061289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af6dc5c7-c09b-4cf2-a3a1-79d78cb39152 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:41.061721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af6dc5c7-c09b-4cf2-a3a1-79d78cb39152 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:41.062406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af6dc5c7-c09b-4cf2-a3a1-79d78cb39152 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:41.062865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af6dc5c7-c09b-4cf2-a3a1-79d78cb39152 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:41.063286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af6dc5c7-c09b-4cf2-a3a1-79d78cb39152 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:41.195440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-af6dc5c7-c09b-4cf2-a3a1-79d78cb39152 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:41.203425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-af6dc5c7-c09b-4cf2-a3a1-79d78cb39152 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154097 Aug 06 13:00:41.203995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1626/3262] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:41 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:41.949439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a1b4093-37c3-4da8-8fd2-f083590560f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:41.950073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a1b4093-37c3-4da8-8fd2-f083590560f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:41.956436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a1b4093-37c3-4da8-8fd2-f083590560f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:41.956912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a1b4093-37c3-4da8-8fd2-f083590560f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:41.957344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a1b4093-37c3-4da8-8fd2-f083590560f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:41.958023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a1b4093-37c3-4da8-8fd2-f083590560f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:41.958472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a1b4093-37c3-4da8-8fd2-f083590560f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:41.958892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a1b4093-37c3-4da8-8fd2-f083590560f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:42.088011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a1b4093-37c3-4da8-8fd2-f083590560f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:42.096043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a1b4093-37c3-4da8-8fd2-f083590560f1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150453 Aug 06 13:00:42.096668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1637/3263] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:41 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:42.224963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0e84e0d2-6f4a-4032-af70-0bbdcba4382e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:42.225494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0e84e0d2-6f4a-4032-af70-0bbdcba4382e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:42.232024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e84e0d2-6f4a-4032-af70-0bbdcba4382e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:42.232530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e84e0d2-6f4a-4032-af70-0bbdcba4382e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:42.232955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e84e0d2-6f4a-4032-af70-0bbdcba4382e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:42.233626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e84e0d2-6f4a-4032-af70-0bbdcba4382e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:42.234076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e84e0d2-6f4a-4032-af70-0bbdcba4382e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:42.234493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e84e0d2-6f4a-4032-af70-0bbdcba4382e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:42.360547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0e84e0d2-6f4a-4032-af70-0bbdcba4382e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:42.369185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0e84e0d2-6f4a-4032-af70-0bbdcba4382e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148592 Aug 06 13:00:42.369775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1627/3264] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:42 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:43.117336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-589f2dbd-3a62-4ee4-90e8-cc9a0fc7f01e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:43.117950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-589f2dbd-3a62-4ee4-90e8-cc9a0fc7f01e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:43.120425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=54 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:00:43.125734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-589f2dbd-3a62-4ee4-90e8-cc9a0fc7f01e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:43.126210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-589f2dbd-3a62-4ee4-90e8-cc9a0fc7f01e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:43.126642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-589f2dbd-3a62-4ee4-90e8-cc9a0fc7f01e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:43.127327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-589f2dbd-3a62-4ee4-90e8-cc9a0fc7f01e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:43.127776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-589f2dbd-3a62-4ee4-90e8-cc9a0fc7f01e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:43.128200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-589f2dbd-3a62-4ee4-90e8-cc9a0fc7f01e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:43.143315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:00:43.262209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-589f2dbd-3a62-4ee4-90e8-cc9a0fc7f01e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:43.270160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-589f2dbd-3a62-4ee4-90e8-cc9a0fc7f01e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.156667 Aug 06 13:00:43.271286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1638/3265] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:43 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:43.390081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5d14c333-50a7-4ccc-b641-0d45f61a0269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:43.390688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5d14c333-50a7-4ccc-b641-0d45f61a0269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:43.397637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d14c333-50a7-4ccc-b641-0d45f61a0269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:43.398119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d14c333-50a7-4ccc-b641-0d45f61a0269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:43.398554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d14c333-50a7-4ccc-b641-0d45f61a0269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:43.399239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d14c333-50a7-4ccc-b641-0d45f61a0269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:43.399694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d14c333-50a7-4ccc-b641-0d45f61a0269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:43.400112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d14c333-50a7-4ccc-b641-0d45f61a0269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:43.533208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5d14c333-50a7-4ccc-b641-0d45f61a0269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:43.541160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5d14c333-50a7-4ccc-b641-0d45f61a0269 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154897 Aug 06 13:00:43.541725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1628/3266] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:44.292494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ddf8a7d0-f853-4af6-bf04-0e2edc045be8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:44.293096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ddf8a7d0-f853-4af6-bf04-0e2edc045be8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:44.299563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddf8a7d0-f853-4af6-bf04-0e2edc045be8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:44.300062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddf8a7d0-f853-4af6-bf04-0e2edc045be8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:44.300547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddf8a7d0-f853-4af6-bf04-0e2edc045be8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:44.301254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddf8a7d0-f853-4af6-bf04-0e2edc045be8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:44.301700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddf8a7d0-f853-4af6-bf04-0e2edc045be8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:44.302115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ddf8a7d0-f853-4af6-bf04-0e2edc045be8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:44.433453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ddf8a7d0-f853-4af6-bf04-0e2edc045be8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:44.441267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ddf8a7d0-f853-4af6-bf04-0e2edc045be8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152662 Aug 06 13:00:44.441825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1639/3267] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:44 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:44.561859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-399ca68d-b1a3-4028-9a55-abe7838cfc1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:44.562408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-399ca68d-b1a3-4028-9a55-abe7838cfc1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:44.568719 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-399ca68d-b1a3-4028-9a55-abe7838cfc1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:44.569228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-399ca68d-b1a3-4028-9a55-abe7838cfc1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:44.569663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-399ca68d-b1a3-4028-9a55-abe7838cfc1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:44.570344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-399ca68d-b1a3-4028-9a55-abe7838cfc1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:44.570796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-399ca68d-b1a3-4028-9a55-abe7838cfc1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:44.571223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-399ca68d-b1a3-4028-9a55-abe7838cfc1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:44.586052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:00:44.699540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-399ca68d-b1a3-4028-9a55-abe7838cfc1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:44.707400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-399ca68d-b1a3-4028-9a55-abe7838cfc1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149483 Aug 06 13:00:44.707999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1629/3268] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:45.462253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a521a8b-2db4-4c31-b013-42bb0a88a31d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:45.462858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a521a8b-2db4-4c31-b013-42bb0a88a31d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:45.469302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a521a8b-2db4-4c31-b013-42bb0a88a31d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:45.469787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a521a8b-2db4-4c31-b013-42bb0a88a31d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:45.470223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a521a8b-2db4-4c31-b013-42bb0a88a31d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:45.470907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a521a8b-2db4-4c31-b013-42bb0a88a31d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:45.471360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a521a8b-2db4-4c31-b013-42bb0a88a31d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:45.471787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a521a8b-2db4-4c31-b013-42bb0a88a31d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:45.597587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a521a8b-2db4-4c31-b013-42bb0a88a31d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:45.605480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a521a8b-2db4-4c31-b013-42bb0a88a31d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147774 Aug 06 13:00:45.606280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1640/3269] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:45 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:45.730297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f3566331-673c-487c-8064-d12e435a25b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:45.730821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f3566331-673c-487c-8064-d12e435a25b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:45.737419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3566331-673c-487c-8064-d12e435a25b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:45.737888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3566331-673c-487c-8064-d12e435a25b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:45.738315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3566331-673c-487c-8064-d12e435a25b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:45.738991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3566331-673c-487c-8064-d12e435a25b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:45.739437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3566331-673c-487c-8064-d12e435a25b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:45.740372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3566331-673c-487c-8064-d12e435a25b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:45.868169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f3566331-673c-487c-8064-d12e435a25b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:45.876049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f3566331-673c-487c-8064-d12e435a25b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149647 Aug 06 13:00:45.876641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1630/3270] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:46.627160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cc8ab3ad-e548-47e0-b5c8-b1c5a5e0121b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:46.627760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cc8ab3ad-e548-47e0-b5c8-b1c5a5e0121b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:46.634095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc8ab3ad-e548-47e0-b5c8-b1c5a5e0121b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:46.634569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc8ab3ad-e548-47e0-b5c8-b1c5a5e0121b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:46.634997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc8ab3ad-e548-47e0-b5c8-b1c5a5e0121b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:46.635672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc8ab3ad-e548-47e0-b5c8-b1c5a5e0121b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:46.636119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc8ab3ad-e548-47e0-b5c8-b1c5a5e0121b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:46.636567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc8ab3ad-e548-47e0-b5c8-b1c5a5e0121b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:46.765097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cc8ab3ad-e548-47e0-b5c8-b1c5a5e0121b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:46.773944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cc8ab3ad-e548-47e0-b5c8-b1c5a5e0121b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150665 Aug 06 13:00:46.774504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1641/3271] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:46 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:46.898069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f04a3b9b-7a49-4b21-af11-d13307307fcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:46.898633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f04a3b9b-7a49-4b21-af11-d13307307fcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:46.905034 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f04a3b9b-7a49-4b21-af11-d13307307fcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:46.905519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f04a3b9b-7a49-4b21-af11-d13307307fcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:46.905958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f04a3b9b-7a49-4b21-af11-d13307307fcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:46.906683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f04a3b9b-7a49-4b21-af11-d13307307fcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:46.907138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f04a3b9b-7a49-4b21-af11-d13307307fcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:46.907565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f04a3b9b-7a49-4b21-af11-d13307307fcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:47.037293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f04a3b9b-7a49-4b21-af11-d13307307fcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:47.045229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f04a3b9b-7a49-4b21-af11-d13307307fcd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151689 Aug 06 13:00:47.045792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1631/3272] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:47.795465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8cee15d8-54f5-432b-ad5b-27ba338cc4c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:47.796063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8cee15d8-54f5-432b-ad5b-27ba338cc4c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:47.808067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cee15d8-54f5-432b-ad5b-27ba338cc4c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:47.808580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cee15d8-54f5-432b-ad5b-27ba338cc4c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:47.809027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cee15d8-54f5-432b-ad5b-27ba338cc4c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:47.809720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cee15d8-54f5-432b-ad5b-27ba338cc4c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:47.810177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cee15d8-54f5-432b-ad5b-27ba338cc4c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:47.810603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cee15d8-54f5-432b-ad5b-27ba338cc4c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:47.940592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8cee15d8-54f5-432b-ad5b-27ba338cc4c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:47.948514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8cee15d8-54f5-432b-ad5b-27ba338cc4c2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.157345 Aug 06 13:00:47.949079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1642/3273] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:47 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:48.065354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-037558db-63ac-4bc0-8e75-4133cedb1fe9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:48.065901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-037558db-63ac-4bc0-8e75-4133cedb1fe9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:48.072494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-037558db-63ac-4bc0-8e75-4133cedb1fe9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:48.072978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-037558db-63ac-4bc0-8e75-4133cedb1fe9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:48.073415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-037558db-63ac-4bc0-8e75-4133cedb1fe9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:48.074099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-037558db-63ac-4bc0-8e75-4133cedb1fe9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:48.074561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-037558db-63ac-4bc0-8e75-4133cedb1fe9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:48.074986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-037558db-63ac-4bc0-8e75-4133cedb1fe9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:48.204914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-037558db-63ac-4bc0-8e75-4133cedb1fe9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:48.212839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-037558db-63ac-4bc0-8e75-4133cedb1fe9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151408 Aug 06 13:00:48.213409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1632/3274] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:48.969557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f22780f9-db9e-4f71-8576-01502f675d79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:48.970166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f22780f9-db9e-4f71-8576-01502f675d79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:48.976529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f22780f9-db9e-4f71-8576-01502f675d79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:48.977018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f22780f9-db9e-4f71-8576-01502f675d79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:48.977457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f22780f9-db9e-4f71-8576-01502f675d79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:48.978143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f22780f9-db9e-4f71-8576-01502f675d79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:48.978600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f22780f9-db9e-4f71-8576-01502f675d79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:48.979030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f22780f9-db9e-4f71-8576-01502f675d79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:49.106481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f22780f9-db9e-4f71-8576-01502f675d79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:49.114987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f22780f9-db9e-4f71-8576-01502f675d79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148745 Aug 06 13:00:49.115541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1643/3275] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:48 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:49.234319 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a9a8ce8d-7380-4fe1-82c4-e01ad25adc08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:49.234943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a9a8ce8d-7380-4fe1-82c4-e01ad25adc08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:49.241760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9a8ce8d-7380-4fe1-82c4-e01ad25adc08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:49.242239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9a8ce8d-7380-4fe1-82c4-e01ad25adc08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:49.242670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9a8ce8d-7380-4fe1-82c4-e01ad25adc08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:49.243353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9a8ce8d-7380-4fe1-82c4-e01ad25adc08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:49.243805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9a8ce8d-7380-4fe1-82c4-e01ad25adc08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:49.244225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9a8ce8d-7380-4fe1-82c4-e01ad25adc08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:49.372832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a9a8ce8d-7380-4fe1-82c4-e01ad25adc08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:49.381295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a9a8ce8d-7380-4fe1-82c4-e01ad25adc08 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151070 Aug 06 13:00:49.381856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1633/3276] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:50.136728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-657911ca-cd9d-4bbb-b94a-f303ce436116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:50.137305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-657911ca-cd9d-4bbb-b94a-f303ce436116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:50.143611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-657911ca-cd9d-4bbb-b94a-f303ce436116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:50.144080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-657911ca-cd9d-4bbb-b94a-f303ce436116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:50.144545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-657911ca-cd9d-4bbb-b94a-f303ce436116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:50.145218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-657911ca-cd9d-4bbb-b94a-f303ce436116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:50.146288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-657911ca-cd9d-4bbb-b94a-f303ce436116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:50.146721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-657911ca-cd9d-4bbb-b94a-f303ce436116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:50.275885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-657911ca-cd9d-4bbb-b94a-f303ce436116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:50.283903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-657911ca-cd9d-4bbb-b94a-f303ce436116 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151005 Aug 06 13:00:50.284514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1644/3277] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:50 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:50.402676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5fea5181-04d3-4506-a7ca-6bfb20cb0707 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:50.403339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5fea5181-04d3-4506-a7ca-6bfb20cb0707 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:50.409667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fea5181-04d3-4506-a7ca-6bfb20cb0707 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:50.410143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fea5181-04d3-4506-a7ca-6bfb20cb0707 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:50.410572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fea5181-04d3-4506-a7ca-6bfb20cb0707 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:50.411252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fea5181-04d3-4506-a7ca-6bfb20cb0707 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:50.411700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fea5181-04d3-4506-a7ca-6bfb20cb0707 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:50.412122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fea5181-04d3-4506-a7ca-6bfb20cb0707 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:50.538679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5fea5181-04d3-4506-a7ca-6bfb20cb0707 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:50.546546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5fea5181-04d3-4506-a7ca-6bfb20cb0707 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147811 Aug 06 13:00:50.547105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1634/3278] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:51.305079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de96c716-7702-49b6-a797-614641ef8e0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:51.305684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-de96c716-7702-49b6-a797-614641ef8e0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:51.311987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de96c716-7702-49b6-a797-614641ef8e0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:51.312506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de96c716-7702-49b6-a797-614641ef8e0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:51.312917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de96c716-7702-49b6-a797-614641ef8e0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:51.313585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de96c716-7702-49b6-a797-614641ef8e0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:51.314030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de96c716-7702-49b6-a797-614641ef8e0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:51.314448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de96c716-7702-49b6-a797-614641ef8e0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:51.441956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-de96c716-7702-49b6-a797-614641ef8e0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:51.449869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-de96c716-7702-49b6-a797-614641ef8e0c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148514 Aug 06 13:00:51.450426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1645/3279] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:51 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:51.569457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-083fd779-ded7-4635-b06c-dc5b2374475a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:51.570776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-083fd779-ded7-4635-b06c-dc5b2374475a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:51.577286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-083fd779-ded7-4635-b06c-dc5b2374475a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:51.577774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-083fd779-ded7-4635-b06c-dc5b2374475a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:51.578209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-083fd779-ded7-4635-b06c-dc5b2374475a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:51.578890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-083fd779-ded7-4635-b06c-dc5b2374475a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:51.579522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-083fd779-ded7-4635-b06c-dc5b2374475a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:51.579947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-083fd779-ded7-4635-b06c-dc5b2374475a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:51.719760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-083fd779-ded7-4635-b06c-dc5b2374475a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:51.728076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-083fd779-ded7-4635-b06c-dc5b2374475a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.164891 Aug 06 13:00:51.728669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1635/3280] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:52.471173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d339c4a8-7b61-4d97-8e5d-972562810327 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:52.471711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d339c4a8-7b61-4d97-8e5d-972562810327 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:52.478554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d339c4a8-7b61-4d97-8e5d-972562810327 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:52.479028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d339c4a8-7b61-4d97-8e5d-972562810327 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:52.479456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d339c4a8-7b61-4d97-8e5d-972562810327 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:52.480130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d339c4a8-7b61-4d97-8e5d-972562810327 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:52.480609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d339c4a8-7b61-4d97-8e5d-972562810327 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:52.481292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d339c4a8-7b61-4d97-8e5d-972562810327 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:52.612077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d339c4a8-7b61-4d97-8e5d-972562810327 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:52.620697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d339c4a8-7b61-4d97-8e5d-972562810327 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153331 Aug 06 13:00:52.621257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1646/3281] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:52 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:52.748963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2a841078-7e03-4725-994d-2d6b24132061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:52.749480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2a841078-7e03-4725-994d-2d6b24132061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:52.756058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a841078-7e03-4725-994d-2d6b24132061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:52.756563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a841078-7e03-4725-994d-2d6b24132061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:52.756993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a841078-7e03-4725-994d-2d6b24132061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:52.757666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a841078-7e03-4725-994d-2d6b24132061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:52.758112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a841078-7e03-4725-994d-2d6b24132061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:52.758531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a841078-7e03-4725-994d-2d6b24132061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:52.887266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2a841078-7e03-4725-994d-2d6b24132061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:52.895044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2a841078-7e03-4725-994d-2d6b24132061 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150003 Aug 06 13:00:52.896085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1636/3282] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:53.642045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d3cd2947-a5c7-4763-abd6-ed6541f0ffa1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:53.642650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d3cd2947-a5c7-4763-abd6-ed6541f0ffa1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:53.648994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cd2947-a5c7-4763-abd6-ed6541f0ffa1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:53.649467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cd2947-a5c7-4763-abd6-ed6541f0ffa1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:53.649891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cd2947-a5c7-4763-abd6-ed6541f0ffa1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:53.650562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cd2947-a5c7-4763-abd6-ed6541f0ffa1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:53.651006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cd2947-a5c7-4763-abd6-ed6541f0ffa1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:53.651419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cd2947-a5c7-4763-abd6-ed6541f0ffa1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:53.775852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d3cd2947-a5c7-4763-abd6-ed6541f0ffa1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:53.783637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d3cd2947-a5c7-4763-abd6-ed6541f0ffa1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145377 Aug 06 13:00:53.784186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1647/3283] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:53 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:53.916782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-830709d2-547f-4417-8af6-48067b7d9ec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:53.917416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-830709d2-547f-4417-8af6-48067b7d9ec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:53.923800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-830709d2-547f-4417-8af6-48067b7d9ec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:53.924278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-830709d2-547f-4417-8af6-48067b7d9ec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:53.924739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-830709d2-547f-4417-8af6-48067b7d9ec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:53.925417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-830709d2-547f-4417-8af6-48067b7d9ec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:53.925869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-830709d2-547f-4417-8af6-48067b7d9ec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:53.926290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-830709d2-547f-4417-8af6-48067b7d9ec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:54.053562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-830709d2-547f-4417-8af6-48067b7d9ec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:54.061423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-830709d2-547f-4417-8af6-48067b7d9ec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148561 Aug 06 13:00:54.061984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1637/3284] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:54.806905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c4fd3fc-ea1d-48b9-88ab-174f44d02126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:54.807508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c4fd3fc-ea1d-48b9-88ab-174f44d02126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:54.813868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c4fd3fc-ea1d-48b9-88ab-174f44d02126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:54.814349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c4fd3fc-ea1d-48b9-88ab-174f44d02126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:54.814783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c4fd3fc-ea1d-48b9-88ab-174f44d02126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:54.815461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c4fd3fc-ea1d-48b9-88ab-174f44d02126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:54.815913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c4fd3fc-ea1d-48b9-88ab-174f44d02126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:54.816363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c4fd3fc-ea1d-48b9-88ab-174f44d02126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:54.945554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4c4fd3fc-ea1d-48b9-88ab-174f44d02126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:54.953491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c4fd3fc-ea1d-48b9-88ab-174f44d02126 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150427 Aug 06 13:00:54.954061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1648/3285] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:54 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:55.082083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bf49506a-24fd-4b2c-92a3-03e4d89233b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:55.082622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bf49506a-24fd-4b2c-92a3-03e4d89233b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:55.089111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf49506a-24fd-4b2c-92a3-03e4d89233b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:55.089589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf49506a-24fd-4b2c-92a3-03e4d89233b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:55.090020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf49506a-24fd-4b2c-92a3-03e4d89233b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:55.090703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf49506a-24fd-4b2c-92a3-03e4d89233b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:55.091155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf49506a-24fd-4b2c-92a3-03e4d89233b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:55.091581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf49506a-24fd-4b2c-92a3-03e4d89233b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:55.220807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bf49506a-24fd-4b2c-92a3-03e4d89233b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:55.228560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bf49506a-24fd-4b2c-92a3-03e4d89233b9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150320 Aug 06 13:00:55.229119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1638/3286] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:00:55.975733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cac1b313-a888-4d5b-b761-6665bc9704bb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:55.976365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cac1b313-a888-4d5b-b761-6665bc9704bb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:55.982997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac1b313-a888-4d5b-b761-6665bc9704bb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:55.983465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac1b313-a888-4d5b-b761-6665bc9704bb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:55.983889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac1b313-a888-4d5b-b761-6665bc9704bb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:55.984580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac1b313-a888-4d5b-b761-6665bc9704bb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:55.985030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac1b313-a888-4d5b-b761-6665bc9704bb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:55.985447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cac1b313-a888-4d5b-b761-6665bc9704bb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:56.114258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cac1b313-a888-4d5b-b761-6665bc9704bb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:56.122068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cac1b313-a888-4d5b-b761-6665bc9704bb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150778 Aug 06 13:00:56.122618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1649/3287] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:55 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:56.249204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f88b681b-2121-45c3-ba25-303120fa0d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:56.249786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f88b681b-2121-45c3-ba25-303120fa0d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:56.256604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f88b681b-2121-45c3-ba25-303120fa0d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:56.257075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f88b681b-2121-45c3-ba25-303120fa0d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:56.257506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f88b681b-2121-45c3-ba25-303120fa0d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:56.258179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f88b681b-2121-45c3-ba25-303120fa0d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:56.258626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f88b681b-2121-45c3-ba25-303120fa0d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:56.259045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f88b681b-2121-45c3-ba25-303120fa0d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:56.382729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f88b681b-2121-45c3-ba25-303120fa0d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:56.390447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f88b681b-2121-45c3-ba25-303120fa0d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145187 Aug 06 13:00:56.391001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1639/3288] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:57.142810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c0f65fb8-0494-4058-848e-8369910bff67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:57.143412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c0f65fb8-0494-4058-848e-8369910bff67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:57.149819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f65fb8-0494-4058-848e-8369910bff67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:57.150294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f65fb8-0494-4058-848e-8369910bff67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:57.150715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f65fb8-0494-4058-848e-8369910bff67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:57.151385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f65fb8-0494-4058-848e-8369910bff67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:57.151829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f65fb8-0494-4058-848e-8369910bff67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:57.152245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0f65fb8-0494-4058-848e-8369910bff67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:57.287852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c0f65fb8-0494-4058-848e-8369910bff67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:57.295678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c0f65fb8-0494-4058-848e-8369910bff67 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.156698 Aug 06 13:00:57.296232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1650/3289] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:57 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:57.411675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d70699da-aa39-4824-b881-79b2f05125c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:57.412315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d70699da-aa39-4824-b881-79b2f05125c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:57.418699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d70699da-aa39-4824-b881-79b2f05125c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:57.419180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d70699da-aa39-4824-b881-79b2f05125c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:57.419619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d70699da-aa39-4824-b881-79b2f05125c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:57.420315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d70699da-aa39-4824-b881-79b2f05125c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:57.420844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d70699da-aa39-4824-b881-79b2f05125c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:57.421266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d70699da-aa39-4824-b881-79b2f05125c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:57.549198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d70699da-aa39-4824-b881-79b2f05125c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:57.557135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d70699da-aa39-4824-b881-79b2f05125c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149886 Aug 06 13:00:57.557697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1640/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:58.316675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9f83bca5-d677-4d00-923a-ba51e7f336f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:58.317862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9f83bca5-d677-4d00-923a-ba51e7f336f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:58.324386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f83bca5-d677-4d00-923a-ba51e7f336f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:58.324874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f83bca5-d677-4d00-923a-ba51e7f336f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:58.325371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f83bca5-d677-4d00-923a-ba51e7f336f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:58.326075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f83bca5-d677-4d00-923a-ba51e7f336f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:58.326603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f83bca5-d677-4d00-923a-ba51e7f336f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:58.327101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9f83bca5-d677-4d00-923a-ba51e7f336f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:58.455957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9f83bca5-d677-4d00-923a-ba51e7f336f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:58.463869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9f83bca5-d677-4d00-923a-ba51e7f336f9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151085 Aug 06 13:00:58.464453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1651/3291] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:58 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:58.577690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5cc9196e-0f8e-4af8-a1c2-14a62e9dc2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:58.578236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5cc9196e-0f8e-4af8-a1c2-14a62e9dc2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:58.586183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cc9196e-0f8e-4af8-a1c2-14a62e9dc2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:58.586739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cc9196e-0f8e-4af8-a1c2-14a62e9dc2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:58.587293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cc9196e-0f8e-4af8-a1c2-14a62e9dc2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:58.588617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cc9196e-0f8e-4af8-a1c2-14a62e9dc2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:58.589080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cc9196e-0f8e-4af8-a1c2-14a62e9dc2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:58.589506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5cc9196e-0f8e-4af8-a1c2-14a62e9dc2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:58.716262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5cc9196e-0f8e-4af8-a1c2-14a62e9dc2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:58.724723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5cc9196e-0f8e-4af8-a1c2-14a62e9dc2fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151095 Aug 06 13:00:58.725290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1641/3292] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:59.486448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cb3d7d8b-464f-40e7-bf12-652f4b536f3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:59.487045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cb3d7d8b-464f-40e7-bf12-652f4b536f3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:59.493876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb3d7d8b-464f-40e7-bf12-652f4b536f3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:59.494359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb3d7d8b-464f-40e7-bf12-652f4b536f3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:59.494790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb3d7d8b-464f-40e7-bf12-652f4b536f3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:59.495466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb3d7d8b-464f-40e7-bf12-652f4b536f3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:59.495917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb3d7d8b-464f-40e7-bf12-652f4b536f3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:59.496358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb3d7d8b-464f-40e7-bf12-652f4b536f3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:59.623220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cb3d7d8b-464f-40e7-bf12-652f4b536f3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:59.631812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cb3d7d8b-464f-40e7-bf12-652f4b536f3d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149285 Aug 06 13:00:59.632404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1652/3293] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:00:59.746055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3733e6e7-fe6a-43ae-9b34-f63216ef2431 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:00:59.746592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3733e6e7-fe6a-43ae-9b34-f63216ef2431 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:00:59.753103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3733e6e7-fe6a-43ae-9b34-f63216ef2431 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:59.753581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3733e6e7-fe6a-43ae-9b34-f63216ef2431 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:59.754014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3733e6e7-fe6a-43ae-9b34-f63216ef2431 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:59.755275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3733e6e7-fe6a-43ae-9b34-f63216ef2431 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:00:59.755758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3733e6e7-fe6a-43ae-9b34-f63216ef2431 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:00:59.756179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3733e6e7-fe6a-43ae-9b34-f63216ef2431 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:00:59.881980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3733e6e7-fe6a-43ae-9b34-f63216ef2431 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:00:59.889924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3733e6e7-fe6a-43ae-9b34-f63216ef2431 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147753 Aug 06 13:00:59.890490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1642/3294] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:00:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:00.652948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-36f0ff6c-53b3-4441-aadd-817ee2d11a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:00.653562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-36f0ff6c-53b3-4441-aadd-817ee2d11a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:00.659917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36f0ff6c-53b3-4441-aadd-817ee2d11a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:00.660422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36f0ff6c-53b3-4441-aadd-817ee2d11a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:00.660895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36f0ff6c-53b3-4441-aadd-817ee2d11a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:00.661566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36f0ff6c-53b3-4441-aadd-817ee2d11a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:00.662012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36f0ff6c-53b3-4441-aadd-817ee2d11a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:00.662422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36f0ff6c-53b3-4441-aadd-817ee2d11a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:00.791550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-36f0ff6c-53b3-4441-aadd-817ee2d11a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:00.799357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-36f0ff6c-53b3-4441-aadd-817ee2d11a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150246 Aug 06 13:01:00.799909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1653/3295] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:00 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:00.910532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-749f6d27-239b-44da-b6c0-868f641c2f7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:00.911103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-749f6d27-239b-44da-b6c0-868f641c2f7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:00.917430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-749f6d27-239b-44da-b6c0-868f641c2f7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:00.917905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-749f6d27-239b-44da-b6c0-868f641c2f7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:00.918339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-749f6d27-239b-44da-b6c0-868f641c2f7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:00.919017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-749f6d27-239b-44da-b6c0-868f641c2f7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:00.919467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-749f6d27-239b-44da-b6c0-868f641c2f7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:00.919890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-749f6d27-239b-44da-b6c0-868f641c2f7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:01.049957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-749f6d27-239b-44da-b6c0-868f641c2f7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:01.057779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-749f6d27-239b-44da-b6c0-868f641c2f7d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151149 Aug 06 13:01:01.058346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1643/3296] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:01.820829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f3b56ef4-0896-406c-958d-204ab3ae977b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:01.821459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f3b56ef4-0896-406c-958d-204ab3ae977b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:01.830223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3b56ef4-0896-406c-958d-204ab3ae977b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:01.830702 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3b56ef4-0896-406c-958d-204ab3ae977b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:01.831133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3b56ef4-0896-406c-958d-204ab3ae977b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:01.831821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3b56ef4-0896-406c-958d-204ab3ae977b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:01.832268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3b56ef4-0896-406c-958d-204ab3ae977b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:01.833812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3b56ef4-0896-406c-958d-204ab3ae977b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:01.964146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f3b56ef4-0896-406c-958d-204ab3ae977b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:01.971992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f3b56ef4-0896-406c-958d-204ab3ae977b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155628 Aug 06 13:01:01.972572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1654/3297] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:01 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:02.078380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e82dca08-fb87-4e1a-894e-ebebb9e47073 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:02.078959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e82dca08-fb87-4e1a-894e-ebebb9e47073 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:02.085328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e82dca08-fb87-4e1a-894e-ebebb9e47073 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:02.085811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e82dca08-fb87-4e1a-894e-ebebb9e47073 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:02.086250 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e82dca08-fb87-4e1a-894e-ebebb9e47073 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:02.086939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e82dca08-fb87-4e1a-894e-ebebb9e47073 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:02.087396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e82dca08-fb87-4e1a-894e-ebebb9e47073 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:02.087824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e82dca08-fb87-4e1a-894e-ebebb9e47073 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:02.216624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e82dca08-fb87-4e1a-894e-ebebb9e47073 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:02.225221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e82dca08-fb87-4e1a-894e-ebebb9e47073 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150706 Aug 06 13:01:02.225785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1644/3298] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:02.993793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-be361e6a-3fca-40b0-bfaf-55189b084a08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:02.994494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-be361e6a-3fca-40b0-bfaf-55189b084a08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:03.000891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be361e6a-3fca-40b0-bfaf-55189b084a08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:03.001373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be361e6a-3fca-40b0-bfaf-55189b084a08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:03.001804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be361e6a-3fca-40b0-bfaf-55189b084a08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:03.002506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be361e6a-3fca-40b0-bfaf-55189b084a08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:03.002956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be361e6a-3fca-40b0-bfaf-55189b084a08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:03.003375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be361e6a-3fca-40b0-bfaf-55189b084a08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:03.007846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:01:03.134380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-be361e6a-3fca-40b0-bfaf-55189b084a08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:03.144688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-be361e6a-3fca-40b0-bfaf-55189b084a08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154349 Aug 06 13:01:03.146301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1655/3299] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:02 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:03.246413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cacedc2f-69cf-4068-ac4a-c456d84deec0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:03.246938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cacedc2f-69cf-4068-ac4a-c456d84deec0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:03.252824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cacedc2f-69cf-4068-ac4a-c456d84deec0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:03.253297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cacedc2f-69cf-4068-ac4a-c456d84deec0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:03.253723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cacedc2f-69cf-4068-ac4a-c456d84deec0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:03.254430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cacedc2f-69cf-4068-ac4a-c456d84deec0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:03.255452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cacedc2f-69cf-4068-ac4a-c456d84deec0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:03.255868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cacedc2f-69cf-4068-ac4a-c456d84deec0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:03.384069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cacedc2f-69cf-4068-ac4a-c456d84deec0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:03.391969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cacedc2f-69cf-4068-ac4a-c456d84deec0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149699 Aug 06 13:01:03.392575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1645/3300] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:04.167535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ce0dec7d-250b-4598-8b97-e99eb5a554a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:04.168176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ce0dec7d-250b-4598-8b97-e99eb5a554a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:04.174655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0dec7d-250b-4598-8b97-e99eb5a554a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:04.175075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0dec7d-250b-4598-8b97-e99eb5a554a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:04.175511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0dec7d-250b-4598-8b97-e99eb5a554a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:04.176193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0dec7d-250b-4598-8b97-e99eb5a554a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:04.176668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0dec7d-250b-4598-8b97-e99eb5a554a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:04.177095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce0dec7d-250b-4598-8b97-e99eb5a554a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:04.306839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ce0dec7d-250b-4598-8b97-e99eb5a554a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:04.314692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ce0dec7d-250b-4598-8b97-e99eb5a554a6 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151027 Aug 06 13:01:04.315250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1656/3301] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:04 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:04.413042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd9592b6-d633-4803-902b-4f8eb97bd02a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:04.413718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd9592b6-d633-4803-902b-4f8eb97bd02a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:04.419996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd9592b6-d633-4803-902b-4f8eb97bd02a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:04.420510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd9592b6-d633-4803-902b-4f8eb97bd02a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:04.420948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd9592b6-d633-4803-902b-4f8eb97bd02a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:04.421633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd9592b6-d633-4803-902b-4f8eb97bd02a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:04.422086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd9592b6-d633-4803-902b-4f8eb97bd02a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:04.422509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd9592b6-d633-4803-902b-4f8eb97bd02a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:04.425097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:01:04.552690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd9592b6-d633-4803-902b-4f8eb97bd02a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:04.560568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd9592b6-d633-4803-902b-4f8eb97bd02a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151284 Aug 06 13:01:04.561138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1646/3302] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:05.335584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-664b824d-64e9-4c25-b7de-2dd0a79d0ed3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:05.336182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-664b824d-64e9-4c25-b7de-2dd0a79d0ed3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:05.342570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664b824d-64e9-4c25-b7de-2dd0a79d0ed3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:05.343045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664b824d-64e9-4c25-b7de-2dd0a79d0ed3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:05.343472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664b824d-64e9-4c25-b7de-2dd0a79d0ed3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:05.344150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664b824d-64e9-4c25-b7de-2dd0a79d0ed3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:05.344634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664b824d-64e9-4c25-b7de-2dd0a79d0ed3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:05.345053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-664b824d-64e9-4c25-b7de-2dd0a79d0ed3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:05.472932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-664b824d-64e9-4c25-b7de-2dd0a79d0ed3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:05.481612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-664b824d-64e9-4c25-b7de-2dd0a79d0ed3 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149860 Aug 06 13:01:05.482177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1657/3303] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:05 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:05.581806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b8bfc5ec-6313-407a-90ea-517fcf249e90 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:05.582925 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b8bfc5ec-6313-407a-90ea-517fcf249e90 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:05.589358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8bfc5ec-6313-407a-90ea-517fcf249e90 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:05.589781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8bfc5ec-6313-407a-90ea-517fcf249e90 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:05.590217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8bfc5ec-6313-407a-90ea-517fcf249e90 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:05.590905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8bfc5ec-6313-407a-90ea-517fcf249e90 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:05.591359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8bfc5ec-6313-407a-90ea-517fcf249e90 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:05.591784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8bfc5ec-6313-407a-90ea-517fcf249e90 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:05.715187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8bfc5ec-6313-407a-90ea-517fcf249e90 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:05.723711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b8bfc5ec-6313-407a-90ea-517fcf249e90 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145189 Aug 06 13:01:05.724285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1647/3304] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:06.502493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2dbe15cc-d404-40dc-8589-71229d7370cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:06.503096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2dbe15cc-d404-40dc-8589-71229d7370cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:06.510069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dbe15cc-d404-40dc-8589-71229d7370cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:06.510542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dbe15cc-d404-40dc-8589-71229d7370cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:06.510968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dbe15cc-d404-40dc-8589-71229d7370cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:06.511637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dbe15cc-d404-40dc-8589-71229d7370cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:06.512081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dbe15cc-d404-40dc-8589-71229d7370cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:06.512527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dbe15cc-d404-40dc-8589-71229d7370cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:06.642359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2dbe15cc-d404-40dc-8589-71229d7370cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:06.650199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2dbe15cc-d404-40dc-8589-71229d7370cd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151493 Aug 06 13:01:06.650748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1658/3305] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:06.744841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fde1bb27-3903-41ed-af57-852da58bec46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:06.745441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fde1bb27-3903-41ed-af57-852da58bec46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:06.751774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fde1bb27-3903-41ed-af57-852da58bec46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:06.752248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fde1bb27-3903-41ed-af57-852da58bec46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:06.752754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fde1bb27-3903-41ed-af57-852da58bec46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:06.753376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fde1bb27-3903-41ed-af57-852da58bec46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:06.753822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fde1bb27-3903-41ed-af57-852da58bec46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:06.754245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fde1bb27-3903-41ed-af57-852da58bec46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:06.885048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fde1bb27-3903-41ed-af57-852da58bec46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:06.893187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fde1bb27-3903-41ed-af57-852da58bec46 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152031 Aug 06 13:01:06.893763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1648/3306] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:01:07.671499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-95b521fc-0d51-4edb-84f1-44a604bedcaf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:07.672104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-95b521fc-0d51-4edb-84f1-44a604bedcaf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:07.678555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95b521fc-0d51-4edb-84f1-44a604bedcaf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:07.679030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95b521fc-0d51-4edb-84f1-44a604bedcaf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:07.679462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95b521fc-0d51-4edb-84f1-44a604bedcaf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:07.680141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95b521fc-0d51-4edb-84f1-44a604bedcaf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:07.680615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95b521fc-0d51-4edb-84f1-44a604bedcaf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:07.681036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95b521fc-0d51-4edb-84f1-44a604bedcaf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:07.809848 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-95b521fc-0d51-4edb-84f1-44a604bedcaf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:07.818295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-95b521fc-0d51-4edb-84f1-44a604bedcaf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150643 Aug 06 13:01:07.818847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1659/3307] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:07 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:07.914303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-91dad709-2d4f-48cb-b151-43e6fc48ac85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:07.914910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-91dad709-2d4f-48cb-b151-43e6fc48ac85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:07.921194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91dad709-2d4f-48cb-b151-43e6fc48ac85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:07.921666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91dad709-2d4f-48cb-b151-43e6fc48ac85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:07.922094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91dad709-2d4f-48cb-b151-43e6fc48ac85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:07.922764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91dad709-2d4f-48cb-b151-43e6fc48ac85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:07.923207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91dad709-2d4f-48cb-b151-43e6fc48ac85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:07.923622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91dad709-2d4f-48cb-b151-43e6fc48ac85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:08.050467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-91dad709-2d4f-48cb-b151-43e6fc48ac85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:08.058345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-91dad709-2d4f-48cb-b151-43e6fc48ac85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147779 Aug 06 13:01:08.058848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1649/3308] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:08.839431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-93a364f1-6d21-4535-aa96-26e3b5fb511c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:08.840039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-93a364f1-6d21-4535-aa96-26e3b5fb511c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:08.846440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93a364f1-6d21-4535-aa96-26e3b5fb511c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:08.846920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93a364f1-6d21-4535-aa96-26e3b5fb511c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:08.847357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93a364f1-6d21-4535-aa96-26e3b5fb511c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:08.848577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93a364f1-6d21-4535-aa96-26e3b5fb511c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:08.849035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93a364f1-6d21-4535-aa96-26e3b5fb511c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:08.850544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93a364f1-6d21-4535-aa96-26e3b5fb511c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:08.976715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-93a364f1-6d21-4535-aa96-26e3b5fb511c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:08.984882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-93a364f1-6d21-4535-aa96-26e3b5fb511c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149388 Aug 06 13:01:08.985438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1660/3309] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:09.079496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d2c27aba-f46f-4c03-ac43-9c1964dea1f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:09.080149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d2c27aba-f46f-4c03-ac43-9c1964dea1f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:09.082644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=52 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:01:09.088005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2c27aba-f46f-4c03-ac43-9c1964dea1f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:09.088517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2c27aba-f46f-4c03-ac43-9c1964dea1f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:09.088952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2c27aba-f46f-4c03-ac43-9c1964dea1f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:09.089688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2c27aba-f46f-4c03-ac43-9c1964dea1f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:09.090083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2c27aba-f46f-4c03-ac43-9c1964dea1f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:09.090531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2c27aba-f46f-4c03-ac43-9c1964dea1f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:09.230332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d2c27aba-f46f-4c03-ac43-9c1964dea1f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:09.239146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d2c27aba-f46f-4c03-ac43-9c1964dea1f0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.162995 Aug 06 13:01:09.239730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1650/3310] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:10.006845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6014576d-ecd7-430e-b73c-89d2dfab6493 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:10.007445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6014576d-ecd7-430e-b73c-89d2dfab6493 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:10.013800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6014576d-ecd7-430e-b73c-89d2dfab6493 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:10.014270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6014576d-ecd7-430e-b73c-89d2dfab6493 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:10.014696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6014576d-ecd7-430e-b73c-89d2dfab6493 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:10.015364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6014576d-ecd7-430e-b73c-89d2dfab6493 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:10.015807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6014576d-ecd7-430e-b73c-89d2dfab6493 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:10.016221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6014576d-ecd7-430e-b73c-89d2dfab6493 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:10.145604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6014576d-ecd7-430e-b73c-89d2dfab6493 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:10.153429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6014576d-ecd7-430e-b73c-89d2dfab6493 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151059 Aug 06 13:01:10.153979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1661/3311] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:10.259557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f0901ba3-d3ba-48d1-be95-7dfc6ce751f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:10.260080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f0901ba3-d3ba-48d1-be95-7dfc6ce751f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:10.266437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0901ba3-d3ba-48d1-be95-7dfc6ce751f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:10.266915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0901ba3-d3ba-48d1-be95-7dfc6ce751f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:10.267348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0901ba3-d3ba-48d1-be95-7dfc6ce751f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:10.268032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0901ba3-d3ba-48d1-be95-7dfc6ce751f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:10.268519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0901ba3-d3ba-48d1-be95-7dfc6ce751f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:10.268941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0901ba3-d3ba-48d1-be95-7dfc6ce751f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:10.394037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f0901ba3-d3ba-48d1-be95-7dfc6ce751f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:10.401875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f0901ba3-d3ba-48d1-be95-7dfc6ce751f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146201 Aug 06 13:01:10.402436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1651/3312] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:11.174704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a520b4ca-6099-4c28-ac34-17f379b1a286 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:11.175298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a520b4ca-6099-4c28-ac34-17f379b1a286 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:11.181603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a520b4ca-6099-4c28-ac34-17f379b1a286 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:11.182074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a520b4ca-6099-4c28-ac34-17f379b1a286 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:11.182501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a520b4ca-6099-4c28-ac34-17f379b1a286 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:11.183167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a520b4ca-6099-4c28-ac34-17f379b1a286 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:11.183608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a520b4ca-6099-4c28-ac34-17f379b1a286 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:11.184032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a520b4ca-6099-4c28-ac34-17f379b1a286 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:11.309162 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a520b4ca-6099-4c28-ac34-17f379b1a286 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:11.317009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a520b4ca-6099-4c28-ac34-17f379b1a286 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146479 Aug 06 13:01:11.317570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1662/3313] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:11.422893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b025eb20-568e-4126-b980-7e439648af06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:11.423521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b025eb20-568e-4126-b980-7e439648af06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:11.430283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b025eb20-568e-4126-b980-7e439648af06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:11.430756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b025eb20-568e-4126-b980-7e439648af06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:11.431187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b025eb20-568e-4126-b980-7e439648af06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:11.431866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b025eb20-568e-4126-b980-7e439648af06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:11.432335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b025eb20-568e-4126-b980-7e439648af06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:11.432764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b025eb20-568e-4126-b980-7e439648af06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:11.561529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b025eb20-568e-4126-b980-7e439648af06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:11.569987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b025eb20-568e-4126-b980-7e439648af06 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150925 Aug 06 13:01:11.570546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1652/3314] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:12.339193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d9460b77-10d6-4365-bf3a-98a2ac941911 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:12.339777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d9460b77-10d6-4365-bf3a-98a2ac941911 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:12.346128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9460b77-10d6-4365-bf3a-98a2ac941911 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:12.346597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9460b77-10d6-4365-bf3a-98a2ac941911 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:12.347059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9460b77-10d6-4365-bf3a-98a2ac941911 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:12.347725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9460b77-10d6-4365-bf3a-98a2ac941911 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:12.348168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9460b77-10d6-4365-bf3a-98a2ac941911 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:12.348609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9460b77-10d6-4365-bf3a-98a2ac941911 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:12.477607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d9460b77-10d6-4365-bf3a-98a2ac941911 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:12.485713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d9460b77-10d6-4365-bf3a-98a2ac941911 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150361 Aug 06 13:01:12.486273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1663/3315] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:12 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:12.590305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-99cbe265-2d08-4a7f-9ab7-58802eb86326 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:12.590841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-99cbe265-2d08-4a7f-9ab7-58802eb86326 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:12.597184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99cbe265-2d08-4a7f-9ab7-58802eb86326 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:12.597656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99cbe265-2d08-4a7f-9ab7-58802eb86326 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:12.598083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99cbe265-2d08-4a7f-9ab7-58802eb86326 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:12.598753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99cbe265-2d08-4a7f-9ab7-58802eb86326 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:12.599244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99cbe265-2d08-4a7f-9ab7-58802eb86326 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:12.599647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99cbe265-2d08-4a7f-9ab7-58802eb86326 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:12.724751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-99cbe265-2d08-4a7f-9ab7-58802eb86326 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:12.733005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-99cbe265-2d08-4a7f-9ab7-58802eb86326 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146540 Aug 06 13:01:12.733563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1653/3316] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:13.506001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8088ba37-af09-481c-acc4-8e61673c5670 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:13.506605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8088ba37-af09-481c-acc4-8e61673c5670 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:13.509337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=52 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:01:13.514668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8088ba37-af09-481c-acc4-8e61673c5670 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:13.515144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8088ba37-af09-481c-acc4-8e61673c5670 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:13.515575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8088ba37-af09-481c-acc4-8e61673c5670 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:13.516256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8088ba37-af09-481c-acc4-8e61673c5670 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:13.516728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8088ba37-af09-481c-acc4-8e61673c5670 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:13.517148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8088ba37-af09-481c-acc4-8e61673c5670 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:13.647518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8088ba37-af09-481c-acc4-8e61673c5670 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:13.655448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8088ba37-af09-481c-acc4-8e61673c5670 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153306 Aug 06 13:01:13.656012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1664/3317] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:13 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:13.753808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-312b566d-bdb4-4b41-8e11-736de80c7ae1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:13.754416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-312b566d-bdb4-4b41-8e11-736de80c7ae1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:13.760798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-312b566d-bdb4-4b41-8e11-736de80c7ae1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:13.761217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-312b566d-bdb4-4b41-8e11-736de80c7ae1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:13.761649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-312b566d-bdb4-4b41-8e11-736de80c7ae1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:13.762331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-312b566d-bdb4-4b41-8e11-736de80c7ae1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:13.762780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-312b566d-bdb4-4b41-8e11-736de80c7ae1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:13.763200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-312b566d-bdb4-4b41-8e11-736de80c7ae1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:13.891828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-312b566d-bdb4-4b41-8e11-736de80c7ae1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:13.903432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-312b566d-bdb4-4b41-8e11-736de80c7ae1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153024 Aug 06 13:01:13.904023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1654/3318] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:14.676926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2eac9541-6ec3-43f3-b76e-42adb585ad4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:14.678085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2eac9541-6ec3-43f3-b76e-42adb585ad4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:14.684413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eac9541-6ec3-43f3-b76e-42adb585ad4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:14.684889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eac9541-6ec3-43f3-b76e-42adb585ad4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:14.685312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eac9541-6ec3-43f3-b76e-42adb585ad4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:14.685980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eac9541-6ec3-43f3-b76e-42adb585ad4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:14.686422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eac9541-6ec3-43f3-b76e-42adb585ad4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:14.686836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eac9541-6ec3-43f3-b76e-42adb585ad4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:14.816867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2eac9541-6ec3-43f3-b76e-42adb585ad4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:14.825357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2eac9541-6ec3-43f3-b76e-42adb585ad4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152242 Aug 06 13:01:14.825915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1665/3319] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:14.927912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-29dff919-d66f-4735-a1bf-a1d8c6aea9b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:14.928488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-29dff919-d66f-4735-a1bf-a1d8c6aea9b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:14.935048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29dff919-d66f-4735-a1bf-a1d8c6aea9b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:14.935526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29dff919-d66f-4735-a1bf-a1d8c6aea9b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:14.935964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29dff919-d66f-4735-a1bf-a1d8c6aea9b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:14.936687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29dff919-d66f-4735-a1bf-a1d8c6aea9b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:14.937144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29dff919-d66f-4735-a1bf-a1d8c6aea9b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:14.937568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29dff919-d66f-4735-a1bf-a1d8c6aea9b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:15.067021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29dff919-d66f-4735-a1bf-a1d8c6aea9b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:15.074830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-29dff919-d66f-4735-a1bf-a1d8c6aea9b3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151544 Aug 06 13:01:15.075396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1655/3320] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:15.846618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4754cf41-2d67-44e4-960f-5fc17ecb07d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:15.847228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4754cf41-2d67-44e4-960f-5fc17ecb07d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:15.853466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4754cf41-2d67-44e4-960f-5fc17ecb07d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:15.853947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4754cf41-2d67-44e4-960f-5fc17ecb07d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:15.854375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4754cf41-2d67-44e4-960f-5fc17ecb07d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:15.855354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4754cf41-2d67-44e4-960f-5fc17ecb07d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:15.856228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4754cf41-2d67-44e4-960f-5fc17ecb07d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:15.856742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4754cf41-2d67-44e4-960f-5fc17ecb07d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:15.985303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4754cf41-2d67-44e4-960f-5fc17ecb07d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:15.993602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4754cf41-2d67-44e4-960f-5fc17ecb07d9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151218 Aug 06 13:01:15.994154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1666/3321] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:16.094801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f339ae22-40c1-48c8-9252-16aac4be2a32 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:16.095413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f339ae22-40c1-48c8-9252-16aac4be2a32 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:16.101842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f339ae22-40c1-48c8-9252-16aac4be2a32 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:16.102268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f339ae22-40c1-48c8-9252-16aac4be2a32 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:16.102711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f339ae22-40c1-48c8-9252-16aac4be2a32 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:16.103400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f339ae22-40c1-48c8-9252-16aac4be2a32 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:16.103856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f339ae22-40c1-48c8-9252-16aac4be2a32 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:16.104284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f339ae22-40c1-48c8-9252-16aac4be2a32 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:16.230201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f339ae22-40c1-48c8-9252-16aac4be2a32 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:16.238215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f339ae22-40c1-48c8-9252-16aac4be2a32 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147240 Aug 06 13:01:16.238775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1656/3322] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:17.015850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ff80240e-4ba5-4994-9c76-f5f786f8464c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:17.016491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ff80240e-4ba5-4994-9c76-f5f786f8464c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:17.023311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff80240e-4ba5-4994-9c76-f5f786f8464c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:17.023783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff80240e-4ba5-4994-9c76-f5f786f8464c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:17.024212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff80240e-4ba5-4994-9c76-f5f786f8464c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:17.024911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff80240e-4ba5-4994-9c76-f5f786f8464c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:17.025355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff80240e-4ba5-4994-9c76-f5f786f8464c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:17.025771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff80240e-4ba5-4994-9c76-f5f786f8464c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:17.152713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ff80240e-4ba5-4994-9c76-f5f786f8464c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:17.160656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ff80240e-4ba5-4994-9c76-f5f786f8464c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149003 Aug 06 13:01:17.161218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1667/3323] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:17.259731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bce2fdcc-0a18-470d-af1b-9508222c4032 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:17.260267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bce2fdcc-0a18-470d-af1b-9508222c4032 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:17.266705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bce2fdcc-0a18-470d-af1b-9508222c4032 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:17.267182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bce2fdcc-0a18-470d-af1b-9508222c4032 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:17.267615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bce2fdcc-0a18-470d-af1b-9508222c4032 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:17.268318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bce2fdcc-0a18-470d-af1b-9508222c4032 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:17.268774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bce2fdcc-0a18-470d-af1b-9508222c4032 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:17.269201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bce2fdcc-0a18-470d-af1b-9508222c4032 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:17.397325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bce2fdcc-0a18-470d-af1b-9508222c4032 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:17.405260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bce2fdcc-0a18-470d-af1b-9508222c4032 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149903 Aug 06 13:01:17.405814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1657/3324] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:18.188453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a2933847-0c75-4dff-9f1b-3c832d93d3b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:18.189080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a2933847-0c75-4dff-9f1b-3c832d93d3b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:18.195681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2933847-0c75-4dff-9f1b-3c832d93d3b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:18.196147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2933847-0c75-4dff-9f1b-3c832d93d3b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:18.196605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2933847-0c75-4dff-9f1b-3c832d93d3b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:18.197274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2933847-0c75-4dff-9f1b-3c832d93d3b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:18.197718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2933847-0c75-4dff-9f1b-3c832d93d3b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:18.198131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2933847-0c75-4dff-9f1b-3c832d93d3b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:18.325982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2933847-0c75-4dff-9f1b-3c832d93d3b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:18.334285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a2933847-0c75-4dff-9f1b-3c832d93d3b8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149667 Aug 06 13:01:18.334845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1668/3325] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:18 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:18.425831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f46f5941-502f-4196-8137-4fc8fdd097e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:18.426438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f46f5941-502f-4196-8137-4fc8fdd097e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:18.432772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46f5941-502f-4196-8137-4fc8fdd097e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:18.433252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46f5941-502f-4196-8137-4fc8fdd097e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:18.433686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46f5941-502f-4196-8137-4fc8fdd097e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:18.434363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46f5941-502f-4196-8137-4fc8fdd097e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:18.434817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46f5941-502f-4196-8137-4fc8fdd097e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:18.435234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f46f5941-502f-4196-8137-4fc8fdd097e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:18.571835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f46f5941-502f-4196-8137-4fc8fdd097e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:18.579700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f46f5941-502f-4196-8137-4fc8fdd097e0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.157681 Aug 06 13:01:18.580307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1658/3326] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:18 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:19.356159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0f208fca-0443-4670-8bb4-2f549c3b7b14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:19.356788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0f208fca-0443-4670-8bb4-2f549c3b7b14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:19.363255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f208fca-0443-4670-8bb4-2f549c3b7b14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:19.363733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f208fca-0443-4670-8bb4-2f549c3b7b14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:19.364164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f208fca-0443-4670-8bb4-2f549c3b7b14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:19.365525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f208fca-0443-4670-8bb4-2f549c3b7b14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:19.365980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f208fca-0443-4670-8bb4-2f549c3b7b14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:19.366402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f208fca-0443-4670-8bb4-2f549c3b7b14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:19.491081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0f208fca-0443-4670-8bb4-2f549c3b7b14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:19.498857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0f208fca-0443-4670-8bb4-2f549c3b7b14 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146805 Aug 06 13:01:19.499404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1669/3327] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:19.601439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2ae7b943-6ab5-4076-b15b-a31b265f7eac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:19.602040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2ae7b943-6ab5-4076-b15b-a31b265f7eac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:19.608784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ae7b943-6ab5-4076-b15b-a31b265f7eac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:19.609203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ae7b943-6ab5-4076-b15b-a31b265f7eac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:19.609630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ae7b943-6ab5-4076-b15b-a31b265f7eac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:19.610303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ae7b943-6ab5-4076-b15b-a31b265f7eac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:19.610751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ae7b943-6ab5-4076-b15b-a31b265f7eac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:19.611165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ae7b943-6ab5-4076-b15b-a31b265f7eac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:19.735717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2ae7b943-6ab5-4076-b15b-a31b265f7eac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:19.743463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2ae7b943-6ab5-4076-b15b-a31b265f7eac tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146287 Aug 06 13:01:19.744022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1659/3328] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:20.519206 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1dba82a0-afd7-4b17-afa6-1542c971ee1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:20.519790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1dba82a0-afd7-4b17-afa6-1542c971ee1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:20.526167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1dba82a0-afd7-4b17-afa6-1542c971ee1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:20.526645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1dba82a0-afd7-4b17-afa6-1542c971ee1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:20.527077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1dba82a0-afd7-4b17-afa6-1542c971ee1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:20.527758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1dba82a0-afd7-4b17-afa6-1542c971ee1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:20.528204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1dba82a0-afd7-4b17-afa6-1542c971ee1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:20.528650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1dba82a0-afd7-4b17-afa6-1542c971ee1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:20.658668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1dba82a0-afd7-4b17-afa6-1542c971ee1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:20.666965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1dba82a0-afd7-4b17-afa6-1542c971ee1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151563 Aug 06 13:01:20.667533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1670/3329] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:20.763177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7111e984-688e-4f80-a0c1-b3ea842386cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:20.763789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7111e984-688e-4f80-a0c1-b3ea842386cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:20.770179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7111e984-688e-4f80-a0c1-b3ea842386cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:20.770623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7111e984-688e-4f80-a0c1-b3ea842386cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:20.771055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7111e984-688e-4f80-a0c1-b3ea842386cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:20.771729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7111e984-688e-4f80-a0c1-b3ea842386cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:20.772177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7111e984-688e-4f80-a0c1-b3ea842386cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:20.772620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7111e984-688e-4f80-a0c1-b3ea842386cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:20.900882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7111e984-688e-4f80-a0c1-b3ea842386cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:20.908797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7111e984-688e-4f80-a0c1-b3ea842386cd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149317 Aug 06 13:01:20.909357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1660/3330] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:21.689131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-34509738-808b-4efb-8b9b-0a5bea2ecd4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:21.689737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-34509738-808b-4efb-8b9b-0a5bea2ecd4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:21.696662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34509738-808b-4efb-8b9b-0a5bea2ecd4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:21.697138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34509738-808b-4efb-8b9b-0a5bea2ecd4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:21.697568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34509738-808b-4efb-8b9b-0a5bea2ecd4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:21.698243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34509738-808b-4efb-8b9b-0a5bea2ecd4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:21.698694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34509738-808b-4efb-8b9b-0a5bea2ecd4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:21.699114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34509738-808b-4efb-8b9b-0a5bea2ecd4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:21.825572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34509738-808b-4efb-8b9b-0a5bea2ecd4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:21.827722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:01:21.835294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-34509738-808b-4efb-8b9b-0a5bea2ecd4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150025 Aug 06 13:01:21.835850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1671/3331] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:21 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:21.929847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-92a09de2-bd6a-4b95-8755-52fbbbec103e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:21.930447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-92a09de2-bd6a-4b95-8755-52fbbbec103e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:21.936870 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a09de2-bd6a-4b95-8755-52fbbbec103e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:21.937339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a09de2-bd6a-4b95-8755-52fbbbec103e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:21.937765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a09de2-bd6a-4b95-8755-52fbbbec103e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:21.938436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a09de2-bd6a-4b95-8755-52fbbbec103e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:21.938881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a09de2-bd6a-4b95-8755-52fbbbec103e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:21.939298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92a09de2-bd6a-4b95-8755-52fbbbec103e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:22.068270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-92a09de2-bd6a-4b95-8755-52fbbbec103e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:22.076656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-92a09de2-bd6a-4b95-8755-52fbbbec103e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150595 Aug 06 13:01:22.077209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1661/3332] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:21 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:22.856682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-074c8083-1f88-41a7-bc99-9d7958a4dede tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:22.857314 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-074c8083-1f88-41a7-bc99-9d7958a4dede tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:22.863861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-074c8083-1f88-41a7-bc99-9d7958a4dede tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:22.864866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-074c8083-1f88-41a7-bc99-9d7958a4dede tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:22.865299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-074c8083-1f88-41a7-bc99-9d7958a4dede tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:22.865986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-074c8083-1f88-41a7-bc99-9d7958a4dede tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:22.866434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-074c8083-1f88-41a7-bc99-9d7958a4dede tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:22.866853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-074c8083-1f88-41a7-bc99-9d7958a4dede tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:22.996107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-074c8083-1f88-41a7-bc99-9d7958a4dede tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:23.004183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-074c8083-1f88-41a7-bc99-9d7958a4dede tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151587 Aug 06 13:01:23.004781 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1672/3333] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:22 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:23.097736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-74873f92-07d7-43a1-9e16-15f7c379752e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:23.098472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-74873f92-07d7-43a1-9e16-15f7c379752e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:23.105369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74873f92-07d7-43a1-9e16-15f7c379752e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:23.106112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74873f92-07d7-43a1-9e16-15f7c379752e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:23.106546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74873f92-07d7-43a1-9e16-15f7c379752e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:23.107282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74873f92-07d7-43a1-9e16-15f7c379752e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:23.107709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74873f92-07d7-43a1-9e16-15f7c379752e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:23.108115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74873f92-07d7-43a1-9e16-15f7c379752e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:23.237027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-74873f92-07d7-43a1-9e16-15f7c379752e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:23.239176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:01:23.246580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-74873f92-07d7-43a1-9e16-15f7c379752e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152640 Aug 06 13:01:23.247138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1662/3334] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:24.025885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aa5024bd-7a6c-42c0-83c6-5515672ff566 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:24.026484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aa5024bd-7a6c-42c0-83c6-5515672ff566 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:24.032800 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa5024bd-7a6c-42c0-83c6-5515672ff566 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:24.033277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa5024bd-7a6c-42c0-83c6-5515672ff566 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:24.033703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa5024bd-7a6c-42c0-83c6-5515672ff566 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:24.034379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa5024bd-7a6c-42c0-83c6-5515672ff566 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:24.034826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa5024bd-7a6c-42c0-83c6-5515672ff566 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:24.035243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa5024bd-7a6c-42c0-83c6-5515672ff566 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:24.164775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aa5024bd-7a6c-42c0-83c6-5515672ff566 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:24.172642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aa5024bd-7a6c-42c0-83c6-5515672ff566 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150580 Aug 06 13:01:24.173199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1673/3335] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:24 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:24.267067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a34a4cfd-e329-4bab-a79d-fbe3180ead7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:24.267601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a34a4cfd-e329-4bab-a79d-fbe3180ead7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:24.274410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a34a4cfd-e329-4bab-a79d-fbe3180ead7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:24.274886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a34a4cfd-e329-4bab-a79d-fbe3180ead7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:24.275325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a34a4cfd-e329-4bab-a79d-fbe3180ead7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:24.276002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a34a4cfd-e329-4bab-a79d-fbe3180ead7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:24.276483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a34a4cfd-e329-4bab-a79d-fbe3180ead7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:24.276908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a34a4cfd-e329-4bab-a79d-fbe3180ead7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:24.405322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a34a4cfd-e329-4bab-a79d-fbe3180ead7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:24.414246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a34a4cfd-e329-4bab-a79d-fbe3180ead7c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151211 Aug 06 13:01:24.415001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1663/3336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:25.194839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d82b68d-0e92-40db-a69d-ce403140e620 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:25.195471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9d82b68d-0e92-40db-a69d-ce403140e620 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:25.201897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d82b68d-0e92-40db-a69d-ce403140e620 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:25.202380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d82b68d-0e92-40db-a69d-ce403140e620 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:25.202818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d82b68d-0e92-40db-a69d-ce403140e620 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:25.203504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d82b68d-0e92-40db-a69d-ce403140e620 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:25.203959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d82b68d-0e92-40db-a69d-ce403140e620 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:25.204415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d82b68d-0e92-40db-a69d-ce403140e620 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:25.329687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9d82b68d-0e92-40db-a69d-ce403140e620 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:25.337755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d82b68d-0e92-40db-a69d-ce403140e620 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147372 Aug 06 13:01:25.338319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1674/3337] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:25 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:25.514469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-18aaee54-02bc-4377-a515-7025f860de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:25.515107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-18aaee54-02bc-4377-a515-7025f860de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:25.520985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18aaee54-02bc-4377-a515-7025f860de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:25.521456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18aaee54-02bc-4377-a515-7025f860de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:25.521889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18aaee54-02bc-4377-a515-7025f860de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:25.522558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18aaee54-02bc-4377-a515-7025f860de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:25.523000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18aaee54-02bc-4377-a515-7025f860de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:25.523422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18aaee54-02bc-4377-a515-7025f860de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:25.651758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-18aaee54-02bc-4377-a515-7025f860de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:25.659737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-18aaee54-02bc-4377-a515-7025f860de37 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.228714 Aug 06 13:01:25.660325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1664/3338] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:26.360281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7f751226-43e7-432e-9f8e-cc98a9525a64 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:26.360908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7f751226-43e7-432e-9f8e-cc98a9525a64 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:26.367238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f751226-43e7-432e-9f8e-cc98a9525a64 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:26.367715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f751226-43e7-432e-9f8e-cc98a9525a64 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:26.368144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f751226-43e7-432e-9f8e-cc98a9525a64 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:26.368853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f751226-43e7-432e-9f8e-cc98a9525a64 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:26.369305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f751226-43e7-432e-9f8e-cc98a9525a64 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:26.369724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7f751226-43e7-432e-9f8e-cc98a9525a64 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:26.498262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7f751226-43e7-432e-9f8e-cc98a9525a64 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:26.506756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7f751226-43e7-432e-9f8e-cc98a9525a64 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150303 Aug 06 13:01:26.507311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1675/3339] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:26 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:26.680959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d2af76d7-3c4d-4202-96a0-33cb72729263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:26.681503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d2af76d7-3c4d-4202-96a0-33cb72729263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:26.687867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2af76d7-3c4d-4202-96a0-33cb72729263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:26.688374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2af76d7-3c4d-4202-96a0-33cb72729263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:26.688812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2af76d7-3c4d-4202-96a0-33cb72729263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:26.689496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2af76d7-3c4d-4202-96a0-33cb72729263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:26.689955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2af76d7-3c4d-4202-96a0-33cb72729263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:26.690381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2af76d7-3c4d-4202-96a0-33cb72729263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:26.818805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d2af76d7-3c4d-4202-96a0-33cb72729263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:26.826754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d2af76d7-3c4d-4202-96a0-33cb72729263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150080 Aug 06 13:01:26.827321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1665/3340] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:27.527546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6b46ae3f-6bfd-4d0f-b601-c1b7d3f3d6a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:27.528149 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6b46ae3f-6bfd-4d0f-b601-c1b7d3f3d6a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:27.534274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b46ae3f-6bfd-4d0f-b601-c1b7d3f3d6a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:27.534746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b46ae3f-6bfd-4d0f-b601-c1b7d3f3d6a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:27.535172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b46ae3f-6bfd-4d0f-b601-c1b7d3f3d6a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:27.535847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b46ae3f-6bfd-4d0f-b601-c1b7d3f3d6a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:27.536290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b46ae3f-6bfd-4d0f-b601-c1b7d3f3d6a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:27.536729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6b46ae3f-6bfd-4d0f-b601-c1b7d3f3d6a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:27.661783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6b46ae3f-6bfd-4d0f-b601-c1b7d3f3d6a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:27.669720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6b46ae3f-6bfd-4d0f-b601-c1b7d3f3d6a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146013 Aug 06 13:01:27.670287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1676/3341] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:27 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:27.846789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9095ad39-9b1f-45f4-82d1-617bb6ce37f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:27.847397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9095ad39-9b1f-45f4-82d1-617bb6ce37f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:27.854291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9095ad39-9b1f-45f4-82d1-617bb6ce37f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:27.854770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9095ad39-9b1f-45f4-82d1-617bb6ce37f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:27.855204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9095ad39-9b1f-45f4-82d1-617bb6ce37f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:27.856146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9095ad39-9b1f-45f4-82d1-617bb6ce37f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:27.856620 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9095ad39-9b1f-45f4-82d1-617bb6ce37f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:27.857045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9095ad39-9b1f-45f4-82d1-617bb6ce37f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:27.982206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9095ad39-9b1f-45f4-82d1-617bb6ce37f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:27.989995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9095ad39-9b1f-45f4-82d1-617bb6ce37f6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147010 Aug 06 13:01:27.990560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1666/3342] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:28.691533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f282ebcd-4b72-4bbb-be3e-09d54cb0265f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:28.692655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f282ebcd-4b72-4bbb-be3e-09d54cb0265f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:28.698972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f282ebcd-4b72-4bbb-be3e-09d54cb0265f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:28.699450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f282ebcd-4b72-4bbb-be3e-09d54cb0265f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:28.699880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f282ebcd-4b72-4bbb-be3e-09d54cb0265f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:28.700584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f282ebcd-4b72-4bbb-be3e-09d54cb0265f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:28.701035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f282ebcd-4b72-4bbb-be3e-09d54cb0265f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:28.701455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f282ebcd-4b72-4bbb-be3e-09d54cb0265f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:28.832572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f282ebcd-4b72-4bbb-be3e-09d54cb0265f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:28.840765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f282ebcd-4b72-4bbb-be3e-09d54cb0265f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153015 Aug 06 13:01:28.841381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1677/3343] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:28 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:29.010555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f741aa1f-01e5-40cb-9fee-e1c8d9f6f547 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:29.011163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f741aa1f-01e5-40cb-9fee-e1c8d9f6f547 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:29.017609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f741aa1f-01e5-40cb-9fee-e1c8d9f6f547 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:29.018089 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f741aa1f-01e5-40cb-9fee-e1c8d9f6f547 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:29.018524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f741aa1f-01e5-40cb-9fee-e1c8d9f6f547 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:29.019203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f741aa1f-01e5-40cb-9fee-e1c8d9f6f547 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:29.019652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f741aa1f-01e5-40cb-9fee-e1c8d9f6f547 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:29.020070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f741aa1f-01e5-40cb-9fee-e1c8d9f6f547 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:29.151653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f741aa1f-01e5-40cb-9fee-e1c8d9f6f547 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:29.159513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f741aa1f-01e5-40cb-9fee-e1c8d9f6f547 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152784 Aug 06 13:01:29.160073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1667/3344] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:29.862570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bcc96535-aac5-4d1c-a5a4-02f7220a8d5b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:29.863171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bcc96535-aac5-4d1c-a5a4-02f7220a8d5b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:29.869612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcc96535-aac5-4d1c-a5a4-02f7220a8d5b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:29.870080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcc96535-aac5-4d1c-a5a4-02f7220a8d5b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:29.870505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcc96535-aac5-4d1c-a5a4-02f7220a8d5b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:29.871176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcc96535-aac5-4d1c-a5a4-02f7220a8d5b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:29.871622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcc96535-aac5-4d1c-a5a4-02f7220a8d5b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:29.872035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bcc96535-aac5-4d1c-a5a4-02f7220a8d5b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:30.000205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bcc96535-aac5-4d1c-a5a4-02f7220a8d5b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:30.008712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bcc96535-aac5-4d1c-a5a4-02f7220a8d5b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150092 Aug 06 13:01:30.009273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1678/3345] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:29 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:30.180912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b7865f71-d729-4703-bd38-35f2bfce3113 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:30.181439 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b7865f71-d729-4703-bd38-35f2bfce3113 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:30.187819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7865f71-d729-4703-bd38-35f2bfce3113 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:30.188293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7865f71-d729-4703-bd38-35f2bfce3113 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:30.188767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7865f71-d729-4703-bd38-35f2bfce3113 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:30.189445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7865f71-d729-4703-bd38-35f2bfce3113 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:30.189896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7865f71-d729-4703-bd38-35f2bfce3113 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:30.190318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7865f71-d729-4703-bd38-35f2bfce3113 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:30.315517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b7865f71-d729-4703-bd38-35f2bfce3113 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:30.324028 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b7865f71-d729-4703-bd38-35f2bfce3113 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147012 Aug 06 13:01:30.324624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1668/3346] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:31.030719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-25956dee-7005-455c-83f4-667442db929b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:31.031315 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-25956dee-7005-455c-83f4-667442db929b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:31.038279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25956dee-7005-455c-83f4-667442db929b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:31.038750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25956dee-7005-455c-83f4-667442db929b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:31.039208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25956dee-7005-455c-83f4-667442db929b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:31.039851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25956dee-7005-455c-83f4-667442db929b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:31.040293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25956dee-7005-455c-83f4-667442db929b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:31.040736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25956dee-7005-455c-83f4-667442db929b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:31.165439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-25956dee-7005-455c-83f4-667442db929b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:31.173360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-25956dee-7005-455c-83f4-667442db929b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146477 Aug 06 13:01:31.173914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1679/3347] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:31 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:31.344720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c99d5b82-8c76-4fe6-b180-4d7118ce6769 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:31.345335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c99d5b82-8c76-4fe6-b180-4d7118ce6769 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:31.351771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c99d5b82-8c76-4fe6-b180-4d7118ce6769 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:31.352255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c99d5b82-8c76-4fe6-b180-4d7118ce6769 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:31.352723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c99d5b82-8c76-4fe6-b180-4d7118ce6769 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:31.353409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c99d5b82-8c76-4fe6-b180-4d7118ce6769 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:31.353865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c99d5b82-8c76-4fe6-b180-4d7118ce6769 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:31.354299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c99d5b82-8c76-4fe6-b180-4d7118ce6769 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:31.481524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c99d5b82-8c76-4fe6-b180-4d7118ce6769 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:31.489459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c99d5b82-8c76-4fe6-b180-4d7118ce6769 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148573 Aug 06 13:01:31.490021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1669/3348] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:32.194575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2eeae693-8325-49bd-a6ef-02247ef9f4c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:32.195177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2eeae693-8325-49bd-a6ef-02247ef9f4c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:32.201694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eeae693-8325-49bd-a6ef-02247ef9f4c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:32.202175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eeae693-8325-49bd-a6ef-02247ef9f4c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:32.202602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eeae693-8325-49bd-a6ef-02247ef9f4c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:32.203275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eeae693-8325-49bd-a6ef-02247ef9f4c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:32.203724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eeae693-8325-49bd-a6ef-02247ef9f4c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:32.204142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2eeae693-8325-49bd-a6ef-02247ef9f4c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:32.337169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2eeae693-8325-49bd-a6ef-02247ef9f4c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:32.345029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2eeae693-8325-49bd-a6ef-02247ef9f4c9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154431 Aug 06 13:01:32.345588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1680/3349] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:32 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:32.510602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-82328c54-2b1f-46fc-8459-1b352d78c80f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:32.511208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-82328c54-2b1f-46fc-8459-1b352d78c80f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:32.517705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82328c54-2b1f-46fc-8459-1b352d78c80f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:32.518190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82328c54-2b1f-46fc-8459-1b352d78c80f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:32.518629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82328c54-2b1f-46fc-8459-1b352d78c80f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:32.519343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82328c54-2b1f-46fc-8459-1b352d78c80f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:32.519789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82328c54-2b1f-46fc-8459-1b352d78c80f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:32.521060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82328c54-2b1f-46fc-8459-1b352d78c80f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:32.648687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-82328c54-2b1f-46fc-8459-1b352d78c80f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:32.656516 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-82328c54-2b1f-46fc-8459-1b352d78c80f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149743 Aug 06 13:01:32.657067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1670/3350] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:33.366451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5628690c-d195-489c-baf2-e9f2d82e1273 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:33.367051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5628690c-d195-489c-baf2-e9f2d82e1273 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:33.373388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5628690c-d195-489c-baf2-e9f2d82e1273 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:33.373868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5628690c-d195-489c-baf2-e9f2d82e1273 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:33.374306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5628690c-d195-489c-baf2-e9f2d82e1273 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:33.374984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5628690c-d195-489c-baf2-e9f2d82e1273 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:33.375430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5628690c-d195-489c-baf2-e9f2d82e1273 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:33.375845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5628690c-d195-489c-baf2-e9f2d82e1273 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:33.509137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5628690c-d195-489c-baf2-e9f2d82e1273 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:33.517049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5628690c-d195-489c-baf2-e9f2d82e1273 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154927 Aug 06 13:01:33.517616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1681/3351] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:33 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:33.678458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2f579e97-9023-4d2d-9cf5-2751a76dcd98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:33.679052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2f579e97-9023-4d2d-9cf5-2751a76dcd98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:33.685621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f579e97-9023-4d2d-9cf5-2751a76dcd98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:33.685752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f579e97-9023-4d2d-9cf5-2751a76dcd98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:33.686152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f579e97-9023-4d2d-9cf5-2751a76dcd98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:33.686840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f579e97-9023-4d2d-9cf5-2751a76dcd98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:33.687296 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f579e97-9023-4d2d-9cf5-2751a76dcd98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:33.687753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f579e97-9023-4d2d-9cf5-2751a76dcd98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:33.821638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2f579e97-9023-4d2d-9cf5-2751a76dcd98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:33.829762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2f579e97-9023-4d2d-9cf5-2751a76dcd98 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.155961 Aug 06 13:01:33.830328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1671/3352] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:34.538095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1894917a-0366-46e7-9c6a-439cdd8f9b79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:34.538714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1894917a-0366-46e7-9c6a-439cdd8f9b79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:34.545022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1894917a-0366-46e7-9c6a-439cdd8f9b79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:34.545497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1894917a-0366-46e7-9c6a-439cdd8f9b79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:34.545923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1894917a-0366-46e7-9c6a-439cdd8f9b79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:34.546605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1894917a-0366-46e7-9c6a-439cdd8f9b79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:34.547052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1894917a-0366-46e7-9c6a-439cdd8f9b79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:34.547469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1894917a-0366-46e7-9c6a-439cdd8f9b79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:34.675268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1894917a-0366-46e7-9c6a-439cdd8f9b79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:34.683860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1894917a-0366-46e7-9c6a-439cdd8f9b79 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150103 Aug 06 13:01:34.684446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1682/3353] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:34 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:34.851197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2e8e0f20-7e46-48a0-b5a1-3b283941535b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:34.851750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2e8e0f20-7e46-48a0-b5a1-3b283941535b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:34.858423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e8e0f20-7e46-48a0-b5a1-3b283941535b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:34.858901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e8e0f20-7e46-48a0-b5a1-3b283941535b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:34.859336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e8e0f20-7e46-48a0-b5a1-3b283941535b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:34.860206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e8e0f20-7e46-48a0-b5a1-3b283941535b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:34.860690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e8e0f20-7e46-48a0-b5a1-3b283941535b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:34.861116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e8e0f20-7e46-48a0-b5a1-3b283941535b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:34.991370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2e8e0f20-7e46-48a0-b5a1-3b283941535b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:35.000502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2e8e0f20-7e46-48a0-b5a1-3b283941535b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153495 Aug 06 13:01:35.000848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1672/3354] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:35.705739 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-76087894-9402-484b-b269-a3f1106b1d8e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:35.706277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-76087894-9402-484b-b269-a3f1106b1d8e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:35.712668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76087894-9402-484b-b269-a3f1106b1d8e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:35.714064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76087894-9402-484b-b269-a3f1106b1d8e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:35.714064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76087894-9402-484b-b269-a3f1106b1d8e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:35.714325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76087894-9402-484b-b269-a3f1106b1d8e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:35.714730 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76087894-9402-484b-b269-a3f1106b1d8e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:35.715145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76087894-9402-484b-b269-a3f1106b1d8e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:35.842898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-76087894-9402-484b-b269-a3f1106b1d8e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:35.851226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-76087894-9402-484b-b269-a3f1106b1d8e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149335 Aug 06 13:01:35.851788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1683/3355] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:35 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:36.021286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4e705791-f659-482a-b548-c571aee1baf0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:36.021898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4e705791-f659-482a-b548-c571aee1baf0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:36.028268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e705791-f659-482a-b548-c571aee1baf0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:36.028775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e705791-f659-482a-b548-c571aee1baf0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:36.029211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e705791-f659-482a-b548-c571aee1baf0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:36.029892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e705791-f659-482a-b548-c571aee1baf0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:36.030344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e705791-f659-482a-b548-c571aee1baf0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:36.030767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e705791-f659-482a-b548-c571aee1baf0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:36.156149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4e705791-f659-482a-b548-c571aee1baf0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:36.164518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4e705791-f659-482a-b548-c571aee1baf0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147154 Aug 06 13:01:36.165082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1673/3356] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:36.873443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-255ecd22-3c24-4c29-a6ac-a7b8df49dee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:36.874025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-255ecd22-3c24-4c29-a6ac-a7b8df49dee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:36.880444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255ecd22-3c24-4c29-a6ac-a7b8df49dee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:36.880930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255ecd22-3c24-4c29-a6ac-a7b8df49dee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:36.881358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255ecd22-3c24-4c29-a6ac-a7b8df49dee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:36.882034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255ecd22-3c24-4c29-a6ac-a7b8df49dee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:36.882484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255ecd22-3c24-4c29-a6ac-a7b8df49dee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:36.882903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-255ecd22-3c24-4c29-a6ac-a7b8df49dee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:37.015192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-255ecd22-3c24-4c29-a6ac-a7b8df49dee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:37.024915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-255ecd22-3c24-4c29-a6ac-a7b8df49dee0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155210 Aug 06 13:01:37.025786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1684/3357] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:36 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:37.185936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f12e9657-0f9f-4783-afec-deab498ffdb6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:37.186558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f12e9657-0f9f-4783-afec-deab498ffdb6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:37.192872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12e9657-0f9f-4783-afec-deab498ffdb6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:37.193337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12e9657-0f9f-4783-afec-deab498ffdb6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:37.193771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12e9657-0f9f-4783-afec-deab498ffdb6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:37.194454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12e9657-0f9f-4783-afec-deab498ffdb6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:37.194907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12e9657-0f9f-4783-afec-deab498ffdb6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:37.195325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f12e9657-0f9f-4783-afec-deab498ffdb6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:37.418639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f12e9657-0f9f-4783-afec-deab498ffdb6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:37.426504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f12e9657-0f9f-4783-afec-deab498ffdb6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.244549 Aug 06 13:01:37.427051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1674/3358] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:37 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:38.046751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-34e58e98-8dbe-42d0-898c-3a5cec1ee277 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:38.047379 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-34e58e98-8dbe-42d0-898c-3a5cec1ee277 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:38.054335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34e58e98-8dbe-42d0-898c-3a5cec1ee277 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:38.054811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34e58e98-8dbe-42d0-898c-3a5cec1ee277 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:38.055241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34e58e98-8dbe-42d0-898c-3a5cec1ee277 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:38.055924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34e58e98-8dbe-42d0-898c-3a5cec1ee277 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:38.056410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34e58e98-8dbe-42d0-898c-3a5cec1ee277 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:38.056834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34e58e98-8dbe-42d0-898c-3a5cec1ee277 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:38.186575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34e58e98-8dbe-42d0-898c-3a5cec1ee277 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:38.194351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-34e58e98-8dbe-42d0-898c-3a5cec1ee277 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151406 Aug 06 13:01:38.194907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1685/3359] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:38 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:38.446964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cd21567c-939b-499b-a4e8-224ec0b17977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:38.447573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cd21567c-939b-499b-a4e8-224ec0b17977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:38.453842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd21567c-939b-499b-a4e8-224ec0b17977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:38.454312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd21567c-939b-499b-a4e8-224ec0b17977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:38.454741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd21567c-939b-499b-a4e8-224ec0b17977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:38.455411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd21567c-939b-499b-a4e8-224ec0b17977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:38.455856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd21567c-939b-499b-a4e8-224ec0b17977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:38.456268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cd21567c-939b-499b-a4e8-224ec0b17977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:38.581252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cd21567c-939b-499b-a4e8-224ec0b17977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:38.589497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cd21567c-939b-499b-a4e8-224ec0b17977 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146369 Aug 06 13:01:38.590049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1675/3360] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:39.215088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fd7a28e6-4b71-4dba-99cd-f54e3387aab8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:39.215689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fd7a28e6-4b71-4dba-99cd-f54e3387aab8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:39.222017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd7a28e6-4b71-4dba-99cd-f54e3387aab8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:39.222492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd7a28e6-4b71-4dba-99cd-f54e3387aab8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:39.222987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd7a28e6-4b71-4dba-99cd-f54e3387aab8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:39.223665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd7a28e6-4b71-4dba-99cd-f54e3387aab8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:39.224115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd7a28e6-4b71-4dba-99cd-f54e3387aab8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:39.224569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fd7a28e6-4b71-4dba-99cd-f54e3387aab8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:39.350316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fd7a28e6-4b71-4dba-99cd-f54e3387aab8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:39.358417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fd7a28e6-4b71-4dba-99cd-f54e3387aab8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147237 Aug 06 13:01:39.358974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1686/3361] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:39 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:39.610876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7fd070fb-36cf-40a7-bad4-3bcf68f53069 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:39.611432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7fd070fb-36cf-40a7-bad4-3bcf68f53069 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:39.614413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=52 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:01:39.619463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fd070fb-36cf-40a7-bad4-3bcf68f53069 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:39.619939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fd070fb-36cf-40a7-bad4-3bcf68f53069 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:39.620394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fd070fb-36cf-40a7-bad4-3bcf68f53069 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:39.621073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fd070fb-36cf-40a7-bad4-3bcf68f53069 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:39.621523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fd070fb-36cf-40a7-bad4-3bcf68f53069 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:39.621941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7fd070fb-36cf-40a7-bad4-3bcf68f53069 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:39.749292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7fd070fb-36cf-40a7-bad4-3bcf68f53069 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:39.757022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7fd070fb-36cf-40a7-bad4-3bcf68f53069 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150022 Aug 06 13:01:39.757579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1676/3362] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:40.380944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aab5e3ee-66b7-4521-a214-13cc47ba02b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:40.381548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aab5e3ee-66b7-4521-a214-13cc47ba02b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:40.387946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aab5e3ee-66b7-4521-a214-13cc47ba02b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:40.388459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aab5e3ee-66b7-4521-a214-13cc47ba02b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:40.388896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aab5e3ee-66b7-4521-a214-13cc47ba02b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:40.389585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aab5e3ee-66b7-4521-a214-13cc47ba02b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:40.390034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aab5e3ee-66b7-4521-a214-13cc47ba02b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:40.390457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aab5e3ee-66b7-4521-a214-13cc47ba02b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:40.520861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aab5e3ee-66b7-4521-a214-13cc47ba02b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:40.528656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aab5e3ee-66b7-4521-a214-13cc47ba02b2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152125 Aug 06 13:01:40.529208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1687/3363] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:40 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:40.779508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff14ad5f-417e-4847-9fbc-7554a561dec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:40.780061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ff14ad5f-417e-4847-9fbc-7554a561dec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:40.787738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff14ad5f-417e-4847-9fbc-7554a561dec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:40.788224 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff14ad5f-417e-4847-9fbc-7554a561dec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:40.788700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff14ad5f-417e-4847-9fbc-7554a561dec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:40.789404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff14ad5f-417e-4847-9fbc-7554a561dec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:40.789854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff14ad5f-417e-4847-9fbc-7554a561dec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:40.790279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff14ad5f-417e-4847-9fbc-7554a561dec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:40.917750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ff14ad5f-417e-4847-9fbc-7554a561dec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:40.925663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff14ad5f-417e-4847-9fbc-7554a561dec1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151733 Aug 06 13:01:40.926746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1677/3364] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:41.550114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6e1e4a98-442d-441e-ab1d-c8a706924f52 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:41.550714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6e1e4a98-442d-441e-ab1d-c8a706924f52 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:41.557064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1e4a98-442d-441e-ab1d-c8a706924f52 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:41.557536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1e4a98-442d-441e-ab1d-c8a706924f52 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:41.557961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1e4a98-442d-441e-ab1d-c8a706924f52 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:41.558632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1e4a98-442d-441e-ab1d-c8a706924f52 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:41.559077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1e4a98-442d-441e-ab1d-c8a706924f52 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:41.559491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e1e4a98-442d-441e-ab1d-c8a706924f52 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:41.573879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:01:41.686056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6e1e4a98-442d-441e-ab1d-c8a706924f52 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:41.693862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6e1e4a98-442d-441e-ab1d-c8a706924f52 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147586 Aug 06 13:01:41.694421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1688/3365] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:41 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:41.947491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5f053b9c-fce5-4ad2-8940-35cfc3a17bf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:41.948023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5f053b9c-fce5-4ad2-8940-35cfc3a17bf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:41.954388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f053b9c-fce5-4ad2-8940-35cfc3a17bf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:41.954866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f053b9c-fce5-4ad2-8940-35cfc3a17bf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:41.955299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f053b9c-fce5-4ad2-8940-35cfc3a17bf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:41.955978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f053b9c-fce5-4ad2-8940-35cfc3a17bf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:41.956460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f053b9c-fce5-4ad2-8940-35cfc3a17bf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:41.956884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f053b9c-fce5-4ad2-8940-35cfc3a17bf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:42.083544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f053b9c-fce5-4ad2-8940-35cfc3a17bf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:42.091389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5f053b9c-fce5-4ad2-8940-35cfc3a17bf7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147902 Aug 06 13:01:42.091948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1678/3366] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:41 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:42.714935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b042ccf9-208c-4f12-b941-464a684585a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:42.715606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b042ccf9-208c-4f12-b941-464a684585a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:42.721871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b042ccf9-208c-4f12-b941-464a684585a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:42.722339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b042ccf9-208c-4f12-b941-464a684585a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:42.723256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b042ccf9-208c-4f12-b941-464a684585a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:42.723916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b042ccf9-208c-4f12-b941-464a684585a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:42.724381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b042ccf9-208c-4f12-b941-464a684585a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:42.724798 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b042ccf9-208c-4f12-b941-464a684585a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:42.854544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b042ccf9-208c-4f12-b941-464a684585a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:42.862698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b042ccf9-208c-4f12-b941-464a684585a2 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151585 Aug 06 13:01:42.863262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1689/3367] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:42 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:43.112183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38604c8b-ec61-4e7b-b440-8425f5dbbb82 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:43.112815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38604c8b-ec61-4e7b-b440-8425f5dbbb82 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:43.120178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38604c8b-ec61-4e7b-b440-8425f5dbbb82 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:43.120679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38604c8b-ec61-4e7b-b440-8425f5dbbb82 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:43.121110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38604c8b-ec61-4e7b-b440-8425f5dbbb82 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:43.121788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38604c8b-ec61-4e7b-b440-8425f5dbbb82 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:43.122239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38604c8b-ec61-4e7b-b440-8425f5dbbb82 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:43.122661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38604c8b-ec61-4e7b-b440-8425f5dbbb82 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:43.136911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:01:43.251552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-38604c8b-ec61-4e7b-b440-8425f5dbbb82 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:43.259363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38604c8b-ec61-4e7b-b440-8425f5dbbb82 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150995 Aug 06 13:01:43.259935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1679/3368] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:43.884762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-21b6ce79-26c0-455b-8607-da665bfc8132 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:43.885289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-21b6ce79-26c0-455b-8607-da665bfc8132 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:43.887541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=52 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:01:43.892954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6ce79-26c0-455b-8607-da665bfc8132 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:43.893434 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6ce79-26c0-455b-8607-da665bfc8132 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:43.893864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6ce79-26c0-455b-8607-da665bfc8132 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:43.894546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6ce79-26c0-455b-8607-da665bfc8132 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:43.894994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6ce79-26c0-455b-8607-da665bfc8132 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:43.895413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-21b6ce79-26c0-455b-8607-da665bfc8132 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:44.021365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-21b6ce79-26c0-455b-8607-da665bfc8132 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:44.029131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-21b6ce79-26c0-455b-8607-da665bfc8132 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148273 Aug 06 13:01:44.029691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1690/3369] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:43 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:44.280765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4b8671d1-def9-438f-89ba-df8bc9ebc428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:44.281288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4b8671d1-def9-438f-89ba-df8bc9ebc428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:44.288073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b8671d1-def9-438f-89ba-df8bc9ebc428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:44.288575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b8671d1-def9-438f-89ba-df8bc9ebc428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:44.289008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b8671d1-def9-438f-89ba-df8bc9ebc428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:44.289691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b8671d1-def9-438f-89ba-df8bc9ebc428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:44.290138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b8671d1-def9-438f-89ba-df8bc9ebc428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:44.290557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b8671d1-def9-438f-89ba-df8bc9ebc428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:44.418239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4b8671d1-def9-438f-89ba-df8bc9ebc428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:44.426682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4b8671d1-def9-438f-89ba-df8bc9ebc428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149199 Aug 06 13:01:44.427249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1680/3370] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:45.049478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2a04f926-2a51-4185-8c60-67b1b35aeb51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:45.050078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2a04f926-2a51-4185-8c60-67b1b35aeb51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:45.056519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a04f926-2a51-4185-8c60-67b1b35aeb51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:45.056989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a04f926-2a51-4185-8c60-67b1b35aeb51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:45.057414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a04f926-2a51-4185-8c60-67b1b35aeb51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:45.058082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a04f926-2a51-4185-8c60-67b1b35aeb51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:45.058553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a04f926-2a51-4185-8c60-67b1b35aeb51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:45.058967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a04f926-2a51-4185-8c60-67b1b35aeb51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:45.186213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2a04f926-2a51-4185-8c60-67b1b35aeb51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:45.194474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2a04f926-2a51-4185-8c60-67b1b35aeb51 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148806 Aug 06 13:01:45.195038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1691/3371] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:45 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:45.447880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cce0d876-27f0-4af8-b9fd-8625ac750c13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:45.448519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cce0d876-27f0-4af8-b9fd-8625ac750c13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:45.454839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cce0d876-27f0-4af8-b9fd-8625ac750c13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:45.455308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cce0d876-27f0-4af8-b9fd-8625ac750c13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:45.455734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cce0d876-27f0-4af8-b9fd-8625ac750c13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:45.456441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cce0d876-27f0-4af8-b9fd-8625ac750c13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:45.456902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cce0d876-27f0-4af8-b9fd-8625ac750c13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:45.457303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cce0d876-27f0-4af8-b9fd-8625ac750c13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:45.588495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cce0d876-27f0-4af8-b9fd-8625ac750c13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:45.596271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cce0d876-27f0-4af8-b9fd-8625ac750c13 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152304 Aug 06 13:01:45.596854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1681/3372] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:46.216263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d3cf6568-a628-4eab-a1d7-9e50f7991d56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:46.216880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d3cf6568-a628-4eab-a1d7-9e50f7991d56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:46.222991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cf6568-a628-4eab-a1d7-9e50f7991d56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:46.223463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cf6568-a628-4eab-a1d7-9e50f7991d56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:46.224606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cf6568-a628-4eab-a1d7-9e50f7991d56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:46.225278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cf6568-a628-4eab-a1d7-9e50f7991d56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:46.225726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cf6568-a628-4eab-a1d7-9e50f7991d56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:46.226141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3cf6568-a628-4eab-a1d7-9e50f7991d56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:46.357039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d3cf6568-a628-4eab-a1d7-9e50f7991d56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:46.364878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d3cf6568-a628-4eab-a1d7-9e50f7991d56 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152627 Aug 06 13:01:46.365439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1692/3373] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:46 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:46.617002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6887298e-a7f9-4cc3-84a1-19ca2a217d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:46.617553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6887298e-a7f9-4cc3-84a1-19ca2a217d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:46.623874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6887298e-a7f9-4cc3-84a1-19ca2a217d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:46.624385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6887298e-a7f9-4cc3-84a1-19ca2a217d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:46.624831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6887298e-a7f9-4cc3-84a1-19ca2a217d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:46.625513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6887298e-a7f9-4cc3-84a1-19ca2a217d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:46.625968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6887298e-a7f9-4cc3-84a1-19ca2a217d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:46.626393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6887298e-a7f9-4cc3-84a1-19ca2a217d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:46.750942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6887298e-a7f9-4cc3-84a1-19ca2a217d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:46.759351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6887298e-a7f9-4cc3-84a1-19ca2a217d83 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146266 Aug 06 13:01:46.759948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1682/3374] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:47.385971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0d44d508-142e-461d-afc7-441bd5d01a4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:47.386571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0d44d508-142e-461d-afc7-441bd5d01a4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:47.393005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d44d508-142e-461d-afc7-441bd5d01a4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:47.393482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d44d508-142e-461d-afc7-441bd5d01a4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:47.393916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d44d508-142e-461d-afc7-441bd5d01a4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:47.394592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d44d508-142e-461d-afc7-441bd5d01a4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:47.395043 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d44d508-142e-461d-afc7-441bd5d01a4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:47.395485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0d44d508-142e-461d-afc7-441bd5d01a4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:47.519810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0d44d508-142e-461d-afc7-441bd5d01a4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:47.528117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0d44d508-142e-461d-afc7-441bd5d01a4f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146051 Aug 06 13:01:47.528715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1693/3375] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:47 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:47.780425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9d315f4d-3bec-465d-835e-67b143bf57ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:47.780965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9d315f4d-3bec-465d-835e-67b143bf57ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:47.787514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d315f4d-3bec-465d-835e-67b143bf57ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:47.787995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d315f4d-3bec-465d-835e-67b143bf57ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:47.788520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d315f4d-3bec-465d-835e-67b143bf57ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:47.789213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d315f4d-3bec-465d-835e-67b143bf57ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:47.790207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d315f4d-3bec-465d-835e-67b143bf57ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:47.790631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d315f4d-3bec-465d-835e-67b143bf57ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:47.916525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9d315f4d-3bec-465d-835e-67b143bf57ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:47.924904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9d315f4d-3bec-465d-835e-67b143bf57ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148365 Aug 06 13:01:47.925682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1683/3376] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:48.549880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1752915e-561b-40dd-bd6a-b82b78dd0f15 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:48.550498 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1752915e-561b-40dd-bd6a-b82b78dd0f15 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:48.557562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1752915e-561b-40dd-bd6a-b82b78dd0f15 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:48.558038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1752915e-561b-40dd-bd6a-b82b78dd0f15 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:48.558472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1752915e-561b-40dd-bd6a-b82b78dd0f15 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:48.559150 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1752915e-561b-40dd-bd6a-b82b78dd0f15 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:48.559599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1752915e-561b-40dd-bd6a-b82b78dd0f15 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:48.560018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1752915e-561b-40dd-bd6a-b82b78dd0f15 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:48.704497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1752915e-561b-40dd-bd6a-b82b78dd0f15 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:48.712308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1752915e-561b-40dd-bd6a-b82b78dd0f15 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.166275 Aug 06 13:01:48.712868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1694/3377] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:48 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:48.952782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c7d89099-09d1-42db-a815-a2b1ad7b32b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:48.953339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c7d89099-09d1-42db-a815-a2b1ad7b32b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:48.960183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d89099-09d1-42db-a815-a2b1ad7b32b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:48.960688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d89099-09d1-42db-a815-a2b1ad7b32b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:48.961114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d89099-09d1-42db-a815-a2b1ad7b32b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:48.961787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d89099-09d1-42db-a815-a2b1ad7b32b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:48.962253 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d89099-09d1-42db-a815-a2b1ad7b32b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:48.962668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d89099-09d1-42db-a815-a2b1ad7b32b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:49.090986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7d89099-09d1-42db-a815-a2b1ad7b32b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:49.099547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c7d89099-09d1-42db-a815-a2b1ad7b32b6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149997 Aug 06 13:01:49.100117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1684/3378] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:49.734886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a670260-6d8a-4b8a-b8e2-0d3daca2e9b9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:49.735482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a670260-6d8a-4b8a-b8e2-0d3daca2e9b9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:49.742331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a670260-6d8a-4b8a-b8e2-0d3daca2e9b9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:49.742804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a670260-6d8a-4b8a-b8e2-0d3daca2e9b9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:49.743224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a670260-6d8a-4b8a-b8e2-0d3daca2e9b9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:49.743892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a670260-6d8a-4b8a-b8e2-0d3daca2e9b9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:49.744358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a670260-6d8a-4b8a-b8e2-0d3daca2e9b9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:49.744775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a670260-6d8a-4b8a-b8e2-0d3daca2e9b9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:49.872331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a670260-6d8a-4b8a-b8e2-0d3daca2e9b9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:49.880806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a670260-6d8a-4b8a-b8e2-0d3daca2e9b9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149135 Aug 06 13:01:49.881357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1695/3379] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:49 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:50.121194 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9dd600eb-bec1-408c-974c-22c55a77823f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:50.121767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9dd600eb-bec1-408c-974c-22c55a77823f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:50.128164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dd600eb-bec1-408c-974c-22c55a77823f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:50.128678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dd600eb-bec1-408c-974c-22c55a77823f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:50.129119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dd600eb-bec1-408c-974c-22c55a77823f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:50.129809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dd600eb-bec1-408c-974c-22c55a77823f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:50.130263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dd600eb-bec1-408c-974c-22c55a77823f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:50.130690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9dd600eb-bec1-408c-974c-22c55a77823f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:50.258565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9dd600eb-bec1-408c-974c-22c55a77823f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:50.266600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9dd600eb-bec1-408c-974c-22c55a77823f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149352 Aug 06 13:01:50.267163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1685/3380] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:50.902006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b13cadc9-f831-447f-b906-5d0f6cc33fa7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:50.902610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b13cadc9-f831-447f-b906-5d0f6cc33fa7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:50.909116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13cadc9-f831-447f-b906-5d0f6cc33fa7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:50.909585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13cadc9-f831-447f-b906-5d0f6cc33fa7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:50.910016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13cadc9-f831-447f-b906-5d0f6cc33fa7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:50.910692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13cadc9-f831-447f-b906-5d0f6cc33fa7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:50.911168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13cadc9-f831-447f-b906-5d0f6cc33fa7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:50.911587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b13cadc9-f831-447f-b906-5d0f6cc33fa7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:51.036747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b13cadc9-f831-447f-b906-5d0f6cc33fa7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:51.044657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b13cadc9-f831-447f-b906-5d0f6cc33fa7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146525 Aug 06 13:01:51.045215 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1696/3381] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:50 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:51.287108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f05852ea-e899-40cb-9320-10fcc54e52eb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:51.287712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f05852ea-e899-40cb-9320-10fcc54e52eb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:51.295364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f05852ea-e899-40cb-9320-10fcc54e52eb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:51.295836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f05852ea-e899-40cb-9320-10fcc54e52eb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:51.296260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f05852ea-e899-40cb-9320-10fcc54e52eb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:51.296960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f05852ea-e899-40cb-9320-10fcc54e52eb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:51.297408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f05852ea-e899-40cb-9320-10fcc54e52eb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:51.297824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f05852ea-e899-40cb-9320-10fcc54e52eb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:51.427845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f05852ea-e899-40cb-9320-10fcc54e52eb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:51.436445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f05852ea-e899-40cb-9320-10fcc54e52eb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153115 Aug 06 13:01:51.437003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1686/3382] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:52.065609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-560902c4-de7e-49ba-8288-bd27d4bac36c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:52.066208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-560902c4-de7e-49ba-8288-bd27d4bac36c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:52.072543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560902c4-de7e-49ba-8288-bd27d4bac36c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:52.073019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560902c4-de7e-49ba-8288-bd27d4bac36c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:52.073445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560902c4-de7e-49ba-8288-bd27d4bac36c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:52.074114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560902c4-de7e-49ba-8288-bd27d4bac36c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:52.074557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560902c4-de7e-49ba-8288-bd27d4bac36c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:52.074980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560902c4-de7e-49ba-8288-bd27d4bac36c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:52.202832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-560902c4-de7e-49ba-8288-bd27d4bac36c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:52.211145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-560902c4-de7e-49ba-8288-bd27d4bac36c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149408 Aug 06 13:01:52.211696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1697/3383] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:52 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:52.457382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad1a47c7-00a5-49b8-a3ed-9c82d4858b9c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:52.457985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad1a47c7-00a5-49b8-a3ed-9c82d4858b9c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:52.464997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad1a47c7-00a5-49b8-a3ed-9c82d4858b9c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:52.465473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad1a47c7-00a5-49b8-a3ed-9c82d4858b9c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:52.465901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad1a47c7-00a5-49b8-a3ed-9c82d4858b9c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:52.466579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad1a47c7-00a5-49b8-a3ed-9c82d4858b9c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:52.467026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad1a47c7-00a5-49b8-a3ed-9c82d4858b9c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:52.467443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad1a47c7-00a5-49b8-a3ed-9c82d4858b9c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:52.597002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad1a47c7-00a5-49b8-a3ed-9c82d4858b9c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:52.604798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad1a47c7-00a5-49b8-a3ed-9c82d4858b9c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151228 Aug 06 13:01:52.605616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1687/3384] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:53.235246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3744c298-ac4d-43e9-b211-b86b68c05713 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:53.235865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3744c298-ac4d-43e9-b211-b86b68c05713 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:53.246961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3744c298-ac4d-43e9-b211-b86b68c05713 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:53.247439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3744c298-ac4d-43e9-b211-b86b68c05713 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:53.247875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3744c298-ac4d-43e9-b211-b86b68c05713 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:53.248584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3744c298-ac4d-43e9-b211-b86b68c05713 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:53.249035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3744c298-ac4d-43e9-b211-b86b68c05713 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:53.249455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3744c298-ac4d-43e9-b211-b86b68c05713 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:53.376987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3744c298-ac4d-43e9-b211-b86b68c05713 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:53.384889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3744c298-ac4d-43e9-b211-b86b68c05713 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153505 Aug 06 13:01:53.385457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1698/3385] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:53 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:53.625757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3a900c37-f403-4275-8058-8262c90cb428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:53.626311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3a900c37-f403-4275-8058-8262c90cb428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:53.632601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a900c37-f403-4275-8058-8262c90cb428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:53.633076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a900c37-f403-4275-8058-8262c90cb428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:53.633515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a900c37-f403-4275-8058-8262c90cb428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:53.634185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a900c37-f403-4275-8058-8262c90cb428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:53.634634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a900c37-f403-4275-8058-8262c90cb428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:53.635050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a900c37-f403-4275-8058-8262c90cb428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:53.762494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3a900c37-f403-4275-8058-8262c90cb428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:53.770355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3a900c37-f403-4275-8058-8262c90cb428 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148476 Aug 06 13:01:53.770912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1688/3386] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:54.406272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-125c4b4d-5968-42a4-b612-7deb9ff9a735 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:54.406874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-125c4b4d-5968-42a4-b612-7deb9ff9a735 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:54.413297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-125c4b4d-5968-42a4-b612-7deb9ff9a735 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:54.413777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-125c4b4d-5968-42a4-b612-7deb9ff9a735 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:54.414209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-125c4b4d-5968-42a4-b612-7deb9ff9a735 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:54.414889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-125c4b4d-5968-42a4-b612-7deb9ff9a735 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:54.415337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-125c4b4d-5968-42a4-b612-7deb9ff9a735 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:54.415757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-125c4b4d-5968-42a4-b612-7deb9ff9a735 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:54.545933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-125c4b4d-5968-42a4-b612-7deb9ff9a735 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:54.554429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-125c4b4d-5968-42a4-b612-7deb9ff9a735 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151946 Aug 06 13:01:54.554993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1699/3387] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:54 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:54.791595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1b0b416d-84c6-400d-b028-9a68abd6f7ea tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:54.792196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1b0b416d-84c6-400d-b028-9a68abd6f7ea tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:54.798603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b0b416d-84c6-400d-b028-9a68abd6f7ea tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:54.799080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b0b416d-84c6-400d-b028-9a68abd6f7ea tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:54.799509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b0b416d-84c6-400d-b028-9a68abd6f7ea tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:54.800181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b0b416d-84c6-400d-b028-9a68abd6f7ea tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:54.800652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b0b416d-84c6-400d-b028-9a68abd6f7ea tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:54.801073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b0b416d-84c6-400d-b028-9a68abd6f7ea tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:54.931108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1b0b416d-84c6-400d-b028-9a68abd6f7ea tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:54.939071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1b0b416d-84c6-400d-b028-9a68abd6f7ea tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151816 Aug 06 13:01:54.939631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1689/3388] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:55.575688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-948b010a-e713-40b2-8059-7bf77605dfc4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:55.576275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-948b010a-e713-40b2-8059-7bf77605dfc4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:55.582647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-948b010a-e713-40b2-8059-7bf77605dfc4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:55.583152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-948b010a-e713-40b2-8059-7bf77605dfc4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:55.583581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-948b010a-e713-40b2-8059-7bf77605dfc4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:55.584870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-948b010a-e713-40b2-8059-7bf77605dfc4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:55.585323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-948b010a-e713-40b2-8059-7bf77605dfc4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:55.585747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-948b010a-e713-40b2-8059-7bf77605dfc4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:55.709451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-948b010a-e713-40b2-8059-7bf77605dfc4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:55.717497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-948b010a-e713-40b2-8059-7bf77605dfc4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.145710 Aug 06 13:01:55.718059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1700/3389] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:55 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:55.959988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1925a2a3-b3c5-426d-b42f-91e5a1982a64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:55.960577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1925a2a3-b3c5-426d-b42f-91e5a1982a64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:55.966893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1925a2a3-b3c5-426d-b42f-91e5a1982a64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:55.967366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1925a2a3-b3c5-426d-b42f-91e5a1982a64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:55.967795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1925a2a3-b3c5-426d-b42f-91e5a1982a64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:55.968500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1925a2a3-b3c5-426d-b42f-91e5a1982a64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:55.968947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1925a2a3-b3c5-426d-b42f-91e5a1982a64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:55.969368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1925a2a3-b3c5-426d-b42f-91e5a1982a64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:56.095786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1925a2a3-b3c5-426d-b42f-91e5a1982a64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:56.104441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1925a2a3-b3c5-426d-b42f-91e5a1982a64 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148308 Aug 06 13:01:56.105004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1690/3390] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:56.738686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a0e16873-a318-4986-a82a-6995cbd10d4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:56.739277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a0e16873-a318-4986-a82a-6995cbd10d4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:56.745627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0e16873-a318-4986-a82a-6995cbd10d4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:56.746106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0e16873-a318-4986-a82a-6995cbd10d4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:56.746539 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0e16873-a318-4986-a82a-6995cbd10d4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:56.747221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0e16873-a318-4986-a82a-6995cbd10d4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:56.747671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0e16873-a318-4986-a82a-6995cbd10d4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:56.748093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0e16873-a318-4986-a82a-6995cbd10d4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:56.778231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:01:56.778586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 13:01:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c (ip 10.222.0.20) !!! Aug 06 13:01:56.881902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a0e16873-a318-4986-a82a-6995cbd10d4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:56.889975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a0e16873-a318-4986-a82a-6995cbd10d4d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.155128 Aug 06 13:01:56.890545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1701/3391] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:56 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:57.126179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-05d6a303-6ad4-4b99-ba3e-5309fbc6caa7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:57.126790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-05d6a303-6ad4-4b99-ba3e-5309fbc6caa7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:57.133643 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05d6a303-6ad4-4b99-ba3e-5309fbc6caa7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:57.134127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05d6a303-6ad4-4b99-ba3e-5309fbc6caa7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:57.134563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05d6a303-6ad4-4b99-ba3e-5309fbc6caa7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:57.135249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05d6a303-6ad4-4b99-ba3e-5309fbc6caa7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:57.135706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05d6a303-6ad4-4b99-ba3e-5309fbc6caa7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:57.136132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05d6a303-6ad4-4b99-ba3e-5309fbc6caa7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:57.263641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05d6a303-6ad4-4b99-ba3e-5309fbc6caa7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:57.271465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-05d6a303-6ad4-4b99-ba3e-5309fbc6caa7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149191 Aug 06 13:01:57.272035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1691/3392] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:57.742714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:01:57.742887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:01:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:01:57.911637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7cedf320-8798-45c0-ac16-e04314b65394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:57.912789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7cedf320-8798-45c0-ac16-e04314b65394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:57.919059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cedf320-8798-45c0-ac16-e04314b65394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:57.919533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cedf320-8798-45c0-ac16-e04314b65394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:57.919959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cedf320-8798-45c0-ac16-e04314b65394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:57.920656 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cedf320-8798-45c0-ac16-e04314b65394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:57.921104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cedf320-8798-45c0-ac16-e04314b65394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:57.921520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cedf320-8798-45c0-ac16-e04314b65394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:58.047721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7cedf320-8798-45c0-ac16-e04314b65394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:58.055713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7cedf320-8798-45c0-ac16-e04314b65394 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148005 Aug 06 13:01:58.056275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1702/3393] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:57 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:58.292018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-71131d72-d294-4ae5-a711-c7341f557c49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:58.292655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-71131d72-d294-4ae5-a711-c7341f557c49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:58.299088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71131d72-d294-4ae5-a711-c7341f557c49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:58.299565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71131d72-d294-4ae5-a711-c7341f557c49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:58.299995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71131d72-d294-4ae5-a711-c7341f557c49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:58.300718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71131d72-d294-4ae5-a711-c7341f557c49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:58.301153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71131d72-d294-4ae5-a711-c7341f557c49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:58.301572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71131d72-d294-4ae5-a711-c7341f557c49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:58.428788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-71131d72-d294-4ae5-a711-c7341f557c49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:58.436645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-71131d72-d294-4ae5-a711-c7341f557c49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148427 Aug 06 13:01:58.437201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1692/3394] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:59.077099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b5ac7df7-d95c-458d-9190-16d6dd35d828 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:59.077693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b5ac7df7-d95c-458d-9190-16d6dd35d828 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:59.084065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5ac7df7-d95c-458d-9190-16d6dd35d828 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:59.084583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5ac7df7-d95c-458d-9190-16d6dd35d828 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:59.085016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5ac7df7-d95c-458d-9190-16d6dd35d828 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:59.085700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5ac7df7-d95c-458d-9190-16d6dd35d828 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:59.086152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5ac7df7-d95c-458d-9190-16d6dd35d828 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:59.086571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5ac7df7-d95c-458d-9190-16d6dd35d828 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:59.213044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b5ac7df7-d95c-458d-9190-16d6dd35d828 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:59.220805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b5ac7df7-d95c-458d-9190-16d6dd35d828 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147545 Aug 06 13:01:59.221362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1703/3395] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:59 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:01:59.457474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8555a124-d1fd-4b77-989a-6542b0cec857 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:01:59.458076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8555a124-d1fd-4b77-989a-6542b0cec857 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:01:59.464931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8555a124-d1fd-4b77-989a-6542b0cec857 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:59.465405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8555a124-d1fd-4b77-989a-6542b0cec857 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:59.465848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8555a124-d1fd-4b77-989a-6542b0cec857 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:59.466510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8555a124-d1fd-4b77-989a-6542b0cec857 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:01:59.466955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8555a124-d1fd-4b77-989a-6542b0cec857 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:01:59.467371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8555a124-d1fd-4b77-989a-6542b0cec857 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:01:59.594671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8555a124-d1fd-4b77-989a-6542b0cec857 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:01:59.603238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8555a124-d1fd-4b77-989a-6542b0cec857 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149534 Aug 06 13:01:59.603786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1693/3396] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:01:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:00.243092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4252622c-3dd8-48e2-ab5f-5b8ca5d0a383 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:00.243707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4252622c-3dd8-48e2-ab5f-5b8ca5d0a383 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:00.250088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4252622c-3dd8-48e2-ab5f-5b8ca5d0a383 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:00.250500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4252622c-3dd8-48e2-ab5f-5b8ca5d0a383 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:00.250925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4252622c-3dd8-48e2-ab5f-5b8ca5d0a383 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:00.251596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4252622c-3dd8-48e2-ab5f-5b8ca5d0a383 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:00.252044 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4252622c-3dd8-48e2-ab5f-5b8ca5d0a383 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:00.252493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4252622c-3dd8-48e2-ab5f-5b8ca5d0a383 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:00.392532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4252622c-3dd8-48e2-ab5f-5b8ca5d0a383 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:00.400267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4252622c-3dd8-48e2-ab5f-5b8ca5d0a383 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.161520 Aug 06 13:02:00.400849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1704/3397] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:00 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:00.625044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9f5d6b56-5bb7-467a-b90d-ca4aa48eb65e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:00.625622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9f5d6b56-5bb7-467a-b90d-ca4aa48eb65e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:00.631960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f5d6b56-5bb7-467a-b90d-ca4aa48eb65e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:00.632489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f5d6b56-5bb7-467a-b90d-ca4aa48eb65e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:00.632916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f5d6b56-5bb7-467a-b90d-ca4aa48eb65e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:00.633586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f5d6b56-5bb7-467a-b90d-ca4aa48eb65e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:00.634031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f5d6b56-5bb7-467a-b90d-ca4aa48eb65e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:00.634450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f5d6b56-5bb7-467a-b90d-ca4aa48eb65e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:00.762400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9f5d6b56-5bb7-467a-b90d-ca4aa48eb65e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:00.770168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9f5d6b56-5bb7-467a-b90d-ca4aa48eb65e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148996 Aug 06 13:02:00.770753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1694/3398] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:01.421114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-245db473-29c2-4a98-8284-d1a016a0fe10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:01.421732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-245db473-29c2-4a98-8284-d1a016a0fe10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:01.428041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-245db473-29c2-4a98-8284-d1a016a0fe10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:01.428549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-245db473-29c2-4a98-8284-d1a016a0fe10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:01.428979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-245db473-29c2-4a98-8284-d1a016a0fe10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:01.429654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-245db473-29c2-4a98-8284-d1a016a0fe10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:01.430104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-245db473-29c2-4a98-8284-d1a016a0fe10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:01.430523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-245db473-29c2-4a98-8284-d1a016a0fe10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:01.433036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:01.555683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-245db473-29c2-4a98-8284-d1a016a0fe10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:01.563502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-245db473-29c2-4a98-8284-d1a016a0fe10 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146302 Aug 06 13:02:01.564211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1705/3399] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:01 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:01.790922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-31985628-4237-44da-bf7d-597239c52dad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:01.791551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-31985628-4237-44da-bf7d-597239c52dad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:01.798046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31985628-4237-44da-bf7d-597239c52dad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:01.798520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31985628-4237-44da-bf7d-597239c52dad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:01.798950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31985628-4237-44da-bf7d-597239c52dad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:01.799625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31985628-4237-44da-bf7d-597239c52dad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:01.800068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31985628-4237-44da-bf7d-597239c52dad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:01.800515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31985628-4237-44da-bf7d-597239c52dad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:01.928961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-31985628-4237-44da-bf7d-597239c52dad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:01.937122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-31985628-4237-44da-bf7d-597239c52dad tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150016 Aug 06 13:02:01.937686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1695/3400] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:01 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:02.585365 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b57e4b0b-8123-47a1-9863-0ea63191d438 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:02.586019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b57e4b0b-8123-47a1-9863-0ea63191d438 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:02.592412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b57e4b0b-8123-47a1-9863-0ea63191d438 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:02.592891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b57e4b0b-8123-47a1-9863-0ea63191d438 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:02.593318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b57e4b0b-8123-47a1-9863-0ea63191d438 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:02.593993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b57e4b0b-8123-47a1-9863-0ea63191d438 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:02.594440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b57e4b0b-8123-47a1-9863-0ea63191d438 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:02.594859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b57e4b0b-8123-47a1-9863-0ea63191d438 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:02.723745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b57e4b0b-8123-47a1-9863-0ea63191d438 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:02.732493 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b57e4b0b-8123-47a1-9863-0ea63191d438 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151513 Aug 06 13:02:02.733052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1706/3401] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:02 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:02.961259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-107c9c75-dc2d-479d-891c-bae53650cfb3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:02.961900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-107c9c75-dc2d-479d-891c-bae53650cfb3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:02.967938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-107c9c75-dc2d-479d-891c-bae53650cfb3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:02.968452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-107c9c75-dc2d-479d-891c-bae53650cfb3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:02.968888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-107c9c75-dc2d-479d-891c-bae53650cfb3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:02.969586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-107c9c75-dc2d-479d-891c-bae53650cfb3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:02.970037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-107c9c75-dc2d-479d-891c-bae53650cfb3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:02.970458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-107c9c75-dc2d-479d-891c-bae53650cfb3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:02.973010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:03.102772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-107c9c75-dc2d-479d-891c-bae53650cfb3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:03.110865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-107c9c75-dc2d-479d-891c-bae53650cfb3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154818 Aug 06 13:02:03.111426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1696/3402] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:03.554042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:02:03.554219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:02:03.752998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d27f23de-37ab-427c-b81b-68b82e42237e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:03.753668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d27f23de-37ab-427c-b81b-68b82e42237e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:03.760047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d27f23de-37ab-427c-b81b-68b82e42237e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:03.760555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d27f23de-37ab-427c-b81b-68b82e42237e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:03.760987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d27f23de-37ab-427c-b81b-68b82e42237e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:03.761666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d27f23de-37ab-427c-b81b-68b82e42237e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:03.762114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d27f23de-37ab-427c-b81b-68b82e42237e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:03.762536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d27f23de-37ab-427c-b81b-68b82e42237e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:03.887250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d27f23de-37ab-427c-b81b-68b82e42237e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:03.903898 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d27f23de-37ab-427c-b81b-68b82e42237e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.154598 Aug 06 13:02:03.904503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1707/3403] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:03 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:04.130980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a6e99537-f35d-4d24-8b59-4a9171fda953 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:04.131517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a6e99537-f35d-4d24-8b59-4a9171fda953 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:04.137878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e99537-f35d-4d24-8b59-4a9171fda953 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:04.138349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e99537-f35d-4d24-8b59-4a9171fda953 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:04.138778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e99537-f35d-4d24-8b59-4a9171fda953 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:04.139454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e99537-f35d-4d24-8b59-4a9171fda953 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:04.139899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e99537-f35d-4d24-8b59-4a9171fda953 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:04.140333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e99537-f35d-4d24-8b59-4a9171fda953 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:04.269905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a6e99537-f35d-4d24-8b59-4a9171fda953 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:04.278467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a6e99537-f35d-4d24-8b59-4a9171fda953 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151442 Aug 06 13:02:04.279030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1697/3404] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:04.925244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-52c8b049-7fd5-46c7-939b-b691f41160f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:04.925862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-52c8b049-7fd5-46c7-939b-b691f41160f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:04.932718 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52c8b049-7fd5-46c7-939b-b691f41160f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:04.933193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52c8b049-7fd5-46c7-939b-b691f41160f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:04.933620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52c8b049-7fd5-46c7-939b-b691f41160f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:04.934288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52c8b049-7fd5-46c7-939b-b691f41160f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:04.934758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52c8b049-7fd5-46c7-939b-b691f41160f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:04.935176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52c8b049-7fd5-46c7-939b-b691f41160f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:05.061099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-52c8b049-7fd5-46c7-939b-b691f41160f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:05.069052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-52c8b049-7fd5-46c7-939b-b691f41160f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147644 Aug 06 13:02:05.069610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1708/3405] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:04 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:05.299075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-983715f5-d416-4464-bfa1-4b6862a23375 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:05.299677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-983715f5-d416-4464-bfa1-4b6862a23375 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:05.306599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-983715f5-d416-4464-bfa1-4b6862a23375 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:05.307073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-983715f5-d416-4464-bfa1-4b6862a23375 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:05.307501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-983715f5-d416-4464-bfa1-4b6862a23375 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:05.308176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-983715f5-d416-4464-bfa1-4b6862a23375 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:05.308655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-983715f5-d416-4464-bfa1-4b6862a23375 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:05.309072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-983715f5-d416-4464-bfa1-4b6862a23375 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:05.685837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-983715f5-d416-4464-bfa1-4b6862a23375 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:05.693717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-983715f5-d416-4464-bfa1-4b6862a23375 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.398502 Aug 06 13:02:05.694272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1698/3406] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:06.090559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bac849b9-da64-461c-bd73-80a2a89a193a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:06.091163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bac849b9-da64-461c-bd73-80a2a89a193a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:06.097659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac849b9-da64-461c-bd73-80a2a89a193a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:06.098134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac849b9-da64-461c-bd73-80a2a89a193a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:06.098564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac849b9-da64-461c-bd73-80a2a89a193a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:06.099241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac849b9-da64-461c-bd73-80a2a89a193a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:06.099688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac849b9-da64-461c-bd73-80a2a89a193a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:06.100104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bac849b9-da64-461c-bd73-80a2a89a193a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:06.232069 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bac849b9-da64-461c-bd73-80a2a89a193a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:06.240518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bac849b9-da64-461c-bd73-80a2a89a193a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153282 Aug 06 13:02:06.241080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1709/3407] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:06 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:06.714413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-45787ff5-0ae2-48cf-9682-09a278703e12 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:06.715046 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-45787ff5-0ae2-48cf-9682-09a278703e12 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:06.721378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45787ff5-0ae2-48cf-9682-09a278703e12 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:06.721855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45787ff5-0ae2-48cf-9682-09a278703e12 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:06.722284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45787ff5-0ae2-48cf-9682-09a278703e12 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:06.722955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45787ff5-0ae2-48cf-9682-09a278703e12 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:06.723403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45787ff5-0ae2-48cf-9682-09a278703e12 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:06.723821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45787ff5-0ae2-48cf-9682-09a278703e12 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:06.850235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-45787ff5-0ae2-48cf-9682-09a278703e12 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:06.858421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-45787ff5-0ae2-48cf-9682-09a278703e12 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147842 Aug 06 13:02:06.858980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1699/3408] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:07.261307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f733299b-2c8e-4933-b4a7-53779a1b2f0d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:07.261843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f733299b-2c8e-4933-b4a7-53779a1b2f0d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:07.268195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f733299b-2c8e-4933-b4a7-53779a1b2f0d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:07.268710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f733299b-2c8e-4933-b4a7-53779a1b2f0d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:07.269145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f733299b-2c8e-4933-b4a7-53779a1b2f0d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:07.269824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f733299b-2c8e-4933-b4a7-53779a1b2f0d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:07.270275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f733299b-2c8e-4933-b4a7-53779a1b2f0d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:07.270700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f733299b-2c8e-4933-b4a7-53779a1b2f0d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:07.396788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f733299b-2c8e-4933-b4a7-53779a1b2f0d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:07.404547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f733299b-2c8e-4933-b4a7-53779a1b2f0d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147146 Aug 06 13:02:07.405106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1710/3409] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:07 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:02:07.881178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-74855bd9-24a9-4d7d-976d-d481076dc4b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:07.881726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-74855bd9-24a9-4d7d-976d-d481076dc4b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:07.888051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74855bd9-24a9-4d7d-976d-d481076dc4b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:07.888564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74855bd9-24a9-4d7d-976d-d481076dc4b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:07.889001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74855bd9-24a9-4d7d-976d-d481076dc4b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:07.889679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74855bd9-24a9-4d7d-976d-d481076dc4b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:07.890129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74855bd9-24a9-4d7d-976d-d481076dc4b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:07.890551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74855bd9-24a9-4d7d-976d-d481076dc4b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:08.019128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-74855bd9-24a9-4d7d-976d-d481076dc4b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:08.026928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-74855bd9-24a9-4d7d-976d-d481076dc4b0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150348 Aug 06 13:02:08.027488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1700/3410] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:08.426029 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e8a09d86-416c-4b45-baa4-5febaac7d246 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:08.426631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e8a09d86-416c-4b45-baa4-5febaac7d246 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:08.432989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a09d86-416c-4b45-baa4-5febaac7d246 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:08.433465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a09d86-416c-4b45-baa4-5febaac7d246 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:08.433889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a09d86-416c-4b45-baa4-5febaac7d246 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:08.434561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a09d86-416c-4b45-baa4-5febaac7d246 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:08.435005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a09d86-416c-4b45-baa4-5febaac7d246 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:08.435421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e8a09d86-416c-4b45-baa4-5febaac7d246 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:08.565018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e8a09d86-416c-4b45-baa4-5febaac7d246 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:08.572770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e8a09d86-416c-4b45-baa4-5febaac7d246 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150649 Aug 06 13:02:08.573323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1711/3411] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:08 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:09.048024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d97baa9e-6d9c-41e4-ba5e-c55abd5f5bfa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:09.048660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d97baa9e-6d9c-41e4-ba5e-c55abd5f5bfa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:09.055107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d97baa9e-6d9c-41e4-ba5e-c55abd5f5bfa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:09.055581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d97baa9e-6d9c-41e4-ba5e-c55abd5f5bfa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:09.056011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d97baa9e-6d9c-41e4-ba5e-c55abd5f5bfa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:09.056709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d97baa9e-6d9c-41e4-ba5e-c55abd5f5bfa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:09.057153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d97baa9e-6d9c-41e4-ba5e-c55abd5f5bfa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:09.057569 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d97baa9e-6d9c-41e4-ba5e-c55abd5f5bfa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:09.182480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d97baa9e-6d9c-41e4-ba5e-c55abd5f5bfa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:09.190295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d97baa9e-6d9c-41e4-ba5e-c55abd5f5bfa tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146088 Aug 06 13:02:09.190888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1701/3412] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:02:09.594085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1275ebac-a371-4a8f-acbc-e8747d5fc3b0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:09.594691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1275ebac-a371-4a8f-acbc-e8747d5fc3b0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:09.601645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1275ebac-a371-4a8f-acbc-e8747d5fc3b0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:09.602126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1275ebac-a371-4a8f-acbc-e8747d5fc3b0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:09.602562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1275ebac-a371-4a8f-acbc-e8747d5fc3b0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:09.603240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1275ebac-a371-4a8f-acbc-e8747d5fc3b0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:09.603688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1275ebac-a371-4a8f-acbc-e8747d5fc3b0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:09.604108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1275ebac-a371-4a8f-acbc-e8747d5fc3b0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:09.729165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1275ebac-a371-4a8f-acbc-e8747d5fc3b0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:09.737274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1275ebac-a371-4a8f-acbc-e8747d5fc3b0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147023 Aug 06 13:02:09.737825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1712/3413] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:09 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:10.213776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7816275-0844-4382-bd1e-a0fba651ba39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:10.214373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7816275-0844-4382-bd1e-a0fba651ba39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:10.216671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=52 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:10.221845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7816275-0844-4382-bd1e-a0fba651ba39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:10.222315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7816275-0844-4382-bd1e-a0fba651ba39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:10.222740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7816275-0844-4382-bd1e-a0fba651ba39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:10.223410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7816275-0844-4382-bd1e-a0fba651ba39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:10.223849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7816275-0844-4382-bd1e-a0fba651ba39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:10.224901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7816275-0844-4382-bd1e-a0fba651ba39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:10.349410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7816275-0844-4382-bd1e-a0fba651ba39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:10.357519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7816275-0844-4382-bd1e-a0fba651ba39 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147582 Aug 06 13:02:10.358075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1702/3414] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:10.759618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98978d39-2d38-4ac0-bbf7-5c9374bc7331 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:10.760165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-98978d39-2d38-4ac0-bbf7-5c9374bc7331 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:10.766388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98978d39-2d38-4ac0-bbf7-5c9374bc7331 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:10.766859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98978d39-2d38-4ac0-bbf7-5c9374bc7331 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:10.767284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98978d39-2d38-4ac0-bbf7-5c9374bc7331 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:10.767982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98978d39-2d38-4ac0-bbf7-5c9374bc7331 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:10.768447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98978d39-2d38-4ac0-bbf7-5c9374bc7331 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:10.768865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98978d39-2d38-4ac0-bbf7-5c9374bc7331 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:10.899502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98978d39-2d38-4ac0-bbf7-5c9374bc7331 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:10.907384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98978d39-2d38-4ac0-bbf7-5c9374bc7331 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.152373 Aug 06 13:02:10.907941 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1713/3415] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:10 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:11.378103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d40c9214-b208-4dce-abee-46110dee56ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:11.378708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d40c9214-b208-4dce-abee-46110dee56ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:11.385216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d40c9214-b208-4dce-abee-46110dee56ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:11.385690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d40c9214-b208-4dce-abee-46110dee56ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:11.386125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d40c9214-b208-4dce-abee-46110dee56ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:11.386803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d40c9214-b208-4dce-abee-46110dee56ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:11.387252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d40c9214-b208-4dce-abee-46110dee56ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:11.387675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d40c9214-b208-4dce-abee-46110dee56ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:11.513341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d40c9214-b208-4dce-abee-46110dee56ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:11.521591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d40c9214-b208-4dce-abee-46110dee56ca tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146866 Aug 06 13:02:11.522158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1703/3416] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:11.930959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7d70675f-6c98-43aa-8bc9-94833834277c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:11.931548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7d70675f-6c98-43aa-8bc9-94833834277c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:11.937955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d70675f-6c98-43aa-8bc9-94833834277c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:11.938430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d70675f-6c98-43aa-8bc9-94833834277c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:11.938854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d70675f-6c98-43aa-8bc9-94833834277c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:11.939522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d70675f-6c98-43aa-8bc9-94833834277c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:11.939968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d70675f-6c98-43aa-8bc9-94833834277c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:11.940412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7d70675f-6c98-43aa-8bc9-94833834277c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:12.065867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7d70675f-6c98-43aa-8bc9-94833834277c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:12.074137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7d70675f-6c98-43aa-8bc9-94833834277c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147114 Aug 06 13:02:12.074697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1714/3417] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:11 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:12.542681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-97841c76-9f73-4d40-8764-f1d61563e01d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:12.543281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-97841c76-9f73-4d40-8764-f1d61563e01d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:12.549686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97841c76-9f73-4d40-8764-f1d61563e01d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:12.550157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97841c76-9f73-4d40-8764-f1d61563e01d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:12.550582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97841c76-9f73-4d40-8764-f1d61563e01d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:12.551251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97841c76-9f73-4d40-8764-f1d61563e01d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:12.551693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97841c76-9f73-4d40-8764-f1d61563e01d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:12.552153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97841c76-9f73-4d40-8764-f1d61563e01d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:12.676760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-97841c76-9f73-4d40-8764-f1d61563e01d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:12.685225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-97841c76-9f73-4d40-8764-f1d61563e01d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146358 Aug 06 13:02:12.685795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1704/3418] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:13.094862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27dc1d68-fe96-4690-addc-f633d1714400 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:13.095457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-27dc1d68-fe96-4690-addc-f633d1714400 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:13.102401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dc1d68-fe96-4690-addc-f633d1714400 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:13.102871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dc1d68-fe96-4690-addc-f633d1714400 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:13.103296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dc1d68-fe96-4690-addc-f633d1714400 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:13.103962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dc1d68-fe96-4690-addc-f633d1714400 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:13.104431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dc1d68-fe96-4690-addc-f633d1714400 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:13.104847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27dc1d68-fe96-4690-addc-f633d1714400 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:13.228996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-27dc1d68-fe96-4690-addc-f633d1714400 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:13.237052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-27dc1d68-fe96-4690-addc-f633d1714400 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.146062 Aug 06 13:02:13.237610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1715/3419] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:13 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:13.706094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c51b3d00-4a64-44b6-88e6-6099c8513429 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:13.706705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c51b3d00-4a64-44b6-88e6-6099c8513429 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:13.713174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b3d00-4a64-44b6-88e6-6099c8513429 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:13.713652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b3d00-4a64-44b6-88e6-6099c8513429 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:13.714084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b3d00-4a64-44b6-88e6-6099c8513429 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:13.714767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b3d00-4a64-44b6-88e6-6099c8513429 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:13.715219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b3d00-4a64-44b6-88e6-6099c8513429 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:13.715642 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b3d00-4a64-44b6-88e6-6099c8513429 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:13.842846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c51b3d00-4a64-44b6-88e6-6099c8513429 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:13.850756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c51b3d00-4a64-44b6-88e6-6099c8513429 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148551 Aug 06 13:02:13.851318 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1705/3420] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:14.257875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9ca4a282-634e-40c8-841a-771d11fd6d39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:14.258408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9ca4a282-634e-40c8-841a-771d11fd6d39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:14.260742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=52 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:14.265773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ca4a282-634e-40c8-841a-771d11fd6d39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:14.266248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ca4a282-634e-40c8-841a-771d11fd6d39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:14.266673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ca4a282-634e-40c8-841a-771d11fd6d39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:14.267348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ca4a282-634e-40c8-841a-771d11fd6d39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:14.267794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ca4a282-634e-40c8-841a-771d11fd6d39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:14.268210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ca4a282-634e-40c8-841a-771d11fd6d39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:14.396705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9ca4a282-634e-40c8-841a-771d11fd6d39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:14.404483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9ca4a282-634e-40c8-841a-771d11fd6d39 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.150479 Aug 06 13:02:14.405038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1716/3421] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:14 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:14.873300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7dabf930-17ea-40d4-adb4-c6b7dcc939d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:14.873891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7dabf930-17ea-40d4-adb4-c6b7dcc939d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:14.880747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dabf930-17ea-40d4-adb4-c6b7dcc939d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:14.881257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dabf930-17ea-40d4-adb4-c6b7dcc939d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:14.881687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dabf930-17ea-40d4-adb4-c6b7dcc939d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:14.882362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dabf930-17ea-40d4-adb4-c6b7dcc939d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:14.882809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dabf930-17ea-40d4-adb4-c6b7dcc939d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:14.883260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dabf930-17ea-40d4-adb4-c6b7dcc939d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:15.010400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7dabf930-17ea-40d4-adb4-c6b7dcc939d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:15.018228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7dabf930-17ea-40d4-adb4-c6b7dcc939d9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148828 Aug 06 13:02:15.018788 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1706/3422] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:15.425380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-76ada277-1f8b-49eb-aac1-0b23799da86a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:15.426007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-76ada277-1f8b-49eb-aac1-0b23799da86a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:15.432962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76ada277-1f8b-49eb-aac1-0b23799da86a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:15.433439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76ada277-1f8b-49eb-aac1-0b23799da86a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:15.433868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76ada277-1f8b-49eb-aac1-0b23799da86a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:15.434548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76ada277-1f8b-49eb-aac1-0b23799da86a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:15.434998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76ada277-1f8b-49eb-aac1-0b23799da86a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:15.435419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76ada277-1f8b-49eb-aac1-0b23799da86a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:15.563297 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-76ada277-1f8b-49eb-aac1-0b23799da86a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:15.571144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-76ada277-1f8b-49eb-aac1-0b23799da86a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149788 Aug 06 13:02:15.571707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1717/3423] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:15 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:16.039960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-74593e64-3559-4c48-9bd7-ec59f98c48ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:16.040590 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-74593e64-3559-4c48-9bd7-ec59f98c48ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:16.047010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74593e64-3559-4c48-9bd7-ec59f98c48ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:16.047490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74593e64-3559-4c48-9bd7-ec59f98c48ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:16.047920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74593e64-3559-4c48-9bd7-ec59f98c48ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:16.048630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74593e64-3559-4c48-9bd7-ec59f98c48ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:16.049081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74593e64-3559-4c48-9bd7-ec59f98c48ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:16.049503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74593e64-3559-4c48-9bd7-ec59f98c48ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:16.180227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-74593e64-3559-4c48-9bd7-ec59f98c48ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:16.188100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-74593e64-3559-4c48-9bd7-ec59f98c48ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152604 Aug 06 13:02:16.188687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1707/3424] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:16.592116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0196abc9-9b01-46f3-b991-aedf5efc3beb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:16.592753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0196abc9-9b01-46f3-b991-aedf5efc3beb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:16.599074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0196abc9-9b01-46f3-b991-aedf5efc3beb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:16.599540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0196abc9-9b01-46f3-b991-aedf5efc3beb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:16.599975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0196abc9-9b01-46f3-b991-aedf5efc3beb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:16.600689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0196abc9-9b01-46f3-b991-aedf5efc3beb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:16.601144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0196abc9-9b01-46f3-b991-aedf5efc3beb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:16.601571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0196abc9-9b01-46f3-b991-aedf5efc3beb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:16.931752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0196abc9-9b01-46f3-b991-aedf5efc3beb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:16.940801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0196abc9-9b01-46f3-b991-aedf5efc3beb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.352478 Aug 06 13:02:16.941384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1718/3425] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:16 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:17.209491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3e925e2-c779-4cea-8b12-eda29493f938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:17.210116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d3e925e2-c779-4cea-8b12-eda29493f938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:17.216383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3e925e2-c779-4cea-8b12-eda29493f938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:17.216853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3e925e2-c779-4cea-8b12-eda29493f938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:17.217280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3e925e2-c779-4cea-8b12-eda29493f938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:17.217951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3e925e2-c779-4cea-8b12-eda29493f938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:17.218396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3e925e2-c779-4cea-8b12-eda29493f938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:17.218814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3e925e2-c779-4cea-8b12-eda29493f938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:17.348459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d3e925e2-c779-4cea-8b12-eda29493f938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:17.356961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3e925e2-c779-4cea-8b12-eda29493f938 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151440 Aug 06 13:02:17.357517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1708/3426] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:17.962594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a847255c-ecca-4d69-a52f-66e9b909b685 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:17.963142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a847255c-ecca-4d69-a52f-66e9b909b685 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:17.969431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a847255c-ecca-4d69-a52f-66e9b909b685 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:17.969901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a847255c-ecca-4d69-a52f-66e9b909b685 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:17.970327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a847255c-ecca-4d69-a52f-66e9b909b685 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:17.970990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a847255c-ecca-4d69-a52f-66e9b909b685 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:17.971435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a847255c-ecca-4d69-a52f-66e9b909b685 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:17.971849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a847255c-ecca-4d69-a52f-66e9b909b685 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:18.097310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a847255c-ecca-4d69-a52f-66e9b909b685 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:18.105949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a847255c-ecca-4d69-a52f-66e9b909b685 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.147280 Aug 06 13:02:18.106507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1719/3427] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:17 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:18.378298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9105eb00-e652-4c7f-ae9b-96b09abda52e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:18.378923 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9105eb00-e652-4c7f-ae9b-96b09abda52e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:18.385049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9105eb00-e652-4c7f-ae9b-96b09abda52e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:18.385523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9105eb00-e652-4c7f-ae9b-96b09abda52e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:18.385952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9105eb00-e652-4c7f-ae9b-96b09abda52e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:18.386630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9105eb00-e652-4c7f-ae9b-96b09abda52e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:18.387077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9105eb00-e652-4c7f-ae9b-96b09abda52e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:18.387570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9105eb00-e652-4c7f-ae9b-96b09abda52e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:18.512288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9105eb00-e652-4c7f-ae9b-96b09abda52e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:18.520004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9105eb00-e652-4c7f-ae9b-96b09abda52e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145525 Aug 06 13:02:18.521222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1709/3428] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:18 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:19.127059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5ac9c5bb-c4c3-4bc6-a302-aa37d4c82f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:19.127595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5ac9c5bb-c4c3-4bc6-a302-aa37d4c82f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:19.134558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ac9c5bb-c4c3-4bc6-a302-aa37d4c82f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:19.135027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ac9c5bb-c4c3-4bc6-a302-aa37d4c82f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:19.135447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ac9c5bb-c4c3-4bc6-a302-aa37d4c82f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:19.136113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ac9c5bb-c4c3-4bc6-a302-aa37d4c82f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:19.136575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ac9c5bb-c4c3-4bc6-a302-aa37d4c82f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:19.136994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ac9c5bb-c4c3-4bc6-a302-aa37d4c82f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:19.268120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5ac9c5bb-c4c3-4bc6-a302-aa37d4c82f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:19.276088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5ac9c5bb-c4c3-4bc6-a302-aa37d4c82f08 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153013 Aug 06 13:02:19.276695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1720/3429] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:19 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:19.542246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-44a8db65-95e8-47fe-81f0-cae8459cd434 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:19.543062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-44a8db65-95e8-47fe-81f0-cae8459cd434 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:19.549771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44a8db65-95e8-47fe-81f0-cae8459cd434 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:19.550245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44a8db65-95e8-47fe-81f0-cae8459cd434 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:19.550669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44a8db65-95e8-47fe-81f0-cae8459cd434 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:19.551352 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44a8db65-95e8-47fe-81f0-cae8459cd434 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:19.551856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44a8db65-95e8-47fe-81f0-cae8459cd434 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:19.553031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44a8db65-95e8-47fe-81f0-cae8459cd434 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:19.683511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-44a8db65-95e8-47fe-81f0-cae8459cd434 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:19.691419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-44a8db65-95e8-47fe-81f0-cae8459cd434 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153027 Aug 06 13:02:19.691975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1710/3430] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:20.296981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e11b92a7-0cfa-446a-b1ac-0349d458c8fe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:20.297583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e11b92a7-0cfa-446a-b1ac-0349d458c8fe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:20.303946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11b92a7-0cfa-446a-b1ac-0349d458c8fe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:20.304456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11b92a7-0cfa-446a-b1ac-0349d458c8fe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:20.304886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11b92a7-0cfa-446a-b1ac-0349d458c8fe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:20.305556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11b92a7-0cfa-446a-b1ac-0349d458c8fe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:20.306006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11b92a7-0cfa-446a-b1ac-0349d458c8fe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:20.306425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e11b92a7-0cfa-446a-b1ac-0349d458c8fe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:20.432405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e11b92a7-0cfa-446a-b1ac-0349d458c8fe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:20.434557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:20.441724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e11b92a7-0cfa-446a-b1ac-0349d458c8fe tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148484 Aug 06 13:02:20.442329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1721/3431] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:20 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:20.711268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-23a4da96-2632-4b00-919e-98b71710a9f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:20.711875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-23a4da96-2632-4b00-919e-98b71710a9f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:20.718256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a4da96-2632-4b00-919e-98b71710a9f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:20.718734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a4da96-2632-4b00-919e-98b71710a9f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:20.719170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a4da96-2632-4b00-919e-98b71710a9f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:20.719852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a4da96-2632-4b00-919e-98b71710a9f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:20.720329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a4da96-2632-4b00-919e-98b71710a9f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:20.720745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23a4da96-2632-4b00-919e-98b71710a9f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:20.845339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-23a4da96-2632-4b00-919e-98b71710a9f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:20.853623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-23a4da96-2632-4b00-919e-98b71710a9f9 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146197 Aug 06 13:02:20.854184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1711/3432] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:21.463445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-93fd72a5-37fb-4aa1-8ed3-f4779843edae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:21.464032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-93fd72a5-37fb-4aa1-8ed3-f4779843edae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:21.470397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93fd72a5-37fb-4aa1-8ed3-f4779843edae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:21.470887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93fd72a5-37fb-4aa1-8ed3-f4779843edae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:21.471310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93fd72a5-37fb-4aa1-8ed3-f4779843edae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:21.471978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93fd72a5-37fb-4aa1-8ed3-f4779843edae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:21.472448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93fd72a5-37fb-4aa1-8ed3-f4779843edae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:21.472864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93fd72a5-37fb-4aa1-8ed3-f4779843edae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:21.602697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-93fd72a5-37fb-4aa1-8ed3-f4779843edae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:21.610700 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-93fd72a5-37fb-4aa1-8ed3-f4779843edae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.151114 Aug 06 13:02:21.611257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1722/3433] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:21 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:21.874956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a81bf746-9c45-4f07-a6bd-39fefa83b794 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:21.875566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a81bf746-9c45-4f07-a6bd-39fefa83b794 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:21.882442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a81bf746-9c45-4f07-a6bd-39fefa83b794 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:21.882929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a81bf746-9c45-4f07-a6bd-39fefa83b794 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:21.883366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a81bf746-9c45-4f07-a6bd-39fefa83b794 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:21.884053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a81bf746-9c45-4f07-a6bd-39fefa83b794 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:21.884535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a81bf746-9c45-4f07-a6bd-39fefa83b794 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:21.884964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a81bf746-9c45-4f07-a6bd-39fefa83b794 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:22.014438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a81bf746-9c45-4f07-a6bd-39fefa83b794 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:22.016661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:22.023606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a81bf746-9c45-4f07-a6bd-39fefa83b794 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152546 Aug 06 13:02:22.024181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1712/3434] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:21 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:22.361383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:02:22.361601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:02:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:02:22.631566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a788b92c-b508-4696-a9b3-59ded28c08d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:22.632103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a788b92c-b508-4696-a9b3-59ded28c08d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:22.638562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a788b92c-b508-4696-a9b3-59ded28c08d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:22.639039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a788b92c-b508-4696-a9b3-59ded28c08d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:22.639469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a788b92c-b508-4696-a9b3-59ded28c08d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:22.640148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a788b92c-b508-4696-a9b3-59ded28c08d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:22.640626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a788b92c-b508-4696-a9b3-59ded28c08d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:22.641052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a788b92c-b508-4696-a9b3-59ded28c08d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:22.767685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a788b92c-b508-4696-a9b3-59ded28c08d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:22.775991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a788b92c-b508-4696-a9b3-59ded28c08d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.148412 Aug 06 13:02:22.776579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1723/3435] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:22 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:22.834503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:02:22.834710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 13:02:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:02:23.044538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-56d17db6-974e-4024-b76a-759f69d6ebfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:23.045137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-56d17db6-974e-4024-b76a-759f69d6ebfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:23.051538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d17db6-974e-4024-b76a-759f69d6ebfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:23.052022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d17db6-974e-4024-b76a-759f69d6ebfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:23.052486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d17db6-974e-4024-b76a-759f69d6ebfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:23.053167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d17db6-974e-4024-b76a-759f69d6ebfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:23.053615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d17db6-974e-4024-b76a-759f69d6ebfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:23.054067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56d17db6-974e-4024-b76a-759f69d6ebfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:23.178449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-56d17db6-974e-4024-b76a-759f69d6ebfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:23.186228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-56d17db6-974e-4024-b76a-759f69d6ebfd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145772 Aug 06 13:02:23.186887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1713/3436] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:23.797562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-751e1cc5-42be-443a-8ce3-396ca743c325 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:23.798161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-751e1cc5-42be-443a-8ce3-396ca743c325 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:23.804651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751e1cc5-42be-443a-8ce3-396ca743c325 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:23.805144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751e1cc5-42be-443a-8ce3-396ca743c325 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:23.805566 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751e1cc5-42be-443a-8ce3-396ca743c325 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:23.806246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751e1cc5-42be-443a-8ce3-396ca743c325 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:23.806692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751e1cc5-42be-443a-8ce3-396ca743c325 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:23.807112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751e1cc5-42be-443a-8ce3-396ca743c325 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:23.934818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-751e1cc5-42be-443a-8ce3-396ca743c325 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:23.943077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-751e1cc5-42be-443a-8ce3-396ca743c325 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.149366 Aug 06 13:02:23.943634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1724/3437] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:23 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:24.207479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f4108f86-9fb5-460f-9f94-6557f427a5f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:24.208062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f4108f86-9fb5-460f-9f94-6557f427a5f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:24.214356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4108f86-9fb5-460f-9f94-6557f427a5f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:24.214834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4108f86-9fb5-460f-9f94-6557f427a5f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:24.215264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4108f86-9fb5-460f-9f94-6557f427a5f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:24.215953 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4108f86-9fb5-460f-9f94-6557f427a5f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:24.216433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4108f86-9fb5-460f-9f94-6557f427a5f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:24.216857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4108f86-9fb5-460f-9f94-6557f427a5f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:24.343168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f4108f86-9fb5-460f-9f94-6557f427a5f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:24.351177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f4108f86-9fb5-460f-9f94-6557f427a5f5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147629 Aug 06 13:02:24.351741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1714/3438] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:24.963600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e465f190-8f86-489a-a89d-772451bdb87d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:24.964225 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e465f190-8f86-489a-a89d-772451bdb87d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:24.970508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e465f190-8f86-489a-a89d-772451bdb87d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:24.970981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e465f190-8f86-489a-a89d-772451bdb87d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:24.971414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e465f190-8f86-489a-a89d-772451bdb87d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:24.972082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e465f190-8f86-489a-a89d-772451bdb87d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:24.972665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e465f190-8f86-489a-a89d-772451bdb87d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:24.973082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e465f190-8f86-489a-a89d-772451bdb87d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:25.105210 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e465f190-8f86-489a-a89d-772451bdb87d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:25.113027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e465f190-8f86-489a-a89d-772451bdb87d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 200 len: 1718 microversion: 2.1 time: 0.153481 Aug 06 13:02:25.113576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1725/3439] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:24 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:25.133961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7a206a33-5c30-4984-871b-c995afdbbbc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '.version_select at 0x7f541f1bf280>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:25.155346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7a206a33-5c30-4984-871b-c995afdbbbc8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207510847" status: 202 len: 0 microversion: 2.1 time: 0.025195 Aug 06 13:02:25.155895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1715/3440] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Aug 6 13:02:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207510847 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:02:25.372829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f89a37bd-61f4-46d4-9b67-03ee2b3e3a34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:25.373426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f89a37bd-61f4-46d4-9b67-03ee2b3e3a34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:25.379229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f89a37bd-61f4-46d4-9b67-03ee2b3e3a34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:25.380238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f89a37bd-61f4-46d4-9b67-03ee2b3e3a34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:25.380691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f89a37bd-61f4-46d4-9b67-03ee2b3e3a34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:25.381368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f89a37bd-61f4-46d4-9b67-03ee2b3e3a34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:25.381815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f89a37bd-61f4-46d4-9b67-03ee2b3e3a34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:25.382235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f89a37bd-61f4-46d4-9b67-03ee2b3e3a34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:25.601141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f89a37bd-61f4-46d4-9b67-03ee2b3e3a34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:25.609343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f89a37bd-61f4-46d4-9b67-03ee2b3e3a34 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.240309 Aug 06 13:02:25.609905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1726/3441] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:26.135800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-1a7e578f-11a3-43ef-99f7-dc72641d34d3 req-4797713a-a11e-4494-93f8-804957a6bd1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe4447d-8246-4c34-8a89-98d7c5ac616c", "tag": "5c5e32b7-d380-492c-b171-a592fe2514b2"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:02:26.149335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-1a7e578f-11a3-43ef-99f7-dc72641d34d3 req-4797713a-a11e-4494-93f8-804957a6bd1a service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:26.149721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-1a7e578f-11a3-43ef-99f7-dc72641d34d3 req-4797713a-a11e-4494-93f8-804957a6bd1a service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:26.150271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-1a7e578f-11a3-43ef-99f7-dc72641d34d3 req-4797713a-a11e-4494-93f8-804957a6bd1a service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:26.161445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-1a7e578f-11a3-43ef-99f7-dc72641d34d3 req-4797713a-a11e-4494-93f8-804957a6bd1a service nova] Creating event network-changed:5c5e32b7-d380-492c-b171-a592fe2514b2 for instance efe4447d-8246-4c34-8a89-98d7c5ac616c on hv-cinder-85199 Aug 06 13:02:26.167635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-1a7e578f-11a3-43ef-99f7-dc72641d34d3 req-4797713a-a11e-4494-93f8-804957a6bd1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035456 Aug 06 13:02:26.168630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1716/3442] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:02:26.300541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-39a9ce09-376f-4442-86fd-4be16fa87c4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Action: 'create', calling method: .version_select at 0x7f541a8f9790>, body: {"keypair": {"name": "tempest-keypair-92887787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHn0LpWe9jUNJ9FiONK2f2ET/eSjP4Zt7Sh/LK5ZNAQk13wyc6nCMwewWPlIf65gvNndNGdzpU6/uHFkSD6pF4OTyjO6n/9zjVLG86YhE2zFKPRSi4UiDpJpnWOl+apFQ=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:02:26.318714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-39a9ce09-376f-4442-86fd-4be16fa87c4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Getting quotas for project 4931a52d9cda40b89d15804b69b5a2d7. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 13:02:26.323030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-39a9ce09-376f-4442-86fd-4be16fa87c4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Getting quotas for user 6844f315435f48f68488a2f0459bf155 and project 4931a52d9cda40b89d15804b69b5a2d7. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 13:02:26.352773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-39a9ce09-376f-4442-86fd-4be16fa87c4a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.055939 Aug 06 13:02:26.353709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1727/3443] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Aug 6 13:02:26 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:02:26.629718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-89538332-4eef-406c-acbd-8373f3946284 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:26.630582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-89538332-4eef-406c-acbd-8373f3946284 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:26.636856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89538332-4eef-406c-acbd-8373f3946284 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:26.637671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89538332-4eef-406c-acbd-8373f3946284 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:26.638301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89538332-4eef-406c-acbd-8373f3946284 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:26.639168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89538332-4eef-406c-acbd-8373f3946284 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:26.639802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89538332-4eef-406c-acbd-8373f3946284 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:26.640248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89538332-4eef-406c-acbd-8373f3946284 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:26.894474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-89538332-4eef-406c-acbd-8373f3946284 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:26.910225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-89538332-4eef-406c-acbd-8373f3946284 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.284310 Aug 06 13:02:26.911472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1717/3444] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:02:27.795817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-10886023", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4607ae07-6111-408a-837d-ad8e0cea7b9c"}], "security_groups": [{"name": "tempest-securitygroup--331879699"}], "key_name": "tempest-keypair-92887787", "user_data": "}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:02:27.898393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] validate_networks() for [('4607ae07-6111-408a-837d-ad8e0cea7b9c', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 13:02:27.932128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0c37701-12a8-4fa8-a0f5-4f3273ce7a49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:27.932768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0c37701-12a8-4fa8-a0f5-4f3273ce7a49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:27.939212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0c37701-12a8-4fa8-a0f5-4f3273ce7a49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:27.939698 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0c37701-12a8-4fa8-a0f5-4f3273ce7a49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:27.940139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0c37701-12a8-4fa8-a0f5-4f3273ce7a49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:27.940858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0c37701-12a8-4fa8-a0f5-4f3273ce7a49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:27.941313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0c37701-12a8-4fa8-a0f5-4f3273ce7a49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:27.941740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0c37701-12a8-4fa8-a0f5-4f3273ce7a49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:28.075055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0c37701-12a8-4fa8-a0f5-4f3273ce7a49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:28.083648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0c37701-12a8-4fa8-a0f5-4f3273ce7a49 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.155411 Aug 06 13:02:28.084212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1718/3445] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:02:28.326192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 13:02:28.326612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 13:02:28.327085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 13:02:28.327488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 13:02:28.327894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 13:02:28.337155 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:28.337627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:28.338054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:28.338775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:28.339222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:28.339642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:28.356017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Getting quotas for project 4931a52d9cda40b89d15804b69b5a2d7. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 13:02:28.359904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Getting quotas for user 6844f315435f48f68488a2f0459bf155 and project 4931a52d9cda40b89d15804b69b5a2d7. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 13:02:28.370732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 13:02:28.372972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 13:02:28.420704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9eb64313-b3c9-4c9f-9c50-5de58946027f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.629615 Aug 06 13:02:28.421347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1728/3446] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 13:02:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 13:02:28.431837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1388502-8448-4cfd-98cd-e1d894ac2722 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:28.432466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b1388502-8448-4cfd-98cd-e1d894ac2722 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:28.484965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b1388502-8448-4cfd-98cd-e1d894ac2722 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:28.491547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b1388502-8448-4cfd-98cd-e1d894ac2722 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1234 microversion: 2.1 time: 0.063451 Aug 06 13:02:28.492213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1719/3447] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:28 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1234 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:29.106026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-68a037b7-66b3-48ff-8f32-93f124394470 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:29.106626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-68a037b7-66b3-48ff-8f32-93f124394470 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:29.113678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68a037b7-66b3-48ff-8f32-93f124394470 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:29.114712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68a037b7-66b3-48ff-8f32-93f124394470 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:29.115142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68a037b7-66b3-48ff-8f32-93f124394470 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:29.115818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68a037b7-66b3-48ff-8f32-93f124394470 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:29.116261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68a037b7-66b3-48ff-8f32-93f124394470 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:29.116706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-68a037b7-66b3-48ff-8f32-93f124394470 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:29.244623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-68a037b7-66b3-48ff-8f32-93f124394470 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:29.252479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-68a037b7-66b3-48ff-8f32-93f124394470 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151091 Aug 06 13:02:29.253036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1729/3448] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:29.511120 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-362ef169-07b2-47c3-95d7-6bdc1d3e1395 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:29.512679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-362ef169-07b2-47c3-95d7-6bdc1d3e1395 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:29.519883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362ef169-07b2-47c3-95d7-6bdc1d3e1395 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:29.520607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362ef169-07b2-47c3-95d7-6bdc1d3e1395 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:29.521045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362ef169-07b2-47c3-95d7-6bdc1d3e1395 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:29.522231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362ef169-07b2-47c3-95d7-6bdc1d3e1395 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:29.522683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362ef169-07b2-47c3-95d7-6bdc1d3e1395 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:29.523104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362ef169-07b2-47c3-95d7-6bdc1d3e1395 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:29.596419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-362ef169-07b2-47c3-95d7-6bdc1d3e1395 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:29.604542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-362ef169-07b2-47c3-95d7-6bdc1d3e1395 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1292 microversion: 2.1 time: 0.097315 Aug 06 13:02:29.605351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1720/3449] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:29 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1292 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:30.273111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-99390181-8c56-410f-a355-06688eb99dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:30.273807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-99390181-8c56-410f-a355-06688eb99dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:30.281238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99390181-8c56-410f-a355-06688eb99dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:30.281721 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99390181-8c56-410f-a355-06688eb99dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:30.282147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99390181-8c56-410f-a355-06688eb99dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:30.282840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99390181-8c56-410f-a355-06688eb99dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:30.283288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99390181-8c56-410f-a355-06688eb99dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:30.283706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-99390181-8c56-410f-a355-06688eb99dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:30.419572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-99390181-8c56-410f-a355-06688eb99dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:30.428433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-99390181-8c56-410f-a355-06688eb99dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.158738 Aug 06 13:02:30.429125 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1730/3450] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:30.624751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b8ab4128-974d-484f-9772-6dc9a52de1ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:30.625351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b8ab4128-974d-484f-9772-6dc9a52de1ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:30.631614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ab4128-974d-484f-9772-6dc9a52de1ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:30.632101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ab4128-974d-484f-9772-6dc9a52de1ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:30.632551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ab4128-974d-484f-9772-6dc9a52de1ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:30.633232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ab4128-974d-484f-9772-6dc9a52de1ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:30.633678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ab4128-974d-484f-9772-6dc9a52de1ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:30.634095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8ab4128-974d-484f-9772-6dc9a52de1ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:30.826900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8ab4128-974d-484f-9772-6dc9a52de1ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:30.834341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b8ab4128-974d-484f-9772-6dc9a52de1ae tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1359 microversion: 2.1 time: 0.213494 Aug 06 13:02:30.835100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1721/3451] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:30 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:30.878927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-6f4f8ac7-727b-4f36-a9be-ddfd8054610a req-1d9ffebc-a15b-4a4e-be80-101c0111a9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6531998f-cbb2-4338-97f5-18cab3aa7ab2", "tag": "ad800de6-b900-499b-94b5-ddc1af8f2ddc"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:02:30.894165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6f4f8ac7-727b-4f36-a9be-ddfd8054610a req-1d9ffebc-a15b-4a4e-be80-101c0111a9d2 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:30.894747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6f4f8ac7-727b-4f36-a9be-ddfd8054610a req-1d9ffebc-a15b-4a4e-be80-101c0111a9d2 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:30.895180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6f4f8ac7-727b-4f36-a9be-ddfd8054610a req-1d9ffebc-a15b-4a4e-be80-101c0111a9d2 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:30.906630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-6f4f8ac7-727b-4f36-a9be-ddfd8054610a req-1d9ffebc-a15b-4a4e-be80-101c0111a9d2 service nova] Creating event network-changed:ad800de6-b900-499b-94b5-ddc1af8f2ddc for instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 on hv-cinder-85199 Aug 06 13:02:30.912943 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-6f4f8ac7-727b-4f36-a9be-ddfd8054610a req-1d9ffebc-a15b-4a4e-be80-101c0111a9d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037045 Aug 06 13:02:30.913533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1731/3452] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:02:31.449289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-813265c0-b8b4-4b69-bbc5-d8937a226b99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:31.449840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-813265c0-b8b4-4b69-bbc5-d8937a226b99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:31.455566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813265c0-b8b4-4b69-bbc5-d8937a226b99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:31.456040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813265c0-b8b4-4b69-bbc5-d8937a226b99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:31.456497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813265c0-b8b4-4b69-bbc5-d8937a226b99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:31.457169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813265c0-b8b4-4b69-bbc5-d8937a226b99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:31.457615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813265c0-b8b4-4b69-bbc5-d8937a226b99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:31.458031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-813265c0-b8b4-4b69-bbc5-d8937a226b99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:31.591564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-813265c0-b8b4-4b69-bbc5-d8937a226b99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:31.599359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-813265c0-b8b4-4b69-bbc5-d8937a226b99 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153949 Aug 06 13:02:31.599915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1722/3453] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:31.856066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c1f0c360-a0c7-47fa-90c7-cc3fe9a554ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:31.856821 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c1f0c360-a0c7-47fa-90c7-cc3fe9a554ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:31.862902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1f0c360-a0c7-47fa-90c7-cc3fe9a554ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:31.863397 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1f0c360-a0c7-47fa-90c7-cc3fe9a554ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:31.863889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1f0c360-a0c7-47fa-90c7-cc3fe9a554ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:31.864643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1f0c360-a0c7-47fa-90c7-cc3fe9a554ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:31.865591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1f0c360-a0c7-47fa-90c7-cc3fe9a554ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:31.866012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c1f0c360-a0c7-47fa-90c7-cc3fe9a554ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:31.998245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c1f0c360-a0c7-47fa-90c7-cc3fe9a554ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:32.005665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c1f0c360-a0c7-47fa-90c7-cc3fe9a554ab tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1359 microversion: 2.1 time: 0.154575 Aug 06 13:02:32.006231 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1732/3454] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:31 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:32.619810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b80e29e0-eefe-4262-a744-37e4e2be2796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:32.620459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b80e29e0-eefe-4262-a744-37e4e2be2796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:32.626854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b80e29e0-eefe-4262-a744-37e4e2be2796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:32.627332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b80e29e0-eefe-4262-a744-37e4e2be2796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:32.627764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b80e29e0-eefe-4262-a744-37e4e2be2796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:32.628475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b80e29e0-eefe-4262-a744-37e4e2be2796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:32.628938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b80e29e0-eefe-4262-a744-37e4e2be2796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:32.629368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b80e29e0-eefe-4262-a744-37e4e2be2796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:32.757339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b80e29e0-eefe-4262-a744-37e4e2be2796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:32.765203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b80e29e0-eefe-4262-a744-37e4e2be2796 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149261 Aug 06 13:02:32.765769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1723/3455] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:33.026711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a29d1855-0b04-42f5-9c81-88070890468f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:33.027319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a29d1855-0b04-42f5-9c81-88070890468f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:33.033738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a29d1855-0b04-42f5-9c81-88070890468f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:33.034216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a29d1855-0b04-42f5-9c81-88070890468f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:33.034647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a29d1855-0b04-42f5-9c81-88070890468f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:33.035323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a29d1855-0b04-42f5-9c81-88070890468f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:33.035776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a29d1855-0b04-42f5-9c81-88070890468f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:33.036194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a29d1855-0b04-42f5-9c81-88070890468f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:33.163648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a29d1855-0b04-42f5-9c81-88070890468f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:33.170917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a29d1855-0b04-42f5-9c81-88070890468f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1359 microversion: 2.1 time: 0.148143 Aug 06 13:02:33.171468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1733/3456] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:33 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:33.787273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-07e7b526-7dc8-4efd-beaf-8634b09de575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:33.787982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-07e7b526-7dc8-4efd-beaf-8634b09de575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:33.793918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07e7b526-7dc8-4efd-beaf-8634b09de575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:33.794402 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07e7b526-7dc8-4efd-beaf-8634b09de575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:33.794838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07e7b526-7dc8-4efd-beaf-8634b09de575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:33.795524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07e7b526-7dc8-4efd-beaf-8634b09de575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:33.795975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07e7b526-7dc8-4efd-beaf-8634b09de575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:33.796420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-07e7b526-7dc8-4efd-beaf-8634b09de575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:33.968596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-07e7b526-7dc8-4efd-beaf-8634b09de575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:33.977091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-07e7b526-7dc8-4efd-beaf-8634b09de575 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.194262 Aug 06 13:02:33.977730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1724/3457] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:34.191178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-269ce375-6d03-456b-99be-ce72180562f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:34.191844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-269ce375-6d03-456b-99be-ce72180562f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:34.200479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269ce375-6d03-456b-99be-ce72180562f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:34.200965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269ce375-6d03-456b-99be-ce72180562f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:34.201392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269ce375-6d03-456b-99be-ce72180562f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:34.202120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269ce375-6d03-456b-99be-ce72180562f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:34.203291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269ce375-6d03-456b-99be-ce72180562f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:34.203291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-269ce375-6d03-456b-99be-ce72180562f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:34.332378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-269ce375-6d03-456b-99be-ce72180562f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:34.340429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-269ce375-6d03-456b-99be-ce72180562f7 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1359 microversion: 2.1 time: 0.153258 Aug 06 13:02:34.341053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1734/3458] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:34 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:34.998043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa741cd9-8a4c-4ddb-bf37-a72438a0bad7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:34.998657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa741cd9-8a4c-4ddb-bf37-a72438a0bad7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:35.005143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa741cd9-8a4c-4ddb-bf37-a72438a0bad7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:35.005808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa741cd9-8a4c-4ddb-bf37-a72438a0bad7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:35.006246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa741cd9-8a4c-4ddb-bf37-a72438a0bad7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:35.006935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa741cd9-8a4c-4ddb-bf37-a72438a0bad7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:35.007388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa741cd9-8a4c-4ddb-bf37-a72438a0bad7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:35.007810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa741cd9-8a4c-4ddb-bf37-a72438a0bad7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:35.131995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fa741cd9-8a4c-4ddb-bf37-a72438a0bad7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:35.139883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa741cd9-8a4c-4ddb-bf37-a72438a0bad7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145621 Aug 06 13:02:35.140405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1725/3459] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:35.361661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2b18546e-847a-477d-b935-54e11743b4cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:35.362261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2b18546e-847a-477d-b935-54e11743b4cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:35.369317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b18546e-847a-477d-b935-54e11743b4cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:35.369801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b18546e-847a-477d-b935-54e11743b4cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:35.370236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b18546e-847a-477d-b935-54e11743b4cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:35.370922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b18546e-847a-477d-b935-54e11743b4cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:35.371377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b18546e-847a-477d-b935-54e11743b4cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:35.371803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b18546e-847a-477d-b935-54e11743b4cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:35.515628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2b18546e-847a-477d-b935-54e11743b4cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:35.525048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2b18546e-847a-477d-b935-54e11743b4cc tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1359 microversion: 2.1 time: 0.167186 Aug 06 13:02:35.526623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1735/3460] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:35 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:36.160255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f5c54157-66d9-4495-af1f-54737be5dea0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:36.160879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f5c54157-66d9-4495-af1f-54737be5dea0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:36.169111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5c54157-66d9-4495-af1f-54737be5dea0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:36.169586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5c54157-66d9-4495-af1f-54737be5dea0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:36.170015 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5c54157-66d9-4495-af1f-54737be5dea0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:36.170690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5c54157-66d9-4495-af1f-54737be5dea0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:36.171136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5c54157-66d9-4495-af1f-54737be5dea0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:36.171554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5c54157-66d9-4495-af1f-54737be5dea0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:36.295374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f5c54157-66d9-4495-af1f-54737be5dea0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:36.303765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f5c54157-66d9-4495-af1f-54737be5dea0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147329 Aug 06 13:02:36.304346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1726/3461] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:36.550319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4db1ca0d-3fc8-4818-ae68-2e27f4ee325f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:36.550932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4db1ca0d-3fc8-4818-ae68-2e27f4ee325f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:36.557903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4db1ca0d-3fc8-4818-ae68-2e27f4ee325f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:36.558389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4db1ca0d-3fc8-4818-ae68-2e27f4ee325f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:36.558829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4db1ca0d-3fc8-4818-ae68-2e27f4ee325f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:36.559518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4db1ca0d-3fc8-4818-ae68-2e27f4ee325f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:36.559972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4db1ca0d-3fc8-4818-ae68-2e27f4ee325f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:36.560425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4db1ca0d-3fc8-4818-ae68-2e27f4ee325f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:36.687623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4db1ca0d-3fc8-4818-ae68-2e27f4ee325f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:36.694905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4db1ca0d-3fc8-4818-ae68-2e27f4ee325f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1359 microversion: 2.1 time: 0.148493 Aug 06 13:02:36.695458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1736/3462] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:36 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:37.324800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-70dc4c2d-94f5-48b7-9d13-ffffafe970c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:37.325417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-70dc4c2d-94f5-48b7-9d13-ffffafe970c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:37.331978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70dc4c2d-94f5-48b7-9d13-ffffafe970c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:37.332604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70dc4c2d-94f5-48b7-9d13-ffffafe970c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:37.333039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70dc4c2d-94f5-48b7-9d13-ffffafe970c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:37.334381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70dc4c2d-94f5-48b7-9d13-ffffafe970c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:37.334828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70dc4c2d-94f5-48b7-9d13-ffffafe970c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:37.335248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70dc4c2d-94f5-48b7-9d13-ffffafe970c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:37.463110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-70dc4c2d-94f5-48b7-9d13-ffffafe970c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:37.470825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-70dc4c2d-94f5-48b7-9d13-ffffafe970c6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149882 Aug 06 13:02:37.471379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1727/3463] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:37 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:37.714518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-78f1c6f3-e482-40e5-810b-ba6f375c66e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:37.715080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-78f1c6f3-e482-40e5-810b-ba6f375c66e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:37.721347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78f1c6f3-e482-40e5-810b-ba6f375c66e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:37.721816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78f1c6f3-e482-40e5-810b-ba6f375c66e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:37.722239 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78f1c6f3-e482-40e5-810b-ba6f375c66e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:37.722908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78f1c6f3-e482-40e5-810b-ba6f375c66e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:37.723349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78f1c6f3-e482-40e5-810b-ba6f375c66e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:37.723763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78f1c6f3-e482-40e5-810b-ba6f375c66e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:37.853192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-78f1c6f3-e482-40e5-810b-ba6f375c66e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:37.861075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-78f1c6f3-e482-40e5-810b-ba6f375c66e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1359 microversion: 2.1 time: 0.150426 Aug 06 13:02:37.861769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1737/3464] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:37 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:37.995118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-dda538fa-f9c9-4439-9df3-31f9c90af6cd req-44ff8876-69bc-4e88-98b7-f434f9a40d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6531998f-cbb2-4338-97f5-18cab3aa7ab2", "name": "network-vif-plugged", "status": "completed", "tag": "ad800de6-b900-499b-94b5-ddc1af8f2ddc"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:02:38.008350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-dda538fa-f9c9-4439-9df3-31f9c90af6cd req-44ff8876-69bc-4e88-98b7-f434f9a40d76 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:38.008350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-dda538fa-f9c9-4439-9df3-31f9c90af6cd req-44ff8876-69bc-4e88-98b7-f434f9a40d76 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:38.008350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-dda538fa-f9c9-4439-9df3-31f9c90af6cd req-44ff8876-69bc-4e88-98b7-f434f9a40d76 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:38.019695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-dda538fa-f9c9-4439-9df3-31f9c90af6cd req-44ff8876-69bc-4e88-98b7-f434f9a40d76 service nova] Creating event network-vif-plugged:ad800de6-b900-499b-94b5-ddc1af8f2ddc for instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 on hv-cinder-85199 Aug 06 13:02:38.024839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-dda538fa-f9c9-4439-9df3-31f9c90af6cd req-44ff8876-69bc-4e88-98b7-f434f9a40d76 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035149 Aug 06 13:02:38.025541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1728/3465] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:02:38.491219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-552354b9-4078-4341-9e86-cb1fe6a46248 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:38.491910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-552354b9-4078-4341-9e86-cb1fe6a46248 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:38.493971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:38.494633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=10 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:38.500571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-552354b9-4078-4341-9e86-cb1fe6a46248 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:38.501052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-552354b9-4078-4341-9e86-cb1fe6a46248 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:38.501510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-552354b9-4078-4341-9e86-cb1fe6a46248 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:38.502194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-552354b9-4078-4341-9e86-cb1fe6a46248 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:38.502648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-552354b9-4078-4341-9e86-cb1fe6a46248 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:38.503077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-552354b9-4078-4341-9e86-cb1fe6a46248 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:38.632914 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-552354b9-4078-4341-9e86-cb1fe6a46248 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:38.641837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-552354b9-4078-4341-9e86-cb1fe6a46248 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154464 Aug 06 13:02:38.642409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1738/3466] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:38.880761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:38.885577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e2f8738d-0cc3-4c66-8dd2-7b044b17b2e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:38.886307 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e2f8738d-0cc3-4c66-8dd2-7b044b17b2e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:38.892911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2f8738d-0cc3-4c66-8dd2-7b044b17b2e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:38.893632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2f8738d-0cc3-4c66-8dd2-7b044b17b2e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:38.894065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2f8738d-0cc3-4c66-8dd2-7b044b17b2e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:38.894752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2f8738d-0cc3-4c66-8dd2-7b044b17b2e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:38.895205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2f8738d-0cc3-4c66-8dd2-7b044b17b2e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:38.895626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2f8738d-0cc3-4c66-8dd2-7b044b17b2e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:39.032675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e2f8738d-0cc3-4c66-8dd2-7b044b17b2e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:39.040243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e2f8738d-0cc3-4c66-8dd2-7b044b17b2e0 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1359 microversion: 2.1 time: 0.160893 Aug 06 13:02:39.040842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1729/3467] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:38 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:39.663269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b65e32ac-f3e7-4053-9934-b2daf4ce17f8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:39.663839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b65e32ac-f3e7-4053-9934-b2daf4ce17f8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:39.670185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b65e32ac-f3e7-4053-9934-b2daf4ce17f8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:39.670661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b65e32ac-f3e7-4053-9934-b2daf4ce17f8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:39.671091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b65e32ac-f3e7-4053-9934-b2daf4ce17f8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:39.671768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b65e32ac-f3e7-4053-9934-b2daf4ce17f8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:39.672219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b65e32ac-f3e7-4053-9934-b2daf4ce17f8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:39.672667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b65e32ac-f3e7-4053-9934-b2daf4ce17f8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:39.802550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b65e32ac-f3e7-4053-9934-b2daf4ce17f8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:39.811108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b65e32ac-f3e7-4053-9934-b2daf4ce17f8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152210 Aug 06 13:02:39.811663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1739/3468] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:40.060662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f5039b50-70b6-4b8e-b821-35a543105638 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:40.061290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f5039b50-70b6-4b8e-b821-35a543105638 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:40.067872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5039b50-70b6-4b8e-b821-35a543105638 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:40.068453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5039b50-70b6-4b8e-b821-35a543105638 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:40.068891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5039b50-70b6-4b8e-b821-35a543105638 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:40.069579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5039b50-70b6-4b8e-b821-35a543105638 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:40.070033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5039b50-70b6-4b8e-b821-35a543105638 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:40.070456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5039b50-70b6-4b8e-b821-35a543105638 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:40.196587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f5039b50-70b6-4b8e-b821-35a543105638 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:40.203828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f5039b50-70b6-4b8e-b821-35a543105638 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1359 microversion: 2.1 time: 0.146975 Aug 06 13:02:40.204407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1730/3469] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:40 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:40.831987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aa7eaff2-1cd1-49b9-81c1-b3c801ebce01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:40.832626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aa7eaff2-1cd1-49b9-81c1-b3c801ebce01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:40.838924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa7eaff2-1cd1-49b9-81c1-b3c801ebce01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:40.839403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa7eaff2-1cd1-49b9-81c1-b3c801ebce01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:40.839839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa7eaff2-1cd1-49b9-81c1-b3c801ebce01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:40.840546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa7eaff2-1cd1-49b9-81c1-b3c801ebce01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:40.841002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa7eaff2-1cd1-49b9-81c1-b3c801ebce01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:40.841423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aa7eaff2-1cd1-49b9-81c1-b3c801ebce01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:40.972430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aa7eaff2-1cd1-49b9-81c1-b3c801ebce01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:40.975126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:40.982290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aa7eaff2-1cd1-49b9-81c1-b3c801ebce01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154178 Aug 06 13:02:40.982854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1740/3470] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:41.225277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e2789823-5372-4d03-a215-3c33928b6484 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:41.225842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e2789823-5372-4d03-a215-3c33928b6484 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:41.228062 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:41.233421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2789823-5372-4d03-a215-3c33928b6484 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:41.233896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2789823-5372-4d03-a215-3c33928b6484 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:41.234325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2789823-5372-4d03-a215-3c33928b6484 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:41.235005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2789823-5372-4d03-a215-3c33928b6484 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:41.235453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2789823-5372-4d03-a215-3c33928b6484 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:41.235871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2789823-5372-4d03-a215-3c33928b6484 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:41.370309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e2789823-5372-4d03-a215-3c33928b6484 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:41.377654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e2789823-5372-4d03-a215-3c33928b6484 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1545 microversion: 2.1 time: 0.156866 Aug 06 13:02:41.378212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1731/3471] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:41 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1545 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:41.400447 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1f71af76-b070-4d67-bb52-658f2278fd55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:41.400934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f71af76-b070-4d67-bb52-658f2278fd55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:41.407092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f71af76-b070-4d67-bb52-658f2278fd55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:41.407565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f71af76-b070-4d67-bb52-658f2278fd55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:41.407992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f71af76-b070-4d67-bb52-658f2278fd55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:41.408705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f71af76-b070-4d67-bb52-658f2278fd55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:41.409152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f71af76-b070-4d67-bb52-658f2278fd55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:41.409571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f71af76-b070-4d67-bb52-658f2278fd55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:41.485703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1f71af76-b070-4d67-bb52-658f2278fd55 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092090 Aug 06 13:02:41.486303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1741/3472] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Aug 6 13:02:41 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:02:42.004251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a6dcc79a-10b4-418a-9add-23dcf6d7c788 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:42.005017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a6dcc79a-10b4-418a-9add-23dcf6d7c788 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:42.011967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6dcc79a-10b4-418a-9add-23dcf6d7c788 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:42.012490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6dcc79a-10b4-418a-9add-23dcf6d7c788 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:42.012918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6dcc79a-10b4-418a-9add-23dcf6d7c788 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:42.013765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6dcc79a-10b4-418a-9add-23dcf6d7c788 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:42.014213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6dcc79a-10b4-418a-9add-23dcf6d7c788 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:42.014634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6dcc79a-10b4-418a-9add-23dcf6d7c788 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:42.149346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a6dcc79a-10b4-418a-9add-23dcf6d7c788 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:42.151535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:42.158441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a6dcc79a-10b4-418a-9add-23dcf6d7c788 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.159256 Aug 06 13:02:42.159004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1732/3473] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:41 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:42.617142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-df16e132-7cc5-408e-9575-811c6b644515 req-8242a901-64ba-4b4b-b695-4ef438077516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6531998f-cbb2-4338-97f5-18cab3aa7ab2", "tag": "ad800de6-b900-499b-94b5-ddc1af8f2ddc"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:02:42.626340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-df16e132-7cc5-408e-9575-811c6b644515 req-8242a901-64ba-4b4b-b695-4ef438077516 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:42.626806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-df16e132-7cc5-408e-9575-811c6b644515 req-8242a901-64ba-4b4b-b695-4ef438077516 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:42.627227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-df16e132-7cc5-408e-9575-811c6b644515 req-8242a901-64ba-4b4b-b695-4ef438077516 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:42.637872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-df16e132-7cc5-408e-9575-811c6b644515 req-8242a901-64ba-4b4b-b695-4ef438077516 service nova] Creating event network-changed:ad800de6-b900-499b-94b5-ddc1af8f2ddc for instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 on hv-cinder-85199 Aug 06 13:02:42.642946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-df16e132-7cc5-408e-9575-811c6b644515 req-8242a901-64ba-4b4b-b695-4ef438077516 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030648 Aug 06 13:02:42.643536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1742/3474] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:02:43.179422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4a5dd532-4b6c-4beb-a686-53d12c86cc4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:43.180037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4a5dd532-4b6c-4beb-a686-53d12c86cc4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:43.186669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a5dd532-4b6c-4beb-a686-53d12c86cc4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:43.187167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a5dd532-4b6c-4beb-a686-53d12c86cc4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:43.187609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a5dd532-4b6c-4beb-a686-53d12c86cc4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:43.188333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a5dd532-4b6c-4beb-a686-53d12c86cc4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:43.188792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a5dd532-4b6c-4beb-a686-53d12c86cc4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:43.189219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a5dd532-4b6c-4beb-a686-53d12c86cc4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:43.324998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4a5dd532-4b6c-4beb-a686-53d12c86cc4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:43.332999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4a5dd532-4b6c-4beb-a686-53d12c86cc4c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.157412 Aug 06 13:02:43.333632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1733/3475] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:44.356273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8144ea28-fed9-430a-809a-1cf2ab5533f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:44.356980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8144ea28-fed9-430a-809a-1cf2ab5533f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:44.358886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:02:44.364195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8144ea28-fed9-430a-809a-1cf2ab5533f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:44.364690 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8144ea28-fed9-430a-809a-1cf2ab5533f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:44.365163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8144ea28-fed9-430a-809a-1cf2ab5533f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:44.365835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8144ea28-fed9-430a-809a-1cf2ab5533f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:44.366304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8144ea28-fed9-430a-809a-1cf2ab5533f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:44.366719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8144ea28-fed9-430a-809a-1cf2ab5533f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:44.494103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8144ea28-fed9-430a-809a-1cf2ab5533f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:44.502211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8144ea28-fed9-430a-809a-1cf2ab5533f2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151483 Aug 06 13:02:44.502766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1743/3476] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:45.522506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f68c9860-cdbc-4b85-828b-cbb1ab3a06ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:45.523113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f68c9860-cdbc-4b85-828b-cbb1ab3a06ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:45.529535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f68c9860-cdbc-4b85-828b-cbb1ab3a06ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:45.530014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f68c9860-cdbc-4b85-828b-cbb1ab3a06ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:45.530450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f68c9860-cdbc-4b85-828b-cbb1ab3a06ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:45.531132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f68c9860-cdbc-4b85-828b-cbb1ab3a06ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:45.531586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f68c9860-cdbc-4b85-828b-cbb1ab3a06ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:45.532008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f68c9860-cdbc-4b85-828b-cbb1ab3a06ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:45.657448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f68c9860-cdbc-4b85-828b-cbb1ab3a06ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:45.665697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f68c9860-cdbc-4b85-828b-cbb1ab3a06ed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147142 Aug 06 13:02:45.666256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1734/3477] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:46.687066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-42e83758-e395-46b1-a1ed-0cf0ff599029 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:46.687654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-42e83758-e395-46b1-a1ed-0cf0ff599029 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:46.694459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42e83758-e395-46b1-a1ed-0cf0ff599029 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:46.694946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42e83758-e395-46b1-a1ed-0cf0ff599029 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:46.695380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42e83758-e395-46b1-a1ed-0cf0ff599029 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:46.696061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42e83758-e395-46b1-a1ed-0cf0ff599029 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:46.696546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42e83758-e395-46b1-a1ed-0cf0ff599029 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:46.696973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42e83758-e395-46b1-a1ed-0cf0ff599029 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:46.821687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-42e83758-e395-46b1-a1ed-0cf0ff599029 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:46.829534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-42e83758-e395-46b1-a1ed-0cf0ff599029 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146355 Aug 06 13:02:46.830100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1744/3478] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:47.850853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5bbf8b47-7f66-4c45-bc95-191aefa79e77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:47.851396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5bbf8b47-7f66-4c45-bc95-191aefa79e77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:47.857988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bbf8b47-7f66-4c45-bc95-191aefa79e77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:47.858457 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bbf8b47-7f66-4c45-bc95-191aefa79e77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:47.858884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bbf8b47-7f66-4c45-bc95-191aefa79e77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:47.859554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bbf8b47-7f66-4c45-bc95-191aefa79e77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:47.859998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bbf8b47-7f66-4c45-bc95-191aefa79e77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:47.860447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bbf8b47-7f66-4c45-bc95-191aefa79e77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:48.029512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5bbf8b47-7f66-4c45-bc95-191aefa79e77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:48.037391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5bbf8b47-7f66-4c45-bc95-191aefa79e77 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.190551 Aug 06 13:02:48.037950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1735/3479] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:49.058018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5d2de471-5575-43c6-bc6b-7042e4b29211 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:49.058622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5d2de471-5575-43c6-bc6b-7042e4b29211 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:49.065081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d2de471-5575-43c6-bc6b-7042e4b29211 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:49.065562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d2de471-5575-43c6-bc6b-7042e4b29211 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:49.065996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d2de471-5575-43c6-bc6b-7042e4b29211 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:49.066673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d2de471-5575-43c6-bc6b-7042e4b29211 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:49.067121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d2de471-5575-43c6-bc6b-7042e4b29211 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:49.067542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d2de471-5575-43c6-bc6b-7042e4b29211 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:49.245878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5d2de471-5575-43c6-bc6b-7042e4b29211 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:49.254113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5d2de471-5575-43c6-bc6b-7042e4b29211 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.199935 Aug 06 13:02:49.254665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1745/3480] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:50.275255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-478cabf7-5842-4ce5-b582-5eecb6cce39d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:50.275840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-478cabf7-5842-4ce5-b582-5eecb6cce39d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:50.282176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-478cabf7-5842-4ce5-b582-5eecb6cce39d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:50.282673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-478cabf7-5842-4ce5-b582-5eecb6cce39d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:50.283098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-478cabf7-5842-4ce5-b582-5eecb6cce39d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:50.283768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-478cabf7-5842-4ce5-b582-5eecb6cce39d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:50.284213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-478cabf7-5842-4ce5-b582-5eecb6cce39d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:50.284726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-478cabf7-5842-4ce5-b582-5eecb6cce39d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:50.671764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-478cabf7-5842-4ce5-b582-5eecb6cce39d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:50.679750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-478cabf7-5842-4ce5-b582-5eecb6cce39d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.408442 Aug 06 13:02:50.680329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1736/3481] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:51.700879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ed2a606-7b52-4c20-887d-c0eac0b20232 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:51.701481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2ed2a606-7b52-4c20-887d-c0eac0b20232 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:51.707839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed2a606-7b52-4c20-887d-c0eac0b20232 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:51.708327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed2a606-7b52-4c20-887d-c0eac0b20232 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:51.708778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed2a606-7b52-4c20-887d-c0eac0b20232 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:51.709457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed2a606-7b52-4c20-887d-c0eac0b20232 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:51.709908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed2a606-7b52-4c20-887d-c0eac0b20232 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:51.710330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ed2a606-7b52-4c20-887d-c0eac0b20232 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:51.837267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2ed2a606-7b52-4c20-887d-c0eac0b20232 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:51.845100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2ed2a606-7b52-4c20-887d-c0eac0b20232 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148066 Aug 06 13:02:51.845653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1746/3482] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:52.867375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-508bcdaa-189c-4a4f-b3eb-3921c18dabf4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:52.867980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-508bcdaa-189c-4a4f-b3eb-3921c18dabf4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:52.874443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508bcdaa-189c-4a4f-b3eb-3921c18dabf4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:52.874867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508bcdaa-189c-4a4f-b3eb-3921c18dabf4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:52.875300 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508bcdaa-189c-4a4f-b3eb-3921c18dabf4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:52.875991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508bcdaa-189c-4a4f-b3eb-3921c18dabf4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:52.876547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508bcdaa-189c-4a4f-b3eb-3921c18dabf4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:52.876969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508bcdaa-189c-4a4f-b3eb-3921c18dabf4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:53.004476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-508bcdaa-189c-4a4f-b3eb-3921c18dabf4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:53.013965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-508bcdaa-189c-4a4f-b3eb-3921c18dabf4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151146 Aug 06 13:02:53.014533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1737/3483] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:54.034525 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4296f54f-69e9-4992-b770-2069297e7023 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:54.035122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4296f54f-69e9-4992-b770-2069297e7023 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:54.041443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4296f54f-69e9-4992-b770-2069297e7023 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:54.041919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4296f54f-69e9-4992-b770-2069297e7023 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:54.042348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4296f54f-69e9-4992-b770-2069297e7023 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:54.043019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4296f54f-69e9-4992-b770-2069297e7023 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:54.043466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4296f54f-69e9-4992-b770-2069297e7023 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:54.043886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4296f54f-69e9-4992-b770-2069297e7023 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:54.173849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4296f54f-69e9-4992-b770-2069297e7023 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:54.182121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4296f54f-69e9-4992-b770-2069297e7023 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151439 Aug 06 13:02:54.182676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1747/3484] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:55.203322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-290da828-b870-400f-8a2d-16060fb41e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:55.203929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-290da828-b870-400f-8a2d-16060fb41e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:55.210911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290da828-b870-400f-8a2d-16060fb41e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:55.211391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290da828-b870-400f-8a2d-16060fb41e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:55.211828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290da828-b870-400f-8a2d-16060fb41e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:55.212536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290da828-b870-400f-8a2d-16060fb41e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:55.212988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290da828-b870-400f-8a2d-16060fb41e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:55.213416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-290da828-b870-400f-8a2d-16060fb41e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:55.339418 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-290da828-b870-400f-8a2d-16060fb41e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:55.347293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-290da828-b870-400f-8a2d-16060fb41e6e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147842 Aug 06 13:02:55.347854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1738/3485] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:55 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:56.367412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9c07354a-eee3-40cf-9573-35b0c52f7f51 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:56.368040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9c07354a-eee3-40cf-9573-35b0c52f7f51 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:56.374450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c07354a-eee3-40cf-9573-35b0c52f7f51 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:56.374927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c07354a-eee3-40cf-9573-35b0c52f7f51 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:56.375354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c07354a-eee3-40cf-9573-35b0c52f7f51 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:56.376028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c07354a-eee3-40cf-9573-35b0c52f7f51 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:56.376504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c07354a-eee3-40cf-9573-35b0c52f7f51 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:56.376925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c07354a-eee3-40cf-9573-35b0c52f7f51 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:56.506356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9c07354a-eee3-40cf-9573-35b0c52f7f51 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:56.514195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9c07354a-eee3-40cf-9573-35b0c52f7f51 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150689 Aug 06 13:02:56.514756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1748/3486] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:57.535440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d6aab611-490d-4c9c-919b-c13482f83a0b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:57.536054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d6aab611-490d-4c9c-919b-c13482f83a0b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:57.543064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6aab611-490d-4c9c-919b-c13482f83a0b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:57.543545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6aab611-490d-4c9c-919b-c13482f83a0b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:57.543984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6aab611-490d-4c9c-919b-c13482f83a0b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:57.544696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6aab611-490d-4c9c-919b-c13482f83a0b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:57.545152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6aab611-490d-4c9c-919b-c13482f83a0b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:57.545579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6aab611-490d-4c9c-919b-c13482f83a0b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:57.670475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d6aab611-490d-4c9c-919b-c13482f83a0b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:57.678862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d6aab611-490d-4c9c-919b-c13482f83a0b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147236 Aug 06 13:02:57.679424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1739/3487] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:58.699571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1171e854-3d3e-467e-a4cd-a2ecb7ff32d5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:58.700181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1171e854-3d3e-467e-a4cd-a2ecb7ff32d5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:58.706455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1171e854-3d3e-467e-a4cd-a2ecb7ff32d5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:58.706927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1171e854-3d3e-467e-a4cd-a2ecb7ff32d5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:58.707354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1171e854-3d3e-467e-a4cd-a2ecb7ff32d5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:58.708033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1171e854-3d3e-467e-a4cd-a2ecb7ff32d5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:58.708559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1171e854-3d3e-467e-a4cd-a2ecb7ff32d5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:58.708979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1171e854-3d3e-467e-a4cd-a2ecb7ff32d5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:58.836638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1171e854-3d3e-467e-a4cd-a2ecb7ff32d5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:02:58.844446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1171e854-3d3e-467e-a4cd-a2ecb7ff32d5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148704 Aug 06 13:02:58.845005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1749/3488] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:02:59.865496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38d3061a-6c96-40e8-8882-6db957326b20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:02:59.866072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38d3061a-6c96-40e8-8882-6db957326b20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:02:59.872517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38d3061a-6c96-40e8-8882-6db957326b20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:59.872997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38d3061a-6c96-40e8-8882-6db957326b20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:59.873432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38d3061a-6c96-40e8-8882-6db957326b20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:02:59.874119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38d3061a-6c96-40e8-8882-6db957326b20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:02:59.874570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38d3061a-6c96-40e8-8882-6db957326b20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:02:59.875026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38d3061a-6c96-40e8-8882-6db957326b20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:00.007134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-38d3061a-6c96-40e8-8882-6db957326b20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:00.014980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38d3061a-6c96-40e8-8882-6db957326b20 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153435 Aug 06 13:03:00.015537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1740/3489] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:02:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:01.037213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ff07e3e3-806e-48d3-8e12-43a02ba5d30c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:01.037844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ff07e3e3-806e-48d3-8e12-43a02ba5d30c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:01.044199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff07e3e3-806e-48d3-8e12-43a02ba5d30c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:01.044703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff07e3e3-806e-48d3-8e12-43a02ba5d30c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:01.045130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff07e3e3-806e-48d3-8e12-43a02ba5d30c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:01.045801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff07e3e3-806e-48d3-8e12-43a02ba5d30c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:01.046245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff07e3e3-806e-48d3-8e12-43a02ba5d30c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:01.046660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff07e3e3-806e-48d3-8e12-43a02ba5d30c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:01.174793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ff07e3e3-806e-48d3-8e12-43a02ba5d30c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:01.182672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ff07e3e3-806e-48d3-8e12-43a02ba5d30c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150043 Aug 06 13:03:01.183229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1750/3490] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:01 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:02.202981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a1b80d71-dbf6-44ac-b93f-a33c557bf59b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:02.203587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a1b80d71-dbf6-44ac-b93f-a33c557bf59b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:02.210068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1b80d71-dbf6-44ac-b93f-a33c557bf59b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:02.210541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1b80d71-dbf6-44ac-b93f-a33c557bf59b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:02.210974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1b80d71-dbf6-44ac-b93f-a33c557bf59b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:02.211651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1b80d71-dbf6-44ac-b93f-a33c557bf59b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:02.212101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1b80d71-dbf6-44ac-b93f-a33c557bf59b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:02.212552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1b80d71-dbf6-44ac-b93f-a33c557bf59b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:02.337772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a1b80d71-dbf6-44ac-b93f-a33c557bf59b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:02.345708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a1b80d71-dbf6-44ac-b93f-a33c557bf59b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146601 Aug 06 13:03:02.346275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1741/3491] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:02 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:03.367761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-84754929-7ae0-4379-8e97-1b9cd7d1a853 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:03.368408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-84754929-7ae0-4379-8e97-1b9cd7d1a853 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:03.374866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84754929-7ae0-4379-8e97-1b9cd7d1a853 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:03.375343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84754929-7ae0-4379-8e97-1b9cd7d1a853 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:03.375775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84754929-7ae0-4379-8e97-1b9cd7d1a853 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:03.376497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84754929-7ae0-4379-8e97-1b9cd7d1a853 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:03.376949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84754929-7ae0-4379-8e97-1b9cd7d1a853 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:03.377372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84754929-7ae0-4379-8e97-1b9cd7d1a853 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:03.503275 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-84754929-7ae0-4379-8e97-1b9cd7d1a853 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:03.511110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-84754929-7ae0-4379-8e97-1b9cd7d1a853 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147746 Aug 06 13:03:03.511673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1751/3492] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:04.535641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a445549a-21c2-4854-a01c-dcd6708cd8a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:04.536876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a445549a-21c2-4854-a01c-dcd6708cd8a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:04.543678 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a445549a-21c2-4854-a01c-dcd6708cd8a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:04.544165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a445549a-21c2-4854-a01c-dcd6708cd8a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:04.544636 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a445549a-21c2-4854-a01c-dcd6708cd8a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:04.545768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a445549a-21c2-4854-a01c-dcd6708cd8a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:04.546614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a445549a-21c2-4854-a01c-dcd6708cd8a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:04.547422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a445549a-21c2-4854-a01c-dcd6708cd8a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:04.672961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a445549a-21c2-4854-a01c-dcd6708cd8a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:04.681245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a445549a-21c2-4854-a01c-dcd6708cd8a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153243 Aug 06 13:03:04.681810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1742/3493] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:05.702141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-72b7fe1c-119f-4e33-a114-6ac59bd8517c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:05.702675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-72b7fe1c-119f-4e33-a114-6ac59bd8517c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:05.709673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72b7fe1c-119f-4e33-a114-6ac59bd8517c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:05.710158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72b7fe1c-119f-4e33-a114-6ac59bd8517c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:05.710588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72b7fe1c-119f-4e33-a114-6ac59bd8517c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:05.711265 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72b7fe1c-119f-4e33-a114-6ac59bd8517c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:05.711714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72b7fe1c-119f-4e33-a114-6ac59bd8517c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:05.712132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72b7fe1c-119f-4e33-a114-6ac59bd8517c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:05.858119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-72b7fe1c-119f-4e33-a114-6ac59bd8517c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:05.866146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-72b7fe1c-119f-4e33-a114-6ac59bd8517c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.167855 Aug 06 13:03:05.866826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1752/3494] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:06.888204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-82033879-ebd1-42f9-90e8-c2dfc1e4c569 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:06.888843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-82033879-ebd1-42f9-90e8-c2dfc1e4c569 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:06.895398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82033879-ebd1-42f9-90e8-c2dfc1e4c569 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:06.895875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82033879-ebd1-42f9-90e8-c2dfc1e4c569 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:06.896324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82033879-ebd1-42f9-90e8-c2dfc1e4c569 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:06.897007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82033879-ebd1-42f9-90e8-c2dfc1e4c569 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:06.897461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82033879-ebd1-42f9-90e8-c2dfc1e4c569 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:06.897883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82033879-ebd1-42f9-90e8-c2dfc1e4c569 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:07.030913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-82033879-ebd1-42f9-90e8-c2dfc1e4c569 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:07.038777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-82033879-ebd1-42f9-90e8-c2dfc1e4c569 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154402 Aug 06 13:03:07.039349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1743/3495] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:08.059815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b975f83e-4b7e-4a32-8d69-d0c1c34243ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:08.060455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b975f83e-4b7e-4a32-8d69-d0c1c34243ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:08.066887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b975f83e-4b7e-4a32-8d69-d0c1c34243ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:08.067858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b975f83e-4b7e-4a32-8d69-d0c1c34243ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:08.068292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b975f83e-4b7e-4a32-8d69-d0c1c34243ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:08.069000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b975f83e-4b7e-4a32-8d69-d0c1c34243ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:08.069451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b975f83e-4b7e-4a32-8d69-d0c1c34243ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:08.069874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b975f83e-4b7e-4a32-8d69-d0c1c34243ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:08.198448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b975f83e-4b7e-4a32-8d69-d0c1c34243ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:08.206295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b975f83e-4b7e-4a32-8d69-d0c1c34243ff tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150326 Aug 06 13:03:08.206856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1753/3496] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:08 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:09.227507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9fe7e7f7-3b9c-42ca-835d-5c8c5367ea9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:09.228119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9fe7e7f7-3b9c-42ca-835d-5c8c5367ea9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:09.234480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fe7e7f7-3b9c-42ca-835d-5c8c5367ea9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:09.234959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fe7e7f7-3b9c-42ca-835d-5c8c5367ea9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:09.235393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fe7e7f7-3b9c-42ca-835d-5c8c5367ea9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:09.236071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fe7e7f7-3b9c-42ca-835d-5c8c5367ea9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:09.236546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fe7e7f7-3b9c-42ca-835d-5c8c5367ea9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:09.236970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fe7e7f7-3b9c-42ca-835d-5c8c5367ea9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:09.363999 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9fe7e7f7-3b9c-42ca-835d-5c8c5367ea9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:09.371851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9fe7e7f7-3b9c-42ca-835d-5c8c5367ea9d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148757 Aug 06 13:03:09.372451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1744/3497] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:09 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:10.391818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f5120c0a-21cb-4b55-bfb4-27d6960c6bd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:10.392463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f5120c0a-21cb-4b55-bfb4-27d6960c6bd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:10.398865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5120c0a-21cb-4b55-bfb4-27d6960c6bd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:10.399340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5120c0a-21cb-4b55-bfb4-27d6960c6bd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:10.399774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5120c0a-21cb-4b55-bfb4-27d6960c6bd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:10.400573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5120c0a-21cb-4b55-bfb4-27d6960c6bd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:10.401036 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5120c0a-21cb-4b55-bfb4-27d6960c6bd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:10.401458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5120c0a-21cb-4b55-bfb4-27d6960c6bd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:10.528822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f5120c0a-21cb-4b55-bfb4-27d6960c6bd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:10.537190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f5120c0a-21cb-4b55-bfb4-27d6960c6bd8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149198 Aug 06 13:03:10.537758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1754/3498] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:11.558362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8370ac75-c6ad-4e46-9134-d719c4d9ed24 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:11.558952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8370ac75-c6ad-4e46-9134-d719c4d9ed24 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:11.561272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=28 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:03:11.566514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8370ac75-c6ad-4e46-9134-d719c4d9ed24 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:11.567595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8370ac75-c6ad-4e46-9134-d719c4d9ed24 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:11.568031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8370ac75-c6ad-4e46-9134-d719c4d9ed24 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:11.568743 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8370ac75-c6ad-4e46-9134-d719c4d9ed24 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:11.569195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8370ac75-c6ad-4e46-9134-d719c4d9ed24 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:11.569615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8370ac75-c6ad-4e46-9134-d719c4d9ed24 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:11.697575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8370ac75-c6ad-4e46-9134-d719c4d9ed24 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:11.705366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8370ac75-c6ad-4e46-9134-d719c4d9ed24 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150951 Aug 06 13:03:11.705917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1745/3499] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:12.726208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0901c98f-a28e-4061-a709-6d4667c18ed1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:12.726813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0901c98f-a28e-4061-a709-6d4667c18ed1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:12.733519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0901c98f-a28e-4061-a709-6d4667c18ed1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:12.733991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0901c98f-a28e-4061-a709-6d4667c18ed1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:12.734419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0901c98f-a28e-4061-a709-6d4667c18ed1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:12.735093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0901c98f-a28e-4061-a709-6d4667c18ed1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:12.735536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0901c98f-a28e-4061-a709-6d4667c18ed1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:12.735949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0901c98f-a28e-4061-a709-6d4667c18ed1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:12.738448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=80 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:03:12.862428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0901c98f-a28e-4061-a709-6d4667c18ed1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:12.871211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0901c98f-a28e-4061-a709-6d4667c18ed1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149003 Aug 06 13:03:12.871771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1755/3500] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:13.892634 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6291b072-7426-4d54-8af5-7bc7c164eb45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:13.893029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6291b072-7426-4d54-8af5-7bc7c164eb45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:13.899952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6291b072-7426-4d54-8af5-7bc7c164eb45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:13.900456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6291b072-7426-4d54-8af5-7bc7c164eb45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:13.900886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6291b072-7426-4d54-8af5-7bc7c164eb45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:13.901558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6291b072-7426-4d54-8af5-7bc7c164eb45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:13.902005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6291b072-7426-4d54-8af5-7bc7c164eb45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:13.902421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6291b072-7426-4d54-8af5-7bc7c164eb45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:13.904911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=80 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:03:14.028922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6291b072-7426-4d54-8af5-7bc7c164eb45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:14.036835 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6291b072-7426-4d54-8af5-7bc7c164eb45 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148306 Aug 06 13:03:14.037400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1746/3501] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:15.057481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-966b9a88-76d0-43d4-948f-38762f036db3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:15.058106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-966b9a88-76d0-43d4-948f-38762f036db3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:15.060444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=26 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:03:15.065973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-966b9a88-76d0-43d4-948f-38762f036db3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:15.066444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-966b9a88-76d0-43d4-948f-38762f036db3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:15.067361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-966b9a88-76d0-43d4-948f-38762f036db3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:15.068031 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-966b9a88-76d0-43d4-948f-38762f036db3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:15.068507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-966b9a88-76d0-43d4-948f-38762f036db3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:15.068928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-966b9a88-76d0-43d4-948f-38762f036db3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:15.197529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-966b9a88-76d0-43d4-948f-38762f036db3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:15.205415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-966b9a88-76d0-43d4-948f-38762f036db3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151786 Aug 06 13:03:15.205969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1756/3502] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:15 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:16.226306 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e0ad51cf-31b3-4155-9ac5-bd0ee5714c2f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:16.226915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e0ad51cf-31b3-4155-9ac5-bd0ee5714c2f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:16.233597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0ad51cf-31b3-4155-9ac5-bd0ee5714c2f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:16.234075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0ad51cf-31b3-4155-9ac5-bd0ee5714c2f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:16.234509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0ad51cf-31b3-4155-9ac5-bd0ee5714c2f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:16.235195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0ad51cf-31b3-4155-9ac5-bd0ee5714c2f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:16.235651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0ad51cf-31b3-4155-9ac5-bd0ee5714c2f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:16.236078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0ad51cf-31b3-4155-9ac5-bd0ee5714c2f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:16.360670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e0ad51cf-31b3-4155-9ac5-bd0ee5714c2f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:16.368635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e0ad51cf-31b3-4155-9ac5-bd0ee5714c2f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146219 Aug 06 13:03:16.369202 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1747/3503] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:16 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:17.390027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-be5b626b-beeb-4829-9fa3-7b89cb99f9af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:17.390659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-be5b626b-beeb-4829-9fa3-7b89cb99f9af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:17.397086 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be5b626b-beeb-4829-9fa3-7b89cb99f9af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:17.397557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be5b626b-beeb-4829-9fa3-7b89cb99f9af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:17.397989 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be5b626b-beeb-4829-9fa3-7b89cb99f9af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:17.398664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be5b626b-beeb-4829-9fa3-7b89cb99f9af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:17.399114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be5b626b-beeb-4829-9fa3-7b89cb99f9af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:17.399535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be5b626b-beeb-4829-9fa3-7b89cb99f9af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:17.526357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-be5b626b-beeb-4829-9fa3-7b89cb99f9af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:17.534133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-be5b626b-beeb-4829-9fa3-7b89cb99f9af tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148196 Aug 06 13:03:17.534701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1757/3504] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:18.555493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4310621a-c34f-438a-a053-78341e23c45a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:18.556097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4310621a-c34f-438a-a053-78341e23c45a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:18.562425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4310621a-c34f-438a-a053-78341e23c45a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:18.562905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4310621a-c34f-438a-a053-78341e23c45a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:18.563341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4310621a-c34f-438a-a053-78341e23c45a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:18.564021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4310621a-c34f-438a-a053-78341e23c45a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:18.564498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4310621a-c34f-438a-a053-78341e23c45a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:18.564927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4310621a-c34f-438a-a053-78341e23c45a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:18.706052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4310621a-c34f-438a-a053-78341e23c45a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:18.714558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4310621a-c34f-438a-a053-78341e23c45a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.162983 Aug 06 13:03:18.715117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1748/3505] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:18 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:19.735711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6488e42-ebc8-4682-b170-7d07ef56e2e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:19.736361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c6488e42-ebc8-4682-b170-7d07ef56e2e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:19.742885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6488e42-ebc8-4682-b170-7d07ef56e2e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:19.743358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6488e42-ebc8-4682-b170-7d07ef56e2e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:19.743785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6488e42-ebc8-4682-b170-7d07ef56e2e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:19.744480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6488e42-ebc8-4682-b170-7d07ef56e2e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:19.744928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6488e42-ebc8-4682-b170-7d07ef56e2e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:19.745344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6488e42-ebc8-4682-b170-7d07ef56e2e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:19.886612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c6488e42-ebc8-4682-b170-7d07ef56e2e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:19.894522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c6488e42-ebc8-4682-b170-7d07ef56e2e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.162794 Aug 06 13:03:19.895577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1758/3506] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:20.915481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2c1b910b-e4a9-4d54-a1b1-209b21b22793 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:20.916113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2c1b910b-e4a9-4d54-a1b1-209b21b22793 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:20.922565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1b910b-e4a9-4d54-a1b1-209b21b22793 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:20.923054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1b910b-e4a9-4d54-a1b1-209b21b22793 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:20.923490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1b910b-e4a9-4d54-a1b1-209b21b22793 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:20.924174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1b910b-e4a9-4d54-a1b1-209b21b22793 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:20.924657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1b910b-e4a9-4d54-a1b1-209b21b22793 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:20.925083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1b910b-e4a9-4d54-a1b1-209b21b22793 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:21.052016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c1b910b-e4a9-4d54-a1b1-209b21b22793 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:21.059983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2c1b910b-e4a9-4d54-a1b1-209b21b22793 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148381 Aug 06 13:03:21.060573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1749/3507] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:22.080013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-584ad1ca-cd31-4d67-ba78-e32da949b398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:22.080642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-584ad1ca-cd31-4d67-ba78-e32da949b398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:22.087034 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-584ad1ca-cd31-4d67-ba78-e32da949b398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:22.087505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-584ad1ca-cd31-4d67-ba78-e32da949b398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:22.087933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-584ad1ca-cd31-4d67-ba78-e32da949b398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:22.088633 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-584ad1ca-cd31-4d67-ba78-e32da949b398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:22.089079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-584ad1ca-cd31-4d67-ba78-e32da949b398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:22.089495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-584ad1ca-cd31-4d67-ba78-e32da949b398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:22.217303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-584ad1ca-cd31-4d67-ba78-e32da949b398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:22.225577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-584ad1ca-cd31-4d67-ba78-e32da949b398 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149420 Aug 06 13:03:22.226134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1759/3508] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:23.247251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f238c726-9840-4b61-8d00-1293b1c096de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:23.247837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f238c726-9840-4b61-8d00-1293b1c096de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:23.254720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f238c726-9840-4b61-8d00-1293b1c096de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:23.255142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f238c726-9840-4b61-8d00-1293b1c096de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:23.255578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f238c726-9840-4b61-8d00-1293b1c096de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:23.256257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f238c726-9840-4b61-8d00-1293b1c096de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:23.256740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f238c726-9840-4b61-8d00-1293b1c096de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:23.257161 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f238c726-9840-4b61-8d00-1293b1c096de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:23.385542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f238c726-9840-4b61-8d00-1293b1c096de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:23.393403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f238c726-9840-4b61-8d00-1293b1c096de tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150003 Aug 06 13:03:23.394040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1750/3509] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:23 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:24.414974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e5e15988-daee-4ec1-abf1-62418e456001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:24.415556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e5e15988-daee-4ec1-abf1-62418e456001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:24.422014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5e15988-daee-4ec1-abf1-62418e456001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:24.422494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5e15988-daee-4ec1-abf1-62418e456001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:24.422948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5e15988-daee-4ec1-abf1-62418e456001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:24.423617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5e15988-daee-4ec1-abf1-62418e456001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:24.424060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5e15988-daee-4ec1-abf1-62418e456001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:24.424505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5e15988-daee-4ec1-abf1-62418e456001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:24.550136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e5e15988-daee-4ec1-abf1-62418e456001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:24.557931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e5e15988-daee-4ec1-abf1-62418e456001 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146784 Aug 06 13:03:24.558481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1760/3510] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:25.579481 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b601ec40-9a9e-44b5-ad18-df53ea8ff883 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:25.580077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b601ec40-9a9e-44b5-ad18-df53ea8ff883 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:25.586993 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b601ec40-9a9e-44b5-ad18-df53ea8ff883 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:25.587468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b601ec40-9a9e-44b5-ad18-df53ea8ff883 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:25.587894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b601ec40-9a9e-44b5-ad18-df53ea8ff883 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:25.588595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b601ec40-9a9e-44b5-ad18-df53ea8ff883 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:25.589043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b601ec40-9a9e-44b5-ad18-df53ea8ff883 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:25.589463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b601ec40-9a9e-44b5-ad18-df53ea8ff883 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:25.715603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b601ec40-9a9e-44b5-ad18-df53ea8ff883 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:25.724079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b601ec40-9a9e-44b5-ad18-df53ea8ff883 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148435 Aug 06 13:03:25.724662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1751/3511] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:26.745466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c38e4c5e-fb6b-4f3b-82aa-a6d542b91d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:26.746082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c38e4c5e-fb6b-4f3b-82aa-a6d542b91d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:26.752446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38e4c5e-fb6b-4f3b-82aa-a6d542b91d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:26.752930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38e4c5e-fb6b-4f3b-82aa-a6d542b91d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:26.753369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38e4c5e-fb6b-4f3b-82aa-a6d542b91d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:26.754058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38e4c5e-fb6b-4f3b-82aa-a6d542b91d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:26.754545 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38e4c5e-fb6b-4f3b-82aa-a6d542b91d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:26.754971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c38e4c5e-fb6b-4f3b-82aa-a6d542b91d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:26.883425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c38e4c5e-fb6b-4f3b-82aa-a6d542b91d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:26.891356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c38e4c5e-fb6b-4f3b-82aa-a6d542b91d25 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149776 Aug 06 13:03:26.891921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1761/3512] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:27.912258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2efbd2f6-26ec-4e5c-9dd0-aa4c74ac62e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:27.912831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2efbd2f6-26ec-4e5c-9dd0-aa4c74ac62e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:27.919190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efbd2f6-26ec-4e5c-9dd0-aa4c74ac62e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:27.919676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efbd2f6-26ec-4e5c-9dd0-aa4c74ac62e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:27.920110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efbd2f6-26ec-4e5c-9dd0-aa4c74ac62e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:27.920826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efbd2f6-26ec-4e5c-9dd0-aa4c74ac62e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:27.921282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efbd2f6-26ec-4e5c-9dd0-aa4c74ac62e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:27.921704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efbd2f6-26ec-4e5c-9dd0-aa4c74ac62e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:28.054511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2efbd2f6-26ec-4e5c-9dd0-aa4c74ac62e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:28.062900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2efbd2f6-26ec-4e5c-9dd0-aa4c74ac62e2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.155177 Aug 06 13:03:28.063475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1752/3513] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:29.083543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-005f9e32-693c-4b71-84c5-5426584f3edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:29.084146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-005f9e32-693c-4b71-84c5-5426584f3edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:29.090508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-005f9e32-693c-4b71-84c5-5426584f3edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:29.090988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-005f9e32-693c-4b71-84c5-5426584f3edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:29.091420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-005f9e32-693c-4b71-84c5-5426584f3edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:29.092097 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-005f9e32-693c-4b71-84c5-5426584f3edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:29.092578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-005f9e32-693c-4b71-84c5-5426584f3edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:29.093004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-005f9e32-693c-4b71-84c5-5426584f3edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:29.224404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-005f9e32-693c-4b71-84c5-5426584f3edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:29.232614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-005f9e32-693c-4b71-84c5-5426584f3edd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152915 Aug 06 13:03:29.233174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1762/3514] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:30.254830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f5d99e22-5d20-43c8-b2e2-c154add8f053 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:30.255361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f5d99e22-5d20-43c8-b2e2-c154add8f053 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:30.261680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d99e22-5d20-43c8-b2e2-c154add8f053 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:30.262158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d99e22-5d20-43c8-b2e2-c154add8f053 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:30.262593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d99e22-5d20-43c8-b2e2-c154add8f053 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:30.263273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d99e22-5d20-43c8-b2e2-c154add8f053 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:30.263724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d99e22-5d20-43c8-b2e2-c154add8f053 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:30.264145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5d99e22-5d20-43c8-b2e2-c154add8f053 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:30.388458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f5d99e22-5d20-43c8-b2e2-c154add8f053 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:30.396238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f5d99e22-5d20-43c8-b2e2-c154add8f053 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145998 Aug 06 13:03:30.396845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1753/3515] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:30 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:31.417095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0ec88bd7-55ac-434d-b23c-ccf2fff7f1ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:31.417705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0ec88bd7-55ac-434d-b23c-ccf2fff7f1ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:31.424065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ec88bd7-55ac-434d-b23c-ccf2fff7f1ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:31.424575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ec88bd7-55ac-434d-b23c-ccf2fff7f1ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:31.425018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ec88bd7-55ac-434d-b23c-ccf2fff7f1ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:31.425738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ec88bd7-55ac-434d-b23c-ccf2fff7f1ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:31.426192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ec88bd7-55ac-434d-b23c-ccf2fff7f1ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:31.426617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ec88bd7-55ac-434d-b23c-ccf2fff7f1ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:31.552557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0ec88bd7-55ac-434d-b23c-ccf2fff7f1ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:31.560534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0ec88bd7-55ac-434d-b23c-ccf2fff7f1ec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147264 Aug 06 13:03:31.561094 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1763/3516] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:32.580968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7f02e604-6664-4c95-bec2-48475f578088 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:32.581551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7f02e604-6664-4c95-bec2-48475f578088 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:32.588414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f02e604-6664-4c95-bec2-48475f578088 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:32.588903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f02e604-6664-4c95-bec2-48475f578088 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:32.589316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f02e604-6664-4c95-bec2-48475f578088 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:32.589990 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f02e604-6664-4c95-bec2-48475f578088 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:32.590436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f02e604-6664-4c95-bec2-48475f578088 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:32.590853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f02e604-6664-4c95-bec2-48475f578088 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:32.715640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7f02e604-6664-4c95-bec2-48475f578088 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:32.723390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7f02e604-6664-4c95-bec2-48475f578088 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146231 Aug 06 13:03:32.723952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1754/3517] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:33.744861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac15ff06-4249-4fdf-bcca-169aefdc51cb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:33.745465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac15ff06-4249-4fdf-bcca-169aefdc51cb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:33.751870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac15ff06-4249-4fdf-bcca-169aefdc51cb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:33.752383 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac15ff06-4249-4fdf-bcca-169aefdc51cb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:33.752819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac15ff06-4249-4fdf-bcca-169aefdc51cb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:33.753578 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac15ff06-4249-4fdf-bcca-169aefdc51cb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:33.754037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac15ff06-4249-4fdf-bcca-169aefdc51cb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:33.754448 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac15ff06-4249-4fdf-bcca-169aefdc51cb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:33.884557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ac15ff06-4249-4fdf-bcca-169aefdc51cb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:33.892353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac15ff06-4249-4fdf-bcca-169aefdc51cb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151284 Aug 06 13:03:33.892917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1764/3518] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:34.914004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8a8b67a7-3094-4394-8fb4-b1739924c3bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:34.914596 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8a8b67a7-3094-4394-8fb4-b1739924c3bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:34.920560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a8b67a7-3094-4394-8fb4-b1739924c3bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:34.921041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a8b67a7-3094-4394-8fb4-b1739924c3bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:34.921473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a8b67a7-3094-4394-8fb4-b1739924c3bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:34.922174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a8b67a7-3094-4394-8fb4-b1739924c3bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:34.922607 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a8b67a7-3094-4394-8fb4-b1739924c3bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:34.923031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a8b67a7-3094-4394-8fb4-b1739924c3bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:35.053042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8a8b67a7-3094-4394-8fb4-b1739924c3bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:35.060905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8a8b67a7-3094-4394-8fb4-b1739924c3bb tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150981 Aug 06 13:03:35.061479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1755/3519] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:36.082389 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3522e08c-09fe-46c7-9937-fe6f82cf6287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:36.083030 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3522e08c-09fe-46c7-9937-fe6f82cf6287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:36.089519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3522e08c-09fe-46c7-9937-fe6f82cf6287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:36.089994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3522e08c-09fe-46c7-9937-fe6f82cf6287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:36.090430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3522e08c-09fe-46c7-9937-fe6f82cf6287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:36.091111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3522e08c-09fe-46c7-9937-fe6f82cf6287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:36.091560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3522e08c-09fe-46c7-9937-fe6f82cf6287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:36.091978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3522e08c-09fe-46c7-9937-fe6f82cf6287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:36.217587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3522e08c-09fe-46c7-9937-fe6f82cf6287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:36.225428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3522e08c-09fe-46c7-9937-fe6f82cf6287 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147567 Aug 06 13:03:36.225987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1765/3520] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:37.247811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e3b2a341-d648-4510-9284-213665333dc7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:37.248383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e3b2a341-d648-4510-9284-213665333dc7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:37.255511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3b2a341-d648-4510-9284-213665333dc7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:37.255994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3b2a341-d648-4510-9284-213665333dc7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:37.256489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3b2a341-d648-4510-9284-213665333dc7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:37.257174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3b2a341-d648-4510-9284-213665333dc7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:37.257629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3b2a341-d648-4510-9284-213665333dc7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:37.258056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3b2a341-d648-4510-9284-213665333dc7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:37.384019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e3b2a341-d648-4510-9284-213665333dc7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:37.391869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e3b2a341-d648-4510-9284-213665333dc7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148033 Aug 06 13:03:37.392525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1756/3521] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:37 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:38.414083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-192aaa26-c044-41e9-8fe1-26553a6f1eba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:38.414680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-192aaa26-c044-41e9-8fe1-26553a6f1eba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:38.421004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-192aaa26-c044-41e9-8fe1-26553a6f1eba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:38.421477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-192aaa26-c044-41e9-8fe1-26553a6f1eba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:38.421903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-192aaa26-c044-41e9-8fe1-26553a6f1eba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:38.422573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-192aaa26-c044-41e9-8fe1-26553a6f1eba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:38.423017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-192aaa26-c044-41e9-8fe1-26553a6f1eba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:38.423428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-192aaa26-c044-41e9-8fe1-26553a6f1eba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:38.555024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-192aaa26-c044-41e9-8fe1-26553a6f1eba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:38.562877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-192aaa26-c044-41e9-8fe1-26553a6f1eba tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153319 Aug 06 13:03:38.563446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1766/3522] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:03:39.583437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c73ccd06-bc2c-4894-9bda-d95b22b927d2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:39.584043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c73ccd06-bc2c-4894-9bda-d95b22b927d2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:39.590394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c73ccd06-bc2c-4894-9bda-d95b22b927d2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:39.590879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c73ccd06-bc2c-4894-9bda-d95b22b927d2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:39.591298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c73ccd06-bc2c-4894-9bda-d95b22b927d2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:39.591969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c73ccd06-bc2c-4894-9bda-d95b22b927d2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:39.592447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c73ccd06-bc2c-4894-9bda-d95b22b927d2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:39.592864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c73ccd06-bc2c-4894-9bda-d95b22b927d2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:39.720726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c73ccd06-bc2c-4894-9bda-d95b22b927d2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:39.729241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c73ccd06-bc2c-4894-9bda-d95b22b927d2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149368 Aug 06 13:03:39.729873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1757/3523] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:40.750791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c25a3cf9-4453-4d5b-8c0d-84d3a4d86811 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:40.751416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c25a3cf9-4453-4d5b-8c0d-84d3a4d86811 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:40.758392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c25a3cf9-4453-4d5b-8c0d-84d3a4d86811 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:40.758867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c25a3cf9-4453-4d5b-8c0d-84d3a4d86811 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:40.759294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c25a3cf9-4453-4d5b-8c0d-84d3a4d86811 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:40.759965 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c25a3cf9-4453-4d5b-8c0d-84d3a4d86811 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:40.760433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c25a3cf9-4453-4d5b-8c0d-84d3a4d86811 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:40.760852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c25a3cf9-4453-4d5b-8c0d-84d3a4d86811 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:40.888980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c25a3cf9-4453-4d5b-8c0d-84d3a4d86811 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:40.896780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c25a3cf9-4453-4d5b-8c0d-84d3a4d86811 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149747 Aug 06 13:03:40.897333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1767/3524] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:41.917778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-39f6e580-6df0-44ce-84f6-1c53e046b9fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:41.918334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-39f6e580-6df0-44ce-84f6-1c53e046b9fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:41.920646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=26 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:03:41.926078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39f6e580-6df0-44ce-84f6-1c53e046b9fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:41.926550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39f6e580-6df0-44ce-84f6-1c53e046b9fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:41.927009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39f6e580-6df0-44ce-84f6-1c53e046b9fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:41.927685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39f6e580-6df0-44ce-84f6-1c53e046b9fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:41.928132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39f6e580-6df0-44ce-84f6-1c53e046b9fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:41.928578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39f6e580-6df0-44ce-84f6-1c53e046b9fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:42.059649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-39f6e580-6df0-44ce-84f6-1c53e046b9fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:42.069139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-39f6e580-6df0-44ce-84f6-1c53e046b9fd tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.155240 Aug 06 13:03:42.069713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1758/3525] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:41 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:43.090678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5d0480f3-4702-4d89-90c6-938bdda10493 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:43.091292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5d0480f3-4702-4d89-90c6-938bdda10493 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:43.098333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0480f3-4702-4d89-90c6-938bdda10493 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:43.098814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0480f3-4702-4d89-90c6-938bdda10493 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:43.099249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0480f3-4702-4d89-90c6-938bdda10493 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:43.099930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0480f3-4702-4d89-90c6-938bdda10493 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:43.100413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0480f3-4702-4d89-90c6-938bdda10493 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:43.100839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d0480f3-4702-4d89-90c6-938bdda10493 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:43.104949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=78 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:03:43.227793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5d0480f3-4702-4d89-90c6-938bdda10493 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:43.235847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5d0480f3-4702-4d89-90c6-938bdda10493 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149017 Aug 06 13:03:43.236427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1768/3526] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:44.257181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96b01a70-0158-4d3b-bcb8-4f7b128879e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:44.257725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-96b01a70-0158-4d3b-bcb8-4f7b128879e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:44.264016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b01a70-0158-4d3b-bcb8-4f7b128879e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:44.264530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b01a70-0158-4d3b-bcb8-4f7b128879e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:44.264958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b01a70-0158-4d3b-bcb8-4f7b128879e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:44.265631 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b01a70-0158-4d3b-bcb8-4f7b128879e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:44.266079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b01a70-0158-4d3b-bcb8-4f7b128879e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:44.266501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b01a70-0158-4d3b-bcb8-4f7b128879e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:44.269057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=78 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:03:44.547208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96b01a70-0158-4d3b-bcb8-4f7b128879e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:44.555010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-96b01a70-0158-4d3b-bcb8-4f7b128879e8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.301791 Aug 06 13:03:44.555568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1759/3527] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:44 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:45.575897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-197ed3a4-52bd-46fc-a9ff-412244831a85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:45.576602 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-197ed3a4-52bd-46fc-a9ff-412244831a85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:45.578337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=26 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:03:45.583701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-197ed3a4-52bd-46fc-a9ff-412244831a85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:45.584192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-197ed3a4-52bd-46fc-a9ff-412244831a85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:45.584644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-197ed3a4-52bd-46fc-a9ff-412244831a85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:45.585319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-197ed3a4-52bd-46fc-a9ff-412244831a85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:45.585764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-197ed3a4-52bd-46fc-a9ff-412244831a85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:45.586181 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-197ed3a4-52bd-46fc-a9ff-412244831a85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:45.714212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-197ed3a4-52bd-46fc-a9ff-412244831a85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:45.722425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-197ed3a4-52bd-46fc-a9ff-412244831a85 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150107 Aug 06 13:03:45.722978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1769/3528] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:46.743550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5f37368-36f7-4f0d-954a-f9d9919c2d56 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:46.744135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5f37368-36f7-4f0d-954a-f9d9919c2d56 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:46.750561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f37368-36f7-4f0d-954a-f9d9919c2d56 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:46.751031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f37368-36f7-4f0d-954a-f9d9919c2d56 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:46.751454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f37368-36f7-4f0d-954a-f9d9919c2d56 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:46.752124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f37368-36f7-4f0d-954a-f9d9919c2d56 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:46.752588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f37368-36f7-4f0d-954a-f9d9919c2d56 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:46.753614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f37368-36f7-4f0d-954a-f9d9919c2d56 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:46.877594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5f37368-36f7-4f0d-954a-f9d9919c2d56 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:46.885893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5f37368-36f7-4f0d-954a-f9d9919c2d56 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146132 Aug 06 13:03:46.886432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1760/3529] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:47.906576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1c897742-8a00-419d-9790-db4ce0adf915 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:47.907115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1c897742-8a00-419d-9790-db4ce0adf915 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:47.914025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c897742-8a00-419d-9790-db4ce0adf915 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:47.914500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c897742-8a00-419d-9790-db4ce0adf915 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:47.914927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c897742-8a00-419d-9790-db4ce0adf915 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:47.915596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c897742-8a00-419d-9790-db4ce0adf915 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:47.916042 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c897742-8a00-419d-9790-db4ce0adf915 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:47.916489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c897742-8a00-419d-9790-db4ce0adf915 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:48.041088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1c897742-8a00-419d-9790-db4ce0adf915 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:48.048891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1c897742-8a00-419d-9790-db4ce0adf915 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146226 Aug 06 13:03:48.049467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1770/3530] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:49.070279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bc8f542b-c278-42bb-99f8-546bb3973e18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:49.070918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bc8f542b-c278-42bb-99f8-546bb3973e18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:49.077412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc8f542b-c278-42bb-99f8-546bb3973e18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:49.077893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc8f542b-c278-42bb-99f8-546bb3973e18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:49.078328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc8f542b-c278-42bb-99f8-546bb3973e18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:49.079011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc8f542b-c278-42bb-99f8-546bb3973e18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:49.079468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc8f542b-c278-42bb-99f8-546bb3973e18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:49.079924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc8f542b-c278-42bb-99f8-546bb3973e18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:49.208760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bc8f542b-c278-42bb-99f8-546bb3973e18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:49.217528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bc8f542b-c278-42bb-99f8-546bb3973e18 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151056 Aug 06 13:03:49.218089 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1761/3531] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:50.238904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-298f67b5-18aa-4b86-84df-36164f8db416 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:50.239489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-298f67b5-18aa-4b86-84df-36164f8db416 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:50.245899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298f67b5-18aa-4b86-84df-36164f8db416 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:50.246375 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298f67b5-18aa-4b86-84df-36164f8db416 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:50.246805 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298f67b5-18aa-4b86-84df-36164f8db416 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:50.247479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298f67b5-18aa-4b86-84df-36164f8db416 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:50.247927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298f67b5-18aa-4b86-84df-36164f8db416 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:50.248373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-298f67b5-18aa-4b86-84df-36164f8db416 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:50.381925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-298f67b5-18aa-4b86-84df-36164f8db416 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:50.389696 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-298f67b5-18aa-4b86-84df-36164f8db416 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.154701 Aug 06 13:03:50.390257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1771/3532] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:51.410986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a6826725-47ef-4ddf-9059-bec9ea2ebd62 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:51.411573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a6826725-47ef-4ddf-9059-bec9ea2ebd62 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:51.417936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6826725-47ef-4ddf-9059-bec9ea2ebd62 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:51.418423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6826725-47ef-4ddf-9059-bec9ea2ebd62 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:51.418862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6826725-47ef-4ddf-9059-bec9ea2ebd62 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:51.419552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6826725-47ef-4ddf-9059-bec9ea2ebd62 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:51.420008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6826725-47ef-4ddf-9059-bec9ea2ebd62 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:51.420471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6826725-47ef-4ddf-9059-bec9ea2ebd62 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:51.544681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a6826725-47ef-4ddf-9059-bec9ea2ebd62 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:51.552483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a6826725-47ef-4ddf-9059-bec9ea2ebd62 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145954 Aug 06 13:03:51.553070 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1762/3533] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:51 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:52.573670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-efcba393-2d30-4449-a953-20afffa82c76 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:52.574284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-efcba393-2d30-4449-a953-20afffa82c76 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:52.580622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efcba393-2d30-4449-a953-20afffa82c76 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:52.581582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efcba393-2d30-4449-a953-20afffa82c76 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:52.582004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efcba393-2d30-4449-a953-20afffa82c76 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:52.582675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efcba393-2d30-4449-a953-20afffa82c76 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:52.583118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efcba393-2d30-4449-a953-20afffa82c76 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:52.583537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efcba393-2d30-4449-a953-20afffa82c76 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:52.707677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-efcba393-2d30-4449-a953-20afffa82c76 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:52.715435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-efcba393-2d30-4449-a953-20afffa82c76 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145582 Aug 06 13:03:52.715987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1772/3534] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:53.738495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bb815451-a563-414f-bc38-26d997ddc313 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:53.739094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bb815451-a563-414f-bc38-26d997ddc313 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:53.745648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb815451-a563-414f-bc38-26d997ddc313 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:53.746132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb815451-a563-414f-bc38-26d997ddc313 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:53.746564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb815451-a563-414f-bc38-26d997ddc313 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:53.747255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb815451-a563-414f-bc38-26d997ddc313 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:53.747707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb815451-a563-414f-bc38-26d997ddc313 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:53.748132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb815451-a563-414f-bc38-26d997ddc313 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:53.874651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bb815451-a563-414f-bc38-26d997ddc313 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:53.882443 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bb815451-a563-414f-bc38-26d997ddc313 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148510 Aug 06 13:03:53.882997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1763/3535] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:53 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:54.903361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-982dc8a3-3781-4b6e-80da-2b6ffb610af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:54.904002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-982dc8a3-3781-4b6e-80da-2b6ffb610af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:54.910277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-982dc8a3-3781-4b6e-80da-2b6ffb610af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:54.910751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-982dc8a3-3781-4b6e-80da-2b6ffb610af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:54.911180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-982dc8a3-3781-4b6e-80da-2b6ffb610af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:54.911853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-982dc8a3-3781-4b6e-80da-2b6ffb610af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:54.912332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-982dc8a3-3781-4b6e-80da-2b6ffb610af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:54.912741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-982dc8a3-3781-4b6e-80da-2b6ffb610af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:55.042180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-982dc8a3-3781-4b6e-80da-2b6ffb610af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:55.050513 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-982dc8a3-3781-4b6e-80da-2b6ffb610af1 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151055 Aug 06 13:03:55.051105 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1773/3536] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:54 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:03:56.071347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a6e88dfc-c6d7-4eb6-b66f-bb6aa7cc08e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:56.071956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a6e88dfc-c6d7-4eb6-b66f-bb6aa7cc08e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:56.078831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e88dfc-c6d7-4eb6-b66f-bb6aa7cc08e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:56.079314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e88dfc-c6d7-4eb6-b66f-bb6aa7cc08e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:56.079752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e88dfc-c6d7-4eb6-b66f-bb6aa7cc08e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:56.080474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e88dfc-c6d7-4eb6-b66f-bb6aa7cc08e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:56.081500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e88dfc-c6d7-4eb6-b66f-bb6aa7cc08e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:56.081932 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6e88dfc-c6d7-4eb6-b66f-bb6aa7cc08e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:56.212327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a6e88dfc-c6d7-4eb6-b66f-bb6aa7cc08e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:56.220178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a6e88dfc-c6d7-4eb6-b66f-bb6aa7cc08e5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152700 Aug 06 13:03:56.220762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1764/3537] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:56 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:57.241678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-74211b8b-6df6-41f7-968a-96017ab56081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:57.242268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-74211b8b-6df6-41f7-968a-96017ab56081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:57.248671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-74211b8b-6df6-41f7-968a-96017ab56081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:57.249091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-74211b8b-6df6-41f7-968a-96017ab56081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:57.249521 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-74211b8b-6df6-41f7-968a-96017ab56081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:57.250198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-74211b8b-6df6-41f7-968a-96017ab56081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:57.250652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-74211b8b-6df6-41f7-968a-96017ab56081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:57.251066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-74211b8b-6df6-41f7-968a-96017ab56081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:57.382065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-74211b8b-6df6-41f7-968a-96017ab56081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:57.390124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-74211b8b-6df6-41f7-968a-96017ab56081 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152299 Aug 06 13:03:57.390682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1774/3538] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:57 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:57.538521 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-77dd615f-bc90-4dcc-97ac-c1c2b27ef562 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:57.539059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-77dd615f-bc90-4dcc-97ac-c1c2b27ef562 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:57.545480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77dd615f-bc90-4dcc-97ac-c1c2b27ef562 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:57.545964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77dd615f-bc90-4dcc-97ac-c1c2b27ef562 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:57.546396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77dd615f-bc90-4dcc-97ac-c1c2b27ef562 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:57.547081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77dd615f-bc90-4dcc-97ac-c1c2b27ef562 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:57.547533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77dd615f-bc90-4dcc-97ac-c1c2b27ef562 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:57.547955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77dd615f-bc90-4dcc-97ac-c1c2b27ef562 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:57.570337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-77dd615f-bc90-4dcc-97ac-c1c2b27ef562 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/ips" status: 200 len: 146 microversion: 2.1 time: 0.035641 Aug 06 13:03:57.570883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1765/3539] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Aug 6 13:03:57 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:03:58.410355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b580b356-1146-41fd-a858-f58350d5836c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:58.410979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b580b356-1146-41fd-a858-f58350d5836c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:58.417471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b580b356-1146-41fd-a858-f58350d5836c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:58.417954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b580b356-1146-41fd-a858-f58350d5836c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:58.418390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b580b356-1146-41fd-a858-f58350d5836c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:58.419074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b580b356-1146-41fd-a858-f58350d5836c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:58.419529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b580b356-1146-41fd-a858-f58350d5836c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:58.419954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b580b356-1146-41fd-a858-f58350d5836c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:58.545193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b580b356-1146-41fd-a858-f58350d5836c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:58.553062 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b580b356-1146-41fd-a858-f58350d5836c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146575 Aug 06 13:03:58.553620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1775/3540] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:58 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:03:59.573921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1f0dc4b2-d7dc-4b65-9933-39c9755d331b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:03:59.574518 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1f0dc4b2-d7dc-4b65-9933-39c9755d331b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:03:59.581506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0dc4b2-d7dc-4b65-9933-39c9755d331b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:59.581978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0dc4b2-d7dc-4b65-9933-39c9755d331b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:59.582407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0dc4b2-d7dc-4b65-9933-39c9755d331b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:59.583078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0dc4b2-d7dc-4b65-9933-39c9755d331b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:03:59.583547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0dc4b2-d7dc-4b65-9933-39c9755d331b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:03:59.583963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f0dc4b2-d7dc-4b65-9933-39c9755d331b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:03:59.709414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1f0dc4b2-d7dc-4b65-9933-39c9755d331b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:03:59.717116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1f0dc4b2-d7dc-4b65-9933-39c9755d331b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147071 Aug 06 13:03:59.717663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1766/3541] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:03:59 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:00.738492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-23d707b0-d6be-4d7e-a016-23d841dee81c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:00.739092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-23d707b0-d6be-4d7e-a016-23d841dee81c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:00.745410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23d707b0-d6be-4d7e-a016-23d841dee81c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:00.745881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23d707b0-d6be-4d7e-a016-23d841dee81c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:00.746312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23d707b0-d6be-4d7e-a016-23d841dee81c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:00.746983 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23d707b0-d6be-4d7e-a016-23d841dee81c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:00.747429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23d707b0-d6be-4d7e-a016-23d841dee81c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:00.747844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23d707b0-d6be-4d7e-a016-23d841dee81c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:00.877641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23d707b0-d6be-4d7e-a016-23d841dee81c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:00.885604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-23d707b0-d6be-4d7e-a016-23d841dee81c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151566 Aug 06 13:04:00.886165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1776/3542] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:00 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:01.907031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-63815ef4-e352-45ec-b48b-da3d55bd6ac6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:01.907556 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-63815ef4-e352-45ec-b48b-da3d55bd6ac6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:01.913974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63815ef4-e352-45ec-b48b-da3d55bd6ac6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:01.914450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63815ef4-e352-45ec-b48b-da3d55bd6ac6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:01.914912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63815ef4-e352-45ec-b48b-da3d55bd6ac6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:01.915629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63815ef4-e352-45ec-b48b-da3d55bd6ac6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:01.916158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63815ef4-e352-45ec-b48b-da3d55bd6ac6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:01.916807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63815ef4-e352-45ec-b48b-da3d55bd6ac6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:02.047105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-63815ef4-e352-45ec-b48b-da3d55bd6ac6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:02.055699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-63815ef4-e352-45ec-b48b-da3d55bd6ac6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152592 Aug 06 13:04:02.056248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1767/3543] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:01 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:03.077099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-17d3a440-4cec-4c40-9cdd-c7f66f641afc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:03.077704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-17d3a440-4cec-4c40-9cdd-c7f66f641afc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:03.084763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17d3a440-4cec-4c40-9cdd-c7f66f641afc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:03.085233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17d3a440-4cec-4c40-9cdd-c7f66f641afc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:03.085659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17d3a440-4cec-4c40-9cdd-c7f66f641afc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:03.086326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17d3a440-4cec-4c40-9cdd-c7f66f641afc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:03.086770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17d3a440-4cec-4c40-9cdd-c7f66f641afc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:03.087187 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17d3a440-4cec-4c40-9cdd-c7f66f641afc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:03.212077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-17d3a440-4cec-4c40-9cdd-c7f66f641afc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:03.219843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-17d3a440-4cec-4c40-9cdd-c7f66f641afc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146597 Aug 06 13:04:03.220416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1777/3544] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:03 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:04.240972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3fb80015-9bbb-4c72-87d7-3f77d52ef82e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:04.241507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3fb80015-9bbb-4c72-87d7-3f77d52ef82e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:04.247314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fb80015-9bbb-4c72-87d7-3f77d52ef82e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:04.247786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fb80015-9bbb-4c72-87d7-3f77d52ef82e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:04.248225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fb80015-9bbb-4c72-87d7-3f77d52ef82e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:04.248924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fb80015-9bbb-4c72-87d7-3f77d52ef82e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:04.249395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fb80015-9bbb-4c72-87d7-3f77d52ef82e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:04.249815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fb80015-9bbb-4c72-87d7-3f77d52ef82e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:04.379464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3fb80015-9bbb-4c72-87d7-3f77d52ef82e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:04.387489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3fb80015-9bbb-4c72-87d7-3f77d52ef82e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150598 Aug 06 13:04:04.388045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1768/3545] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:04 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:05.409337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8f499e3b-19b9-4c85-b3cc-46099db3ceab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:05.409942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8f499e3b-19b9-4c85-b3cc-46099db3ceab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:05.416254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f499e3b-19b9-4c85-b3cc-46099db3ceab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:05.416759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f499e3b-19b9-4c85-b3cc-46099db3ceab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:05.417193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f499e3b-19b9-4c85-b3cc-46099db3ceab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:05.417896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f499e3b-19b9-4c85-b3cc-46099db3ceab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:05.418349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f499e3b-19b9-4c85-b3cc-46099db3ceab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:05.418768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f499e3b-19b9-4c85-b3cc-46099db3ceab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:05.550414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8f499e3b-19b9-4c85-b3cc-46099db3ceab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:05.558199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8f499e3b-19b9-4c85-b3cc-46099db3ceab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153428 Aug 06 13:04:05.558759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1778/3546] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:05 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:06.578769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2cfc7f4b-5a07-4f89-a689-422794832f6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:06.579372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2cfc7f4b-5a07-4f89-a689-422794832f6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:06.586129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cfc7f4b-5a07-4f89-a689-422794832f6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:06.586618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cfc7f4b-5a07-4f89-a689-422794832f6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:06.587059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cfc7f4b-5a07-4f89-a689-422794832f6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:06.587751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cfc7f4b-5a07-4f89-a689-422794832f6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:06.588207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cfc7f4b-5a07-4f89-a689-422794832f6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:06.588665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cfc7f4b-5a07-4f89-a689-422794832f6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:06.717894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2cfc7f4b-5a07-4f89-a689-422794832f6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:06.726284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2cfc7f4b-5a07-4f89-a689-422794832f6d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151377 Aug 06 13:04:06.726844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1769/3547] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:06 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:07.748037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d601a286-2d8f-410f-9136-a06989855a1e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:07.748660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d601a286-2d8f-410f-9136-a06989855a1e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:07.755532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d601a286-2d8f-410f-9136-a06989855a1e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:07.756006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d601a286-2d8f-410f-9136-a06989855a1e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:07.756480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d601a286-2d8f-410f-9136-a06989855a1e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:07.757164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d601a286-2d8f-410f-9136-a06989855a1e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:07.757609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d601a286-2d8f-410f-9136-a06989855a1e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:07.758022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d601a286-2d8f-410f-9136-a06989855a1e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:07.893985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d601a286-2d8f-410f-9136-a06989855a1e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:07.901813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d601a286-2d8f-410f-9136-a06989855a1e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.157608 Aug 06 13:04:07.902370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1779/3548] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:07 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:08.922776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-83844fe8-75f7-41a1-8b4d-2b303079efa0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:08.923362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-83844fe8-75f7-41a1-8b4d-2b303079efa0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:08.929692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83844fe8-75f7-41a1-8b4d-2b303079efa0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:08.930174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83844fe8-75f7-41a1-8b4d-2b303079efa0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:08.930609 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83844fe8-75f7-41a1-8b4d-2b303079efa0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:08.931291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83844fe8-75f7-41a1-8b4d-2b303079efa0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:08.931747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83844fe8-75f7-41a1-8b4d-2b303079efa0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:08.932167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83844fe8-75f7-41a1-8b4d-2b303079efa0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:09.061426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-83844fe8-75f7-41a1-8b4d-2b303079efa0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:09.070100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-83844fe8-75f7-41a1-8b4d-2b303079efa0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151598 Aug 06 13:04:09.070659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1770/3549] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:08 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:10.091268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6ad442ab-e19a-4118-80f6-aa74a4920e01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:10.091867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6ad442ab-e19a-4118-80f6-aa74a4920e01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:10.099135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ad442ab-e19a-4118-80f6-aa74a4920e01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:10.099620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ad442ab-e19a-4118-80f6-aa74a4920e01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:10.100056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ad442ab-e19a-4118-80f6-aa74a4920e01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:10.100767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ad442ab-e19a-4118-80f6-aa74a4920e01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:10.101223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ad442ab-e19a-4118-80f6-aa74a4920e01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:10.101673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ad442ab-e19a-4118-80f6-aa74a4920e01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:10.229170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6ad442ab-e19a-4118-80f6-aa74a4920e01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:10.237137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6ad442ab-e19a-4118-80f6-aa74a4920e01 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149717 Aug 06 13:04:10.237707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1780/3550] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:10 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:11.258618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dc9447ca-802d-4c0b-85e3-5df3c9122aab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:11.259139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dc9447ca-802d-4c0b-85e3-5df3c9122aab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:11.265946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc9447ca-802d-4c0b-85e3-5df3c9122aab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:11.266416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc9447ca-802d-4c0b-85e3-5df3c9122aab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:11.266845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc9447ca-802d-4c0b-85e3-5df3c9122aab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:11.267520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc9447ca-802d-4c0b-85e3-5df3c9122aab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:11.267967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc9447ca-802d-4c0b-85e3-5df3c9122aab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:11.268409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc9447ca-802d-4c0b-85e3-5df3c9122aab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:11.396804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dc9447ca-802d-4c0b-85e3-5df3c9122aab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:11.404597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dc9447ca-802d-4c0b-85e3-5df3c9122aab tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149877 Aug 06 13:04:11.405149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1771/3551] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:11 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:12.426582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3646d7c8-0ed8-4ec9-8558-0f5da00cf271 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:12.427189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3646d7c8-0ed8-4ec9-8558-0f5da00cf271 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:12.433629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3646d7c8-0ed8-4ec9-8558-0f5da00cf271 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:12.434111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3646d7c8-0ed8-4ec9-8558-0f5da00cf271 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:12.434551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3646d7c8-0ed8-4ec9-8558-0f5da00cf271 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:12.435233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3646d7c8-0ed8-4ec9-8558-0f5da00cf271 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:12.435688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3646d7c8-0ed8-4ec9-8558-0f5da00cf271 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:12.436112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3646d7c8-0ed8-4ec9-8558-0f5da00cf271 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:12.564600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3646d7c8-0ed8-4ec9-8558-0f5da00cf271 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:12.572374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3646d7c8-0ed8-4ec9-8558-0f5da00cf271 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150088 Aug 06 13:04:12.572934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1781/3552] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:12 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:13.593153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c2cdd29-10a9-492b-926c-42b60707f310 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:13.593813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c2cdd29-10a9-492b-926c-42b60707f310 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:13.596041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=28 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:04:13.601196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c2cdd29-10a9-492b-926c-42b60707f310 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:13.601673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c2cdd29-10a9-492b-926c-42b60707f310 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:13.602110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c2cdd29-10a9-492b-926c-42b60707f310 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:13.602792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c2cdd29-10a9-492b-926c-42b60707f310 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:13.603270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c2cdd29-10a9-492b-926c-42b60707f310 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:13.603947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c2cdd29-10a9-492b-926c-42b60707f310 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:13.732444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8c2cdd29-10a9-492b-926c-42b60707f310 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:13.740676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c2cdd29-10a9-492b-926c-42b60707f310 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151457 Aug 06 13:04:13.741229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1772/3553] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:13 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:14.762077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ce6e6fa1-0161-4a9b-8b9c-3a62d6caec96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:14.762675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ce6e6fa1-0161-4a9b-8b9c-3a62d6caec96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:14.769655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce6e6fa1-0161-4a9b-8b9c-3a62d6caec96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:14.770132 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce6e6fa1-0161-4a9b-8b9c-3a62d6caec96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:14.770563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce6e6fa1-0161-4a9b-8b9c-3a62d6caec96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:14.771241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce6e6fa1-0161-4a9b-8b9c-3a62d6caec96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:14.771688 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce6e6fa1-0161-4a9b-8b9c-3a62d6caec96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:14.772109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ce6e6fa1-0161-4a9b-8b9c-3a62d6caec96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:14.775921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=84 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:04:14.900741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ce6e6fa1-0161-4a9b-8b9c-3a62d6caec96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:14.908699 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ce6e6fa1-0161-4a9b-8b9c-3a62d6caec96 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150455 Aug 06 13:04:14.909256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1782/3554] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:14 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:15.929897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27b7242d-7381-4f22-92c7-5d3b5ff63824 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:15.930432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27b7242d-7381-4f22-92c7-5d3b5ff63824 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:15.936897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b7242d-7381-4f22-92c7-5d3b5ff63824 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:15.937381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b7242d-7381-4f22-92c7-5d3b5ff63824 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:15.937816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b7242d-7381-4f22-92c7-5d3b5ff63824 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:15.938497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b7242d-7381-4f22-92c7-5d3b5ff63824 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:15.938947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b7242d-7381-4f22-92c7-5d3b5ff63824 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:15.939373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b7242d-7381-4f22-92c7-5d3b5ff63824 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:15.942452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=82 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:04:16.067011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-27b7242d-7381-4f22-92c7-5d3b5ff63824 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:16.074810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27b7242d-7381-4f22-92c7-5d3b5ff63824 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148893 Aug 06 13:04:16.075365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1773/3555] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:15 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:17.095124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f12b755d-d3f2-4f6b-88e5-3b04eeae54ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:17.096221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f12b755d-d3f2-4f6b-88e5-3b04eeae54ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:17.098084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=28 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:04:17.103692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f12b755d-d3f2-4f6b-88e5-3b04eeae54ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:17.104171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f12b755d-d3f2-4f6b-88e5-3b04eeae54ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:17.104632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f12b755d-d3f2-4f6b-88e5-3b04eeae54ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:17.105316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f12b755d-d3f2-4f6b-88e5-3b04eeae54ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:17.105764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f12b755d-d3f2-4f6b-88e5-3b04eeae54ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:17.106186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f12b755d-d3f2-4f6b-88e5-3b04eeae54ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:17.234997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f12b755d-d3f2-4f6b-88e5-3b04eeae54ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:17.243312 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f12b755d-d3f2-4f6b-88e5-3b04eeae54ef tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.152204 Aug 06 13:04:17.243855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1783/3556] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:17 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:18.263863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0986233a-c3a1-463e-8703-6fcfea892cdc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:18.264453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0986233a-c3a1-463e-8703-6fcfea892cdc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:18.271211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0986233a-c3a1-463e-8703-6fcfea892cdc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:18.271686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0986233a-c3a1-463e-8703-6fcfea892cdc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:18.272116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0986233a-c3a1-463e-8703-6fcfea892cdc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:18.272821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0986233a-c3a1-463e-8703-6fcfea892cdc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:18.273267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0986233a-c3a1-463e-8703-6fcfea892cdc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:18.273680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0986233a-c3a1-463e-8703-6fcfea892cdc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:18.402285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0986233a-c3a1-463e-8703-6fcfea892cdc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:18.410690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0986233a-c3a1-463e-8703-6fcfea892cdc tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150666 Aug 06 13:04:18.411281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1774/3557] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:18 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:19.432530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d93cedee-c88a-48d9-92ad-a15fd38b25d6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:19.433133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d93cedee-c88a-48d9-92ad-a15fd38b25d6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:19.439445 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d93cedee-c88a-48d9-92ad-a15fd38b25d6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:19.439919 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d93cedee-c88a-48d9-92ad-a15fd38b25d6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:19.440377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d93cedee-c88a-48d9-92ad-a15fd38b25d6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:19.441056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d93cedee-c88a-48d9-92ad-a15fd38b25d6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:19.441504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d93cedee-c88a-48d9-92ad-a15fd38b25d6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:19.441926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d93cedee-c88a-48d9-92ad-a15fd38b25d6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:19.566474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d93cedee-c88a-48d9-92ad-a15fd38b25d6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:19.574326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d93cedee-c88a-48d9-92ad-a15fd38b25d6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145626 Aug 06 13:04:19.574915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1784/3558] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:19 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:20.595317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d50a956f-5a93-4177-a15d-6e2187d265c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:20.595931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d50a956f-5a93-4177-a15d-6e2187d265c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:20.602207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d50a956f-5a93-4177-a15d-6e2187d265c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:20.602681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d50a956f-5a93-4177-a15d-6e2187d265c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:20.603109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d50a956f-5a93-4177-a15d-6e2187d265c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:20.604036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d50a956f-5a93-4177-a15d-6e2187d265c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:20.604517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d50a956f-5a93-4177-a15d-6e2187d265c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:20.604934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d50a956f-5a93-4177-a15d-6e2187d265c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:20.732800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d50a956f-5a93-4177-a15d-6e2187d265c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:20.741567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d50a956f-5a93-4177-a15d-6e2187d265c0 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150040 Aug 06 13:04:20.742145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1775/3559] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:20 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:21.762939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ffdbd23c-4fc1-4632-9662-12b297c57a9f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:21.763542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ffdbd23c-4fc1-4632-9662-12b297c57a9f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:21.769978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdbd23c-4fc1-4632-9662-12b297c57a9f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:21.770451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdbd23c-4fc1-4632-9662-12b297c57a9f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:21.770879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdbd23c-4fc1-4632-9662-12b297c57a9f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:21.771557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdbd23c-4fc1-4632-9662-12b297c57a9f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:21.772006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdbd23c-4fc1-4632-9662-12b297c57a9f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:21.772456 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffdbd23c-4fc1-4632-9662-12b297c57a9f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:21.903725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ffdbd23c-4fc1-4632-9662-12b297c57a9f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:21.912423 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ffdbd23c-4fc1-4632-9662-12b297c57a9f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153287 Aug 06 13:04:21.912984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1785/3560] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:21 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:22.933406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ea6e71f-869f-4062-901b-ddd30b6b392a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:22.934010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ea6e71f-869f-4062-901b-ddd30b6b392a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:22.941262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea6e71f-869f-4062-901b-ddd30b6b392a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:22.941749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea6e71f-869f-4062-901b-ddd30b6b392a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:22.942290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea6e71f-869f-4062-901b-ddd30b6b392a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:22.942979 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea6e71f-869f-4062-901b-ddd30b6b392a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:22.943431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea6e71f-869f-4062-901b-ddd30b6b392a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:22.943855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ea6e71f-869f-4062-901b-ddd30b6b392a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:23.073517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ea6e71f-869f-4062-901b-ddd30b6b392a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:23.081295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ea6e71f-869f-4062-901b-ddd30b6b392a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151744 Aug 06 13:04:23.081855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1776/3561] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:22 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:24.102115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8077893e-e9cf-4fb6-9cea-0bb5d74f2bed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:24.102747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8077893e-e9cf-4fb6-9cea-0bb5d74f2bed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:24.109515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8077893e-e9cf-4fb6-9cea-0bb5d74f2bed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:24.109985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8077893e-e9cf-4fb6-9cea-0bb5d74f2bed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:24.110412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8077893e-e9cf-4fb6-9cea-0bb5d74f2bed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:24.111572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8077893e-e9cf-4fb6-9cea-0bb5d74f2bed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:24.112017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8077893e-e9cf-4fb6-9cea-0bb5d74f2bed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:24.112458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8077893e-e9cf-4fb6-9cea-0bb5d74f2bed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:24.239515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8077893e-e9cf-4fb6-9cea-0bb5d74f2bed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:24.247255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8077893e-e9cf-4fb6-9cea-0bb5d74f2bed tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149043 Aug 06 13:04:24.247998 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1786/3562] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:24 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:25.267841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2700c858-c627-4e6d-aa45-a58fb16b0af5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:25.268411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2700c858-c627-4e6d-aa45-a58fb16b0af5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:25.274785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2700c858-c627-4e6d-aa45-a58fb16b0af5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:25.275268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2700c858-c627-4e6d-aa45-a58fb16b0af5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:25.275706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2700c858-c627-4e6d-aa45-a58fb16b0af5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:25.276420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2700c858-c627-4e6d-aa45-a58fb16b0af5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:25.276881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2700c858-c627-4e6d-aa45-a58fb16b0af5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:25.277306 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2700c858-c627-4e6d-aa45-a58fb16b0af5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:25.406594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2700c858-c627-4e6d-aa45-a58fb16b0af5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:25.414873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2700c858-c627-4e6d-aa45-a58fb16b0af5 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151025 Aug 06 13:04:25.415424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1777/3563] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:25 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:26.436118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e7c94433-f1a1-448d-b001-800c849f878d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:26.436750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e7c94433-f1a1-448d-b001-800c849f878d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:26.443004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7c94433-f1a1-448d-b001-800c849f878d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:26.443475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7c94433-f1a1-448d-b001-800c849f878d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:26.443897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7c94433-f1a1-448d-b001-800c849f878d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:26.444588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7c94433-f1a1-448d-b001-800c849f878d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:26.445033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7c94433-f1a1-448d-b001-800c849f878d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:26.445452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7c94433-f1a1-448d-b001-800c849f878d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:26.571522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e7c94433-f1a1-448d-b001-800c849f878d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:26.579335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e7c94433-f1a1-448d-b001-800c849f878d tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147097 Aug 06 13:04:26.580415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1787/3564] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:26 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:27.600490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a7520551-054f-4aaa-a74c-c0c03d0e02e3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:27.601094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a7520551-054f-4aaa-a74c-c0c03d0e02e3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:27.607658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7520551-054f-4aaa-a74c-c0c03d0e02e3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:27.608132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7520551-054f-4aaa-a74c-c0c03d0e02e3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:27.608591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7520551-054f-4aaa-a74c-c0c03d0e02e3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:27.609275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7520551-054f-4aaa-a74c-c0c03d0e02e3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:27.609723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7520551-054f-4aaa-a74c-c0c03d0e02e3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:27.610142 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a7520551-054f-4aaa-a74c-c0c03d0e02e3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:27.736321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a7520551-054f-4aaa-a74c-c0c03d0e02e3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:27.744091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a7520551-054f-4aaa-a74c-c0c03d0e02e3 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147533 Aug 06 13:04:27.744679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1778/3565] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:27 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:28.765492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b9669f80-1ce2-41b2-883a-700065689f5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:28.766095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b9669f80-1ce2-41b2-883a-700065689f5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:28.772936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9669f80-1ce2-41b2-883a-700065689f5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:28.773415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9669f80-1ce2-41b2-883a-700065689f5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:28.773847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9669f80-1ce2-41b2-883a-700065689f5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:28.774531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9669f80-1ce2-41b2-883a-700065689f5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:28.774976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9669f80-1ce2-41b2-883a-700065689f5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:28.775396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9669f80-1ce2-41b2-883a-700065689f5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:28.907060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b9669f80-1ce2-41b2-883a-700065689f5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:28.915640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b9669f80-1ce2-41b2-883a-700065689f5a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.153984 Aug 06 13:04:28.916208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1788/3566] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:28 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:29.936442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ae52a737-eb3f-451e-8742-0cc9d75e7dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:29.937078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ae52a737-eb3f-451e-8742-0cc9d75e7dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:29.943391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae52a737-eb3f-451e-8742-0cc9d75e7dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:29.943864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae52a737-eb3f-451e-8742-0cc9d75e7dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:29.944295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae52a737-eb3f-451e-8742-0cc9d75e7dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:29.944988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae52a737-eb3f-451e-8742-0cc9d75e7dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:29.945436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae52a737-eb3f-451e-8742-0cc9d75e7dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:29.945853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae52a737-eb3f-451e-8742-0cc9d75e7dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:30.074758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ae52a737-eb3f-451e-8742-0cc9d75e7dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:30.083024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ae52a737-eb3f-451e-8742-0cc9d75e7dbe tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150400 Aug 06 13:04:30.083576 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1779/3567] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:29 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:31.105223 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2f8184c7-210e-45b7-ad75-602355f47263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:31.105828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2f8184c7-210e-45b7-ad75-602355f47263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:31.112708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f8184c7-210e-45b7-ad75-602355f47263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:31.113185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f8184c7-210e-45b7-ad75-602355f47263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:31.113618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f8184c7-210e-45b7-ad75-602355f47263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:31.114293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f8184c7-210e-45b7-ad75-602355f47263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:31.114750 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f8184c7-210e-45b7-ad75-602355f47263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:31.115166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f8184c7-210e-45b7-ad75-602355f47263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:31.240169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2f8184c7-210e-45b7-ad75-602355f47263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:31.248193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2f8184c7-210e-45b7-ad75-602355f47263 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147075 Aug 06 13:04:31.248784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1789/3568] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:31 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:32.268669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-64cedd26-f400-4ffd-b568-4e29971ea706 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:32.269190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-64cedd26-f400-4ffd-b568-4e29971ea706 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:32.275465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64cedd26-f400-4ffd-b568-4e29971ea706 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:32.275935 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64cedd26-f400-4ffd-b568-4e29971ea706 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:32.276386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64cedd26-f400-4ffd-b568-4e29971ea706 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:32.277067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64cedd26-f400-4ffd-b568-4e29971ea706 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:32.277509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64cedd26-f400-4ffd-b568-4e29971ea706 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:32.277928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64cedd26-f400-4ffd-b568-4e29971ea706 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:32.402826 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-64cedd26-f400-4ffd-b568-4e29971ea706 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:32.410671 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-64cedd26-f400-4ffd-b568-4e29971ea706 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146596 Aug 06 13:04:32.411239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1780/3569] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:32 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:33.431916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-205246b3-67e6-47a9-935a-2ab6c234f289 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:33.432546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-205246b3-67e6-47a9-935a-2ab6c234f289 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:33.439090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-205246b3-67e6-47a9-935a-2ab6c234f289 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:33.440121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-205246b3-67e6-47a9-935a-2ab6c234f289 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:33.440593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-205246b3-67e6-47a9-935a-2ab6c234f289 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:33.441273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-205246b3-67e6-47a9-935a-2ab6c234f289 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:33.441724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-205246b3-67e6-47a9-935a-2ab6c234f289 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:33.442147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-205246b3-67e6-47a9-935a-2ab6c234f289 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:33.569555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-205246b3-67e6-47a9-935a-2ab6c234f289 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:33.577527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-205246b3-67e6-47a9-935a-2ab6c234f289 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149416 Aug 06 13:04:33.578079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1790/3570] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:33 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:34.599617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d826b00e-4d6a-446e-99d1-26e64468c70c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:34.600221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d826b00e-4d6a-446e-99d1-26e64468c70c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:34.606630 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d826b00e-4d6a-446e-99d1-26e64468c70c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:34.607109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d826b00e-4d6a-446e-99d1-26e64468c70c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:34.607540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d826b00e-4d6a-446e-99d1-26e64468c70c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:34.608214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d826b00e-4d6a-446e-99d1-26e64468c70c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:34.608687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d826b00e-4d6a-446e-99d1-26e64468c70c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:34.609111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d826b00e-4d6a-446e-99d1-26e64468c70c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:34.733143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d826b00e-4d6a-446e-99d1-26e64468c70c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:34.740891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d826b00e-4d6a-446e-99d1-26e64468c70c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145770 Aug 06 13:04:34.741454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1781/3571] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:34 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:35.761608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dda07466-fdad-4321-9fa8-4adf25d33a28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:35.762126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dda07466-fdad-4321-9fa8-4adf25d33a28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:35.768497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dda07466-fdad-4321-9fa8-4adf25d33a28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:35.768975 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dda07466-fdad-4321-9fa8-4adf25d33a28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:35.769409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dda07466-fdad-4321-9fa8-4adf25d33a28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:35.770093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dda07466-fdad-4321-9fa8-4adf25d33a28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:35.770541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dda07466-fdad-4321-9fa8-4adf25d33a28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:35.770962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dda07466-fdad-4321-9fa8-4adf25d33a28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:35.895035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dda07466-fdad-4321-9fa8-4adf25d33a28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:35.902892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dda07466-fdad-4321-9fa8-4adf25d33a28 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145266 Aug 06 13:04:35.903452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1791/3572] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:35 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:36.925119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-40053239-72d3-48e4-bae7-c7f0b287d1a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:36.925735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-40053239-72d3-48e4-bae7-c7f0b287d1a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:36.933106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40053239-72d3-48e4-bae7-c7f0b287d1a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:36.933600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40053239-72d3-48e4-bae7-c7f0b287d1a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:36.934035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40053239-72d3-48e4-bae7-c7f0b287d1a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:36.934731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40053239-72d3-48e4-bae7-c7f0b287d1a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:36.935182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40053239-72d3-48e4-bae7-c7f0b287d1a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:36.935606 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40053239-72d3-48e4-bae7-c7f0b287d1a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:37.068711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-40053239-72d3-48e4-bae7-c7f0b287d1a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:37.076659 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-40053239-72d3-48e4-bae7-c7f0b287d1a4 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.156258 Aug 06 13:04:37.077221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1782/3573] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:36 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:38.097331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8e8ee1b9-2bc2-4296-a260-368b8283c399 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:38.097962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8e8ee1b9-2bc2-4296-a260-368b8283c399 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:38.104560 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e8ee1b9-2bc2-4296-a260-368b8283c399 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:38.105039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e8ee1b9-2bc2-4296-a260-368b8283c399 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:38.105469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e8ee1b9-2bc2-4296-a260-368b8283c399 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:38.106146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e8ee1b9-2bc2-4296-a260-368b8283c399 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:38.106597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e8ee1b9-2bc2-4296-a260-368b8283c399 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:38.107017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e8ee1b9-2bc2-4296-a260-368b8283c399 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:38.237161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8e8ee1b9-2bc2-4296-a260-368b8283c399 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:38.245185 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8e8ee1b9-2bc2-4296-a260-368b8283c399 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151724 Aug 06 13:04:38.245760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1792/3574] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:38 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:39.266138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-46e6566e-f296-4130-9625-4c0c4563d124 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:39.266695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-46e6566e-f296-4130-9625-4c0c4563d124 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:39.273731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46e6566e-f296-4130-9625-4c0c4563d124 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:39.274200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46e6566e-f296-4130-9625-4c0c4563d124 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:39.274638 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46e6566e-f296-4130-9625-4c0c4563d124 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:39.275326 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46e6566e-f296-4130-9625-4c0c4563d124 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:39.275776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46e6566e-f296-4130-9625-4c0c4563d124 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:39.276198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46e6566e-f296-4130-9625-4c0c4563d124 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:39.402059 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-46e6566e-f296-4130-9625-4c0c4563d124 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:39.410464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-46e6566e-f296-4130-9625-4c0c4563d124 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148200 Aug 06 13:04:39.411024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1783/3575] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:39 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:40.431872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2b777f0b-8329-405d-9a1e-feefc04bf65b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:40.432575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2b777f0b-8329-405d-9a1e-feefc04bf65b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:40.438932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b777f0b-8329-405d-9a1e-feefc04bf65b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:40.439412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b777f0b-8329-405d-9a1e-feefc04bf65b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:40.439844 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b777f0b-8329-405d-9a1e-feefc04bf65b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:40.440550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b777f0b-8329-405d-9a1e-feefc04bf65b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:40.441006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b777f0b-8329-405d-9a1e-feefc04bf65b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:40.441428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b777f0b-8329-405d-9a1e-feefc04bf65b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:40.569481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2b777f0b-8329-405d-9a1e-feefc04bf65b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:40.577270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2b777f0b-8329-405d-9a1e-feefc04bf65b tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149230 Aug 06 13:04:40.577823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1793/3576] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:40 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:41.598452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-feda9fa7-a4d6-423f-a47c-0beeeb91f60f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:41.599053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-feda9fa7-a4d6-423f-a47c-0beeeb91f60f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:41.605712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-feda9fa7-a4d6-423f-a47c-0beeeb91f60f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:41.606181 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-feda9fa7-a4d6-423f-a47c-0beeeb91f60f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:41.606610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-feda9fa7-a4d6-423f-a47c-0beeeb91f60f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:41.607282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-feda9fa7-a4d6-423f-a47c-0beeeb91f60f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:41.607729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-feda9fa7-a4d6-423f-a47c-0beeeb91f60f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:41.608148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-feda9fa7-a4d6-423f-a47c-0beeeb91f60f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:41.737838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-feda9fa7-a4d6-423f-a47c-0beeeb91f60f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:41.745829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-feda9fa7-a4d6-423f-a47c-0beeeb91f60f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151294 Aug 06 13:04:41.746381 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1784/3577] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:41 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:42.766435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b568cb2b-7b99-4828-854f-e040c10f85df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:42.767075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b568cb2b-7b99-4828-854f-e040c10f85df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:42.774012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b568cb2b-7b99-4828-854f-e040c10f85df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:42.774483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b568cb2b-7b99-4828-854f-e040c10f85df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:42.774907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b568cb2b-7b99-4828-854f-e040c10f85df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:42.775576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b568cb2b-7b99-4828-854f-e040c10f85df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:42.776018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b568cb2b-7b99-4828-854f-e040c10f85df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:42.776471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b568cb2b-7b99-4828-854f-e040c10f85df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:42.902613 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b568cb2b-7b99-4828-854f-e040c10f85df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:42.910463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b568cb2b-7b99-4828-854f-e040c10f85df tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.147826 Aug 06 13:04:42.911023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1794/3578] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:42 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:43.931208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d8aff9c-3f05-4687-99cb-d404ca5e4eec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:43.931769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1d8aff9c-3f05-4687-99cb-d404ca5e4eec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:43.934055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=26 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:04:43.939361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8aff9c-3f05-4687-99cb-d404ca5e4eec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:43.940361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8aff9c-3f05-4687-99cb-d404ca5e4eec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:43.940805 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8aff9c-3f05-4687-99cb-d404ca5e4eec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:43.941501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8aff9c-3f05-4687-99cb-d404ca5e4eec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:43.941961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8aff9c-3f05-4687-99cb-d404ca5e4eec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:43.942391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d8aff9c-3f05-4687-99cb-d404ca5e4eec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:44.073697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1d8aff9c-3f05-4687-99cb-d404ca5e4eec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:44.082454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1d8aff9c-3f05-4687-99cb-d404ca5e4eec tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.155223 Aug 06 13:04:44.083019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1785/3579] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:43 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:45.103410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-89ad2b46-5251-4cc1-b196-7c410ebdeaa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:45.104007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-89ad2b46-5251-4cc1-b196-7c410ebdeaa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:45.110402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89ad2b46-5251-4cc1-b196-7c410ebdeaa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:45.110874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89ad2b46-5251-4cc1-b196-7c410ebdeaa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:45.111301 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89ad2b46-5251-4cc1-b196-7c410ebdeaa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:45.112023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89ad2b46-5251-4cc1-b196-7c410ebdeaa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:45.112494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89ad2b46-5251-4cc1-b196-7c410ebdeaa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:45.112912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-89ad2b46-5251-4cc1-b196-7c410ebdeaa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:45.115405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=78 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:04:45.241874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-89ad2b46-5251-4cc1-b196-7c410ebdeaa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:45.249643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-89ad2b46-5251-4cc1-b196-7c410ebdeaa6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.150276 Aug 06 13:04:45.250159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1795/3580] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:45 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:04:46.270559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ac38adc8-d3f5-4555-984b-51944938567a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:46.271119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ac38adc8-d3f5-4555-984b-51944938567a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:46.277501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac38adc8-d3f5-4555-984b-51944938567a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:46.277977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac38adc8-d3f5-4555-984b-51944938567a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:46.278407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac38adc8-d3f5-4555-984b-51944938567a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:46.279085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac38adc8-d3f5-4555-984b-51944938567a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:46.279537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac38adc8-d3f5-4555-984b-51944938567a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:46.279957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac38adc8-d3f5-4555-984b-51944938567a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:46.282466 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=78 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:04:46.409909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ac38adc8-d3f5-4555-984b-51944938567a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:46.418333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ac38adc8-d3f5-4555-984b-51944938567a tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.151672 Aug 06 13:04:46.418884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1786/3581] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:46 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:47.440543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f5f4c3ab-5abf-475d-a706-8691e23544c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:47.441147 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f5f4c3ab-5abf-475d-a706-8691e23544c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:47.443899 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=26 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:04:47.450010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5f4c3ab-5abf-475d-a706-8691e23544c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:47.450492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5f4c3ab-5abf-475d-a706-8691e23544c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:47.450925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5f4c3ab-5abf-475d-a706-8691e23544c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:47.451689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5f4c3ab-5abf-475d-a706-8691e23544c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:47.452143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5f4c3ab-5abf-475d-a706-8691e23544c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:47.452595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f5f4c3ab-5abf-475d-a706-8691e23544c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:47.576916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f5f4c3ab-5abf-475d-a706-8691e23544c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:47.584757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f5f4c3ab-5abf-475d-a706-8691e23544c7 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148773 Aug 06 13:04:47.585316 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1796/3582] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:47 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:48.604540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ac137d4d-7a72-4768-ac17-d861173e7d7e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:48.605143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ac137d4d-7a72-4768-ac17-d861173e7d7e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:48.611396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac137d4d-7a72-4768-ac17-d861173e7d7e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:48.611847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac137d4d-7a72-4768-ac17-d861173e7d7e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:48.612274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac137d4d-7a72-4768-ac17-d861173e7d7e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:48.612977 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac137d4d-7a72-4768-ac17-d861173e7d7e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:48.613423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac137d4d-7a72-4768-ac17-d861173e7d7e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:48.613843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac137d4d-7a72-4768-ac17-d861173e7d7e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:48.738415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ac137d4d-7a72-4768-ac17-d861173e7d7e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:48.746268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ac137d4d-7a72-4768-ac17-d861173e7d7e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.145839 Aug 06 13:04:48.746825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1787/3583] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:48 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:49.768261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e4a3984e-69fc-4e52-b4f8-d45f4db0e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:49.768883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e4a3984e-69fc-4e52-b4f8-d45f4db0e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:49.775167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4a3984e-69fc-4e52-b4f8-d45f4db0e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:49.775639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4a3984e-69fc-4e52-b4f8-d45f4db0e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:49.776065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4a3984e-69fc-4e52-b4f8-d45f4db0e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:49.776770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4a3984e-69fc-4e52-b4f8-d45f4db0e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:49.777218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4a3984e-69fc-4e52-b4f8-d45f4db0e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:49.777634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e4a3984e-69fc-4e52-b4f8-d45f4db0e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:49.905807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e4a3984e-69fc-4e52-b4f8-d45f4db0e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:49.913682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e4a3984e-69fc-4e52-b4f8-d45f4db0e62c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.149835 Aug 06 13:04:49.914243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1797/3584] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:49 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:50.934309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5984442e-518f-4541-b399-f4b200770ea6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:50.934915 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5984442e-518f-4541-b399-f4b200770ea6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:50.941795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5984442e-518f-4541-b399-f4b200770ea6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:50.942278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5984442e-518f-4541-b399-f4b200770ea6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:50.942716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5984442e-518f-4541-b399-f4b200770ea6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:50.943398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5984442e-518f-4541-b399-f4b200770ea6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:50.943849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5984442e-518f-4541-b399-f4b200770ea6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:50.944272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5984442e-518f-4541-b399-f4b200770ea6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:51.068769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5984442e-518f-4541-b399-f4b200770ea6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:51.076756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5984442e-518f-4541-b399-f4b200770ea6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.146272 Aug 06 13:04:51.077320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1788/3585] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:50 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:52.097984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-244101ce-7901-4036-8a9f-4c3a2dafddc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:52.098595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-244101ce-7901-4036-8a9f-4c3a2dafddc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 7a8a8915-eeca-4909-aab7-6fe8381ced6e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:04:52.105254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-244101ce-7901-4036-8a9f-4c3a2dafddc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:52.105734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-244101ce-7901-4036-8a9f-4c3a2dafddc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:52.106169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-244101ce-7901-4036-8a9f-4c3a2dafddc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:52.106853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-244101ce-7901-4036-8a9f-4c3a2dafddc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:52.107307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-244101ce-7901-4036-8a9f-4c3a2dafddc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:52.107731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-244101ce-7901-4036-8a9f-4c3a2dafddc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:52.232735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-244101ce-7901-4036-8a9f-4c3a2dafddc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:04:52.242669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-244101ce-7901-4036-8a9f-4c3a2dafddc2 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e" status: 200 len: 1736 microversion: 2.1 time: 0.148762 Aug 06 13:04:52.243273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1798/3586] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:04:52 2022] GET /compute/v2.1/servers/7a8a8915-eeca-4909-aab7-6fe8381ced6e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:04:52.263817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-25cf2118-e4d4-4327-bf7e-5f3506c2f874 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '.version_select at 0x7f541f2043a0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:04:52.282667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-25cf2118-e4d4-4327-bf7e-5f3506c2f874 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906258088" status: 202 len: 0 microversion: 2.1 time: 0.022659 Aug 06 13:04:52.283216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1789/3587] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Aug 6 13:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906258088 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:04:53.514995 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-85d14dcf-bbbd-4419-8b63-e8107a2eb198 req-336789bd-d90d-43da-b550-53b0842c4653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8a8915-eeca-4909-aab7-6fe8381ced6e", "tag": "57231bce-1a43-402f-869f-8f5913fcf388"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:04:53.524992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-85d14dcf-bbbd-4419-8b63-e8107a2eb198 req-336789bd-d90d-43da-b550-53b0842c4653 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:04:53.525583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-85d14dcf-bbbd-4419-8b63-e8107a2eb198 req-336789bd-d90d-43da-b550-53b0842c4653 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:04:53.526072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-85d14dcf-bbbd-4419-8b63-e8107a2eb198 req-336789bd-d90d-43da-b550-53b0842c4653 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:04:53.537693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-85d14dcf-bbbd-4419-8b63-e8107a2eb198 req-336789bd-d90d-43da-b550-53b0842c4653 service nova] Creating event network-changed:57231bce-1a43-402f-869f-8f5913fcf388 for instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e on hv-cinder-85199 Aug 06 13:04:53.543219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-85d14dcf-bbbd-4419-8b63-e8107a2eb198 req-336789bd-d90d-43da-b550-53b0842c4653 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145704 Aug 06 13:04:53.543813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1799/3588] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:05:16.787319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:05:16.788007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 13:05:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:05:21.105076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:05:21.105686 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 13:05:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:05:23.564371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:05:23.564998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:05:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:05:42.370174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:05:42.370795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:05:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:06:23.484809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=17 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:23.485834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:23.490791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4e42ff9a-64fb-4c0e-904c-d12692895559 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3dffac9-1c0a-4e99-862b-d45d7eeab969"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:23.493128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4e42ff9a-64fb-4c0e-904c-d12692895559 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:23.501371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e42ff9a-64fb-4c0e-904c-d12692895559 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:23.501856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e42ff9a-64fb-4c0e-904c-d12692895559 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:23.502302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e42ff9a-64fb-4c0e-904c-d12692895559 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:23.502981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e42ff9a-64fb-4c0e-904c-d12692895559 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:23.503431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e42ff9a-64fb-4c0e-904c-d12692895559 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:23.503854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e42ff9a-64fb-4c0e-904c-d12692895559 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:24.092245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=7 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:24.093471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=25 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:24.098973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6035f9f3-034d-475b-92ef-112cc65a2521 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:24.099825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6035f9f3-034d-475b-92ef-112cc65a2521 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:24.108484 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6035f9f3-034d-475b-92ef-112cc65a2521 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:24.108981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6035f9f3-034d-475b-92ef-112cc65a2521 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:24.109409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6035f9f3-034d-475b-92ef-112cc65a2521 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:24.110317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6035f9f3-034d-475b-92ef-112cc65a2521 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:24.110772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6035f9f3-034d-475b-92ef-112cc65a2521 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:24.111194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6035f9f3-034d-475b-92ef-112cc65a2521 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:24.137011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-6035f9f3-034d-475b-92ef-112cc65a2521 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lazy-loading 'flavor' on Instance uuid e9511bf2-6616-4fd6-9739-6c901a1da341 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 13:06:24.218869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4e42ff9a-64fb-4c0e-904c-d12692895559 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735697 Aug 06 13:06:24.224558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1790/3589] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 13:06:23 2022] POST /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:24.330819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6035f9f3-034d-475b-92ef-112cc65a2521 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/action" status: 202 len: 0 microversion: 2.20 time: 0.241041 Aug 06 13:06:24.331959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1800/3590] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Aug 6 13:06:24 2022] POST /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 06 13:06:24.342262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:24.344105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:24.352945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:24.353467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:24.353873 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:24.354623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:24.355057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:24.355462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:24.490649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:24.498547 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:24.500649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:24.501807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e223360-d414-406e-9613-ce911eea3a42 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.165015 Aug 06 13:06:24.502359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1791/3591] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:24 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:24.629347 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-01cc50db-fac0-4ac6-97d6-5d278330bbbd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26c4737f-8c2d-4bce-934c-46ef9ffce317"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:24.631674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-01cc50db-fac0-4ac6-97d6-5d278330bbbd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:24.641335 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01cc50db-fac0-4ac6-97d6-5d278330bbbd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:24.641813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01cc50db-fac0-4ac6-97d6-5d278330bbbd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:24.642246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01cc50db-fac0-4ac6-97d6-5d278330bbbd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:24.642942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01cc50db-fac0-4ac6-97d6-5d278330bbbd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:24.643376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01cc50db-fac0-4ac6-97d6-5d278330bbbd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:24.643795 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-01cc50db-fac0-4ac6-97d6-5d278330bbbd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:25.525995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:25.527425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:25.534394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:25.535179 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:25.535893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:25.536783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:25.539722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:25.540350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:25.739665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-01cc50db-fac0-4ac6-97d6-5d278330bbbd tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "POST /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.114814 Aug 06 13:06:25.741059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1801/3592] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 13:06:24 2022] POST /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments => generated 194 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:25.755702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:25.764866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:25.769718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:25.771755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4649b4fc-3cae-46a9-a4eb-ed84cb6191d8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.250903 Aug 06 13:06:25.772342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1792/3593] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:25 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:06:26.691822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-b7d2ca85-00b4-4a67-bc74-73d1131d9f8f req-bd924977-c8e5-4308-a9f1-6177ef47ad56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe4447d-8246-4c34-8a89-98d7c5ac616c", "name": "network-vif-deleted", "tag": "5c5e32b7-d380-492c-b171-a592fe2514b2"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:26.707594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-b7d2ca85-00b4-4a67-bc74-73d1131d9f8f req-bd924977-c8e5-4308-a9f1-6177ef47ad56 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:26.708072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-b7d2ca85-00b4-4a67-bc74-73d1131d9f8f req-bd924977-c8e5-4308-a9f1-6177ef47ad56 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:26.708644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-b7d2ca85-00b4-4a67-bc74-73d1131d9f8f req-bd924977-c8e5-4308-a9f1-6177ef47ad56 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:26.721751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-b7d2ca85-00b4-4a67-bc74-73d1131d9f8f req-bd924977-c8e5-4308-a9f1-6177ef47ad56 service nova] Creating event network-vif-deleted:5c5e32b7-d380-492c-b171-a592fe2514b2 for instance efe4447d-8246-4c34-8a89-98d7c5ac616c on hv-cinder-85199 Aug 06 13:06:26.726910 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-b7d2ca85-00b4-4a67-bc74-73d1131d9f8f req-bd924977-c8e5-4308-a9f1-6177ef47ad56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164987 Aug 06 13:06:26.727575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1802/3594] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:26.794680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:26.795280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:26.802192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:26.802670 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:26.803093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:26.803767 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:26.804212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:26.804649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:26.974308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:26.983004 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:26.984744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:26.985905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0d9e5204-1da8-4a99-bac6-b3911233df3a tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.195272 Aug 06 13:06:26.986456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1793/3595] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:26 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:28.014642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:28.015884 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:28.022908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:28.023591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:28.024234 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:28.025130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:28.025756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:28.026364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:28.253228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:28.264257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:28.266435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:28.268627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-75e35467-2dff-476a-8e79-0805d65daaec tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.258622 Aug 06 13:06:28.280336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1803/3596] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:28 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:29.146652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-61746c33-421c-42e4-b6e0-e25788027402 req-d0335114-5a7e-49ec-a27c-62a02ccf4fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8a8915-eeca-4909-aab7-6fe8381ced6e", "name": "network-vif-deleted", "tag": "57231bce-1a43-402f-869f-8f5913fcf388"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:29.160446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-61746c33-421c-42e4-b6e0-e25788027402 req-d0335114-5a7e-49ec-a27c-62a02ccf4fc7 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:29.161011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-61746c33-421c-42e4-b6e0-e25788027402 req-d0335114-5a7e-49ec-a27c-62a02ccf4fc7 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:29.161504 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-61746c33-421c-42e4-b6e0-e25788027402 req-d0335114-5a7e-49ec-a27c-62a02ccf4fc7 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:29.184076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-61746c33-421c-42e4-b6e0-e25788027402 req-d0335114-5a7e-49ec-a27c-62a02ccf4fc7 service nova] Creating event network-vif-deleted:57231bce-1a43-402f-869f-8f5913fcf388 for instance 7a8a8915-eeca-4909-aab7-6fe8381ced6e on hv-cinder-85199 Aug 06 13:06:29.192732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-61746c33-421c-42e4-b6e0-e25788027402 req-d0335114-5a7e-49ec-a27c-62a02ccf4fc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050461 Aug 06 13:06:29.193657 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1794/3597] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:06:29.293766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:29.295073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:29.302427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:29.303123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:29.303985 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:29.305085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:29.305727 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:29.306551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:29.473952 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:29.483650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:29.485272 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:29.487060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0cba7213-257d-4908-bb99-c7252038dc48 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.198268 Aug 06 13:06:29.488646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1804/3598] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:29 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:30.512558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:30.514673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:30.522403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:30.523200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:30.523828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:30.524894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:30.525563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:30.526169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:30.690421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:30.708714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:30.710914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:30.712123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bbaf3d88-e978-4a95-8245-86f86498e8b0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.204622 Aug 06 13:06:30.725329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1795/3599] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:30 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:31.216070 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-fa0e62dd-c8fe-4e51-8a39-590305a0b364 req-2077f143-cdd9-4f4e-a024-169cf5273756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5982553-7c7c-4d67-bb7e-13ac69cfc674", "name": "network-vif-deleted", "tag": "16a90f6e-485c-4787-91f0-a0bca7134d68"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:31.242661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-fa0e62dd-c8fe-4e51-8a39-590305a0b364 req-2077f143-cdd9-4f4e-a024-169cf5273756 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:31.243888 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-fa0e62dd-c8fe-4e51-8a39-590305a0b364 req-2077f143-cdd9-4f4e-a024-169cf5273756 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:31.244446 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-fa0e62dd-c8fe-4e51-8a39-590305a0b364 req-2077f143-cdd9-4f4e-a024-169cf5273756 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:31.268152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-fa0e62dd-c8fe-4e51-8a39-590305a0b364 req-2077f143-cdd9-4f4e-a024-169cf5273756 service nova] Creating event network-vif-deleted:16a90f6e-485c-4787-91f0-a0bca7134d68 for instance e5982553-7c7c-4d67-bb7e-13ac69cfc674 on hv-cinder-85199 Aug 06 13:06:31.274336 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-fa0e62dd-c8fe-4e51-8a39-590305a0b364 req-2077f143-cdd9-4f4e-a024-169cf5273756 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063260 Aug 06 13:06:31.276768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1805/3600] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:31.736598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:31.737270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:31.746321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:31.750578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:31.751041 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:31.751794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:31.752257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:31.752712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:32.073731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:32.082705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:32.084369 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:32.086183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f84112e2-b615-438f-b287-a706873120f7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.353553 Aug 06 13:06:32.088906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1796/3601] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:31 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:33.109830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:33.111777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:33.120570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:33.121310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:33.121936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:33.122692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:33.123154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:33.123733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:33.278928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:33.289743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:33.291330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:33.292851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fc70c36d-1842-4ffc-a63a-729e2b52b0e7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.187246 Aug 06 13:06:33.293892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1806/3602] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:33 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:34.316965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:34.318138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:34.325388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:34.326198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:34.326850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:34.327797 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:34.328513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:34.329154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:34.626730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:34.636877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:34.638414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:34.640118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b8247217-bcdb-4aa7-8ca3-3df323c4cad3 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.326718 Aug 06 13:06:34.640692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1797/3603] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:34 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:35.125860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3dffac9-1c0a-4e99-862b-d45d7eeab969"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:35.128345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:35.137073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:35.137861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:35.138528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:35.140124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:35.141608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:35.142537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:35.324534 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Invalid volume: volume d3dffac9-1c0a-4e99-862b-d45d7eeab969 is already attached to instances: b858f51c-0983-4ec0-85a2-d955c78aff33 Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: POST /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments HTTP/1.1 Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 74 Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:06:35.326726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {"volumeAttachment": {"volumeId": "d3dffac9-1c0a-4e99-862b-d45d7eeab969"}} Aug 06 13:06:35.330451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Invalid volume: volume d3dffac9-1c0a-4e99-862b-d45d7eeab969 is already attached to instances: b858f51c-0983-4ec0-85a2-d955c78aff33 Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': 'b858f51c-0983-4ec0-85a2-d955c78aff33', 'body': {'volumeAttachment': {'volumeId': 'd3dffac9-1c0a-4e99-862b-d45d7eeab969'}}} Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d3dffac9-1c0a-4e99-862b-d45d7eeab969 is already attached to instances: b858f51c-0983-4ec0-85a2-d955c78aff33 Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:06:35.331584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d3dffac9-1c0a-4e99-862b-d45d7eeab969 is already attached to instances: b858f51c-0983-4ec0-85a2-d955c78aff33 Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:06:35.333777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:06:35.336807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:06:35.336807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:06:35.336807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:06:35.336807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d3dffac9-1c0a-4e99-862b-d45d7eeab969 is already attached to instances: b858f51c-0983-4ec0-85a2-d955c78aff33 Aug 06 13:06:35.336807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:06:35.336807 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 400 to user: Invalid volume: volume d3dffac9-1c0a-4e99-862b-d45d7eeab969 is already attached to instances: b858f51c-0983-4ec0-85a2-d955c78aff33 {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:06:35.339116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d4f977d7-f3d0-4ade-ae9f-ef1a7fb211ce tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.218214 Aug 06 13:06:35.340052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1807/3604] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 13:06:35 2022] POST /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments => generated 174 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 13:06:35.438628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eca5b2e5-227f-47ba-ac49-d127cba05de2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:35.439851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eca5b2e5-227f-47ba-ac49-d127cba05de2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:35.451656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca5b2e5-227f-47ba-ac49-d127cba05de2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:35.453092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca5b2e5-227f-47ba-ac49-d127cba05de2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:35.453735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca5b2e5-227f-47ba-ac49-d127cba05de2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:35.454666 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca5b2e5-227f-47ba-ac49-d127cba05de2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:35.455311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca5b2e5-227f-47ba-ac49-d127cba05de2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:35.456324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eca5b2e5-227f-47ba-ac49-d127cba05de2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:35.602173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-eca5b2e5-227f-47ba-ac49-d127cba05de2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lazy-loading 'services' on Instance uuid b858f51c-0983-4ec0-85a2-d955c78aff33 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 13:06:35.663552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:35.663999 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:35.672455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:35.675904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:35.676735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:35.678890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:35.680373 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:35.681266 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:35.815683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eca5b2e5-227f-47ba-ac49-d127cba05de2 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments/d3dffac9-1c0a-4e99-862b-d45d7eeab969" status: 202 len: 0 microversion: 2.1 time: 0.381290 Aug 06 13:06:35.825807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1798/3605] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 13:06:35 2022] DELETE /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments/d3dffac9-1c0a-4e99-862b-d45d7eeab969 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:06:35.842580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-43d74314-6714-4419-ba86-1ad30e25e249 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:35.847834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-43d74314-6714-4419-ba86-1ad30e25e249 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:35.868458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-43d74314-6714-4419-ba86-1ad30e25e249 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:35.872735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-43d74314-6714-4419-ba86-1ad30e25e249 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:35.874897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-43d74314-6714-4419-ba86-1ad30e25e249 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:35.875949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-43d74314-6714-4419-ba86-1ad30e25e249 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:35.876617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-43d74314-6714-4419-ba86-1ad30e25e249 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:35.877235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-43d74314-6714-4419-ba86-1ad30e25e249 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:35.927420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-43d74314-6714-4419-ba86-1ad30e25e249 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096048 Aug 06 13:06:35.928320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1799/3606] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:06:35 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:36.197302 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:36.207191 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:36.213395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:36.214624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-36e2b48f-e22e-4b4c-8179-5d7b9607c276 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.555034 Aug 06 13:06:36.234261 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1808/3607] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:35 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:06:36.944113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-663dd942-c261-41df-8c77-18d22c69d327 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:36.947372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-663dd942-c261-41df-8c77-18d22c69d327 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:36.960010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-663dd942-c261-41df-8c77-18d22c69d327 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:36.960602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-663dd942-c261-41df-8c77-18d22c69d327 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:36.961277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-663dd942-c261-41df-8c77-18d22c69d327 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:36.964071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-663dd942-c261-41df-8c77-18d22c69d327 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:36.964811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-663dd942-c261-41df-8c77-18d22c69d327 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:36.966563 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-663dd942-c261-41df-8c77-18d22c69d327 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:37.027049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-663dd942-c261-41df-8c77-18d22c69d327 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090040 Aug 06 13:06:37.027820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1800/3608] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:06:36 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:37.243429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:37.245857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:37.255770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:37.256264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:37.257507 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:37.258342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:37.258816 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:37.259236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:37.526575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:37.545471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:37.547588 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:37.551235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2a42b33c-a985-4910-811d-22677ad1aef9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.312745 Aug 06 13:06:37.567016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1809/3609] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:37 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:38.039362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4c16a567-adfd-40be-8fcb-012d94d35feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:38.042123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4c16a567-adfd-40be-8fcb-012d94d35feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:38.050706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c16a567-adfd-40be-8fcb-012d94d35feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:38.051594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c16a567-adfd-40be-8fcb-012d94d35feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:38.052261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c16a567-adfd-40be-8fcb-012d94d35feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:38.053219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c16a567-adfd-40be-8fcb-012d94d35feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:38.053681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c16a567-adfd-40be-8fcb-012d94d35feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:38.054281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c16a567-adfd-40be-8fcb-012d94d35feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:38.095227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4c16a567-adfd-40be-8fcb-012d94d35feb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060007 Aug 06 13:06:38.096356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1801/3610] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:06:38 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:38.574499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:38.575180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:38.582109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:38.582663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:38.583102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:38.583779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:38.584227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:38.584673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:38.752176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:38.761836 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:38.767769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:38.770842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-02cbb1a7-0251-41e1-9ec9-f08c966312d5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.200232 Aug 06 13:06:38.772420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1810/3611] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:38 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:39.107597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c2ffb46e-040b-4930-b8e8-34566806db0b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:39.110251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c2ffb46e-040b-4930-b8e8-34566806db0b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:39.116962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2ffb46e-040b-4930-b8e8-34566806db0b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:39.117468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2ffb46e-040b-4930-b8e8-34566806db0b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:39.118079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2ffb46e-040b-4930-b8e8-34566806db0b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:39.119012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2ffb46e-040b-4930-b8e8-34566806db0b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:39.119627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2ffb46e-040b-4930-b8e8-34566806db0b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:39.120229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2ffb46e-040b-4930-b8e8-34566806db0b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:39.150501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c2ffb46e-040b-4930-b8e8-34566806db0b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 Aug 06 13:06:39.155100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1802/3612] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:06:39 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:39.793209 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:39.793774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:39.806173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:39.806675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:39.807116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:39.807826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:39.808284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:39.808749 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:39.987027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:40.004879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:40.006593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:40.007922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b2ca8a1c-5672-4440-868a-b9d897b9a535 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.218740 Aug 06 13:06:40.009008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1811/3613] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:39 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:40.162924 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5ea8001a-6920-4bb0-8335-e4f69928fa63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:40.165892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5ea8001a-6920-4bb0-8335-e4f69928fa63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:40.178072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea8001a-6920-4bb0-8335-e4f69928fa63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:40.178929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea8001a-6920-4bb0-8335-e4f69928fa63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:40.179839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea8001a-6920-4bb0-8335-e4f69928fa63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:40.180946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea8001a-6920-4bb0-8335-e4f69928fa63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:40.181603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea8001a-6920-4bb0-8335-e4f69928fa63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:40.182227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5ea8001a-6920-4bb0-8335-e4f69928fa63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:40.219605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5ea8001a-6920-4bb0-8335-e4f69928fa63 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061168 Aug 06 13:06:40.222557 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1803/3614] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:06:40 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:41.035233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:41.037421 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:41.045226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:41.046632 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:41.047140 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:41.047922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:41.048482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:41.049148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:41.232118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bf543ec6-aa58-4a0a-adc4-1ca796660d13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:41.235892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bf543ec6-aa58-4a0a-adc4-1ca796660d13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:41.240243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:41.254376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:41.256719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:41.259399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf543ec6-aa58-4a0a-adc4-1ca796660d13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:41.261136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dc377c10-1cd1-44e9-aca6-00795ef53ecd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.229783 Aug 06 13:06:41.261726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1812/3615] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:41 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:41.262231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf543ec6-aa58-4a0a-adc4-1ca796660d13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:41.263001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf543ec6-aa58-4a0a-adc4-1ca796660d13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:41.263984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf543ec6-aa58-4a0a-adc4-1ca796660d13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:41.265875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf543ec6-aa58-4a0a-adc4-1ca796660d13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:41.266589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf543ec6-aa58-4a0a-adc4-1ca796660d13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:41.318748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bf543ec6-aa58-4a0a-adc4-1ca796660d13 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090293 Aug 06 13:06:41.320248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1804/3616] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:06:41 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:06:42.286189 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:42.287487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:42.303020 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:42.309738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:42.321120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:42.322156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:42.322843 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:42.323597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:42.333695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-41bb9501-f65c-4b71-b5fb-1129744b5ecd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:42.335842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-41bb9501-f65c-4b71-b5fb-1129744b5ecd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:42.349825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41bb9501-f65c-4b71-b5fb-1129744b5ecd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:42.350808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41bb9501-f65c-4b71-b5fb-1129744b5ecd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:42.351774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41bb9501-f65c-4b71-b5fb-1129744b5ecd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:42.355249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41bb9501-f65c-4b71-b5fb-1129744b5ecd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:42.356006 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41bb9501-f65c-4b71-b5fb-1129744b5ecd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:42.356721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41bb9501-f65c-4b71-b5fb-1129744b5ecd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:42.361899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:42.418072 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-41bb9501-f65c-4b71-b5fb-1129744b5ecd tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087352 Aug 06 13:06:42.420170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1805/3617] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:06:42 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:06:42.429581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-03e89bdc-f7d7-481c-a283-bfe31b6a500f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:42.432100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-03e89bdc-f7d7-481c-a283-bfe31b6a500f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:42.438669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03e89bdc-f7d7-481c-a283-bfe31b6a500f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:42.439383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03e89bdc-f7d7-481c-a283-bfe31b6a500f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:42.439996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03e89bdc-f7d7-481c-a283-bfe31b6a500f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:42.440888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03e89bdc-f7d7-481c-a283-bfe31b6a500f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:42.441501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03e89bdc-f7d7-481c-a283-bfe31b6a500f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:42.442085 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03e89bdc-f7d7-481c-a283-bfe31b6a500f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:42.479128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-03e89bdc-f7d7-481c-a283-bfe31b6a500f tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056058 Aug 06 13:06:42.480393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1806/3618] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:06:42 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:42.494234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-afc8d436-3603-4c8f-baa7-8ac07223791c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:42.495243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-afc8d436-3603-4c8f-baa7-8ac07223791c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:42.503852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afc8d436-3603-4c8f-baa7-8ac07223791c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:42.504691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afc8d436-3603-4c8f-baa7-8ac07223791c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:42.505127 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afc8d436-3603-4c8f-baa7-8ac07223791c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:42.506084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afc8d436-3603-4c8f-baa7-8ac07223791c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:42.506533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afc8d436-3603-4c8f-baa7-8ac07223791c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:42.506945 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afc8d436-3603-4c8f-baa7-8ac07223791c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:42.532808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:42.543277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-afc8d436-3603-4c8f-baa7-8ac07223791c tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments/26c4737f-8c2d-4bce-934c-46ef9ffce317" status: 200 len: 194 microversion: 2.1 time: 0.055637 Aug 06 13:06:42.544422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1807/3619] 10.222.0.20 () {58 vars in 1413 bytes} [Sat Aug 6 13:06:42 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments/26c4737f-8c2d-4bce-934c-46ef9ffce317 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:06:42.551577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:42.554303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:42.555776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-740abde5-c927-4c02-80f3-efcd202136a9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1741 microversion: 2.20 time: 0.273774 Aug 06 13:06:42.557354 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1813/3620] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:42 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1741 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:43.432216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa20f113-1e43-4e44-acf7-c9a109213092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:43.435948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa20f113-1e43-4e44-acf7-c9a109213092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:43.450267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa20f113-1e43-4e44-acf7-c9a109213092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:43.450761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa20f113-1e43-4e44-acf7-c9a109213092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:43.451195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa20f113-1e43-4e44-acf7-c9a109213092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:43.452535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa20f113-1e43-4e44-acf7-c9a109213092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:43.453475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa20f113-1e43-4e44-acf7-c9a109213092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:43.453911 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa20f113-1e43-4e44-acf7-c9a109213092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:43.493011 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa20f113-1e43-4e44-acf7-c9a109213092 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064651 Aug 06 13:06:43.494362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1808/3621] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:06:43 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 13:06:43.582128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e619976c-cd11-40b3-98e2-eeaaaaea5234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:43.582777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e619976c-cd11-40b3-98e2-eeaaaaea5234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:43.583938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:43.586308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:43.590485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e619976c-cd11-40b3-98e2-eeaaaaea5234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:43.591321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e619976c-cd11-40b3-98e2-eeaaaaea5234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:43.591984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e619976c-cd11-40b3-98e2-eeaaaaea5234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:43.592974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e619976c-cd11-40b3-98e2-eeaaaaea5234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:43.593655 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e619976c-cd11-40b3-98e2-eeaaaaea5234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:43.594300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e619976c-cd11-40b3-98e2-eeaaaaea5234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:43.597906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:43.598414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:43.598856 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:43.599561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:43.605121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:43.605789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:43.625746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:43.632102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e619976c-cd11-40b3-98e2-eeaaaaea5234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 13:06:43.781834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e619976c-cd11-40b3-98e2-eeaaaaea5234 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 204 len: 0 microversion: 2.1 time: 0.203681 Aug 06 13:06:43.785476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1814/3622] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:06:43 2022] DELETE /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:06:43.796074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-036520d2-efec-4620-8bb2-fe772549434c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:43.796852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-036520d2-efec-4620-8bb2-fe772549434c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:43.813617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-036520d2-efec-4620-8bb2-fe772549434c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:43.814112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-036520d2-efec-4620-8bb2-fe772549434c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:43.814552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-036520d2-efec-4620-8bb2-fe772549434c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:43.815425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-036520d2-efec-4620-8bb2-fe772549434c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:43.815890 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-036520d2-efec-4620-8bb2-fe772549434c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:43.816328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-036520d2-efec-4620-8bb2-fe772549434c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:43.858796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:43.874753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:43.876270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:43.877672 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2e0bcc3b-97a2-477a-aec5-5e05c53fea67 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1741 microversion: 2.20 time: 0.299001 Aug 06 13:06:43.878426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1809/3623] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:43 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1741 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:44.009433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-036520d2-efec-4620-8bb2-fe772549434c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:44.017195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-036520d2-efec-4620-8bb2-fe772549434c tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1681 microversion: 2.1 time: 0.230299 Aug 06 13:06:44.028049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1815/3624] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:43 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:44.168551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e0a6b503-b0b2-4736-bf48-7850cdfd18d8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f908efe-fd55-46c5-a2a1-41dc02c97d63"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:44.172093 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e0a6b503-b0b2-4736-bf48-7850cdfd18d8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:44.178433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0a6b503-b0b2-4736-bf48-7850cdfd18d8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:44.179138 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0a6b503-b0b2-4736-bf48-7850cdfd18d8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:44.179869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0a6b503-b0b2-4736-bf48-7850cdfd18d8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:44.180807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0a6b503-b0b2-4736-bf48-7850cdfd18d8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:44.181435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0a6b503-b0b2-4736-bf48-7850cdfd18d8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:44.182033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0a6b503-b0b2-4736-bf48-7850cdfd18d8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:44.527939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e0a6b503-b0b2-4736-bf48-7850cdfd18d8 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "POST /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363959 Aug 06 13:06:44.531204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1810/3625] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 13:06:44 2022] POST /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:44.900970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:44.902849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:44.929321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:44.935662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:44.936869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:44.938880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:44.940802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:44.942872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:45.039404 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff91ccdf-7664-4c99-a45a-50060fe77426 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:45.040336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ff91ccdf-7664-4c99-a45a-50060fe77426 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:45.053195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff91ccdf-7664-4c99-a45a-50060fe77426 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:45.054027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff91ccdf-7664-4c99-a45a-50060fe77426 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:45.054965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff91ccdf-7664-4c99-a45a-50060fe77426 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:45.057331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff91ccdf-7664-4c99-a45a-50060fe77426 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:45.060721 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff91ccdf-7664-4c99-a45a-50060fe77426 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:45.061777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff91ccdf-7664-4c99-a45a-50060fe77426 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:45.179612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:45.190449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:45.192256 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:45.193732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-930cd8b3-7647-4d9d-8fb6-00a83f749ab1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1741 microversion: 2.20 time: 0.296755 Aug 06 13:06:45.194355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1816/3626] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:44 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1741 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:45.221777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ff91ccdf-7664-4c99-a45a-50060fe77426 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:45.231526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff91ccdf-7664-4c99-a45a-50060fe77426 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1681 microversion: 2.1 time: 0.196778 Aug 06 13:06:45.232322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1811/3627] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:45 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:45.352584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-9610f49c-689c-4b7b-98b5-79dd25539ac9 req-a6a71f8b-8e0e-4852-97d1-5d9dfa3516d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9511bf2-6616-4fd6-9739-6c901a1da341", "name": "network-vif-plugged", "status": "completed", "tag": "5653f9b3-1473-445f-9406-188160ed27ac"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:45.362682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9610f49c-689c-4b7b-98b5-79dd25539ac9 req-a6a71f8b-8e0e-4852-97d1-5d9dfa3516d5 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:45.365732 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9610f49c-689c-4b7b-98b5-79dd25539ac9 req-a6a71f8b-8e0e-4852-97d1-5d9dfa3516d5 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:45.366418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9610f49c-689c-4b7b-98b5-79dd25539ac9 req-a6a71f8b-8e0e-4852-97d1-5d9dfa3516d5 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:45.379854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-9610f49c-689c-4b7b-98b5-79dd25539ac9 req-a6a71f8b-8e0e-4852-97d1-5d9dfa3516d5 service nova] Creating event network-vif-plugged:5653f9b3-1473-445f-9406-188160ed27ac for instance e9511bf2-6616-4fd6-9739-6c901a1da341 on hv-cinder-85199 Aug 06 13:06:45.399707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-9610f49c-689c-4b7b-98b5-79dd25539ac9 req-a6a71f8b-8e0e-4852-97d1-5d9dfa3516d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188970 Aug 06 13:06:45.402237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1817/3628] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:46.219964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:46.221422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:46.229739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:46.230610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:46.231277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:46.232276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:46.233076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:46.233574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:46.254242 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f463e3f6-d6e4-4833-865a-74fff9da3385 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:46.254937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f463e3f6-d6e4-4833-865a-74fff9da3385 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:46.262881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f463e3f6-d6e4-4833-865a-74fff9da3385 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:46.263371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f463e3f6-d6e4-4833-865a-74fff9da3385 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:46.263803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f463e3f6-d6e4-4833-865a-74fff9da3385 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:46.265100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f463e3f6-d6e4-4833-865a-74fff9da3385 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:46.265619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f463e3f6-d6e4-4833-865a-74fff9da3385 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:46.266046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f463e3f6-d6e4-4833-865a-74fff9da3385 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:46.397340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f463e3f6-d6e4-4833-865a-74fff9da3385 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:46.405229 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f463e3f6-d6e4-4833-865a-74fff9da3385 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 200 len: 1613 microversion: 2.1 time: 0.155094 Aug 06 13:06:46.406395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1818/3629] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:46 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 1613 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:06:46.657616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-9d5eeebd-1a96-4460-a2d9-eebcf27e2982 req-57ae59d8-9c08-4966-8c08-b8136c0dc9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b858f51c-0983-4ec0-85a2-d955c78aff33", "name": "network-vif-deleted", "tag": "dd9248b7-558b-4e95-8d9a-8f51f4c58eb8"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:46.658640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:46.667830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:46.669733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:46.671712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-820e7587-1ad2-483a-97b0-73882a942590 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1741 microversion: 2.20 time: 0.456524 Aug 06 13:06:46.672474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1812/3630] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:46 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1741 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:46.675213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9d5eeebd-1a96-4460-a2d9-eebcf27e2982 req-57ae59d8-9c08-4966-8c08-b8136c0dc9f4 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:46.675909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9d5eeebd-1a96-4460-a2d9-eebcf27e2982 req-57ae59d8-9c08-4966-8c08-b8136c0dc9f4 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:46.676541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9d5eeebd-1a96-4460-a2d9-eebcf27e2982 req-57ae59d8-9c08-4966-8c08-b8136c0dc9f4 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:46.690246 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-9d5eeebd-1a96-4460-a2d9-eebcf27e2982 req-57ae59d8-9c08-4966-8c08-b8136c0dc9f4 service nova] Creating event network-vif-deleted:dd9248b7-558b-4e95-8d9a-8f51f4c58eb8 for instance b858f51c-0983-4ec0-85a2-d955c78aff33 on hv-cinder-85199 Aug 06 13:06:46.704401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-9d5eeebd-1a96-4460-a2d9-eebcf27e2982 req-57ae59d8-9c08-4966-8c08-b8136c0dc9f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049601 Aug 06 13:06:46.705497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1819/3631] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:06:47.429890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:47.430493 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:47.438221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:47.438710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:47.448420 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:47.449405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:47.450349 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:47.450958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:47.468497 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 HTTP/1.1 Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:06:47.470571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:06:47.472116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'b858f51c-0983-4ec0-85a2-d955c78aff33'} Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:06:47.473667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:06:47.475995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:06:47.478383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:06:47.478383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-96311430-da46-42db-ab17-a3887e41e8b9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 404 len: 111 microversion: 2.1 time: 0.046115 Aug 06 13:06:47.478383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1813/3632] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:47 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:06:47.481601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a2c09d36-81d6-4393-adc8-8a5964b955db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '.version_select at 0x7f541aa26ca0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:47.522644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a2c09d36-81d6-4393-adc8-8a5964b955db tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-577736125" status: 202 len: 0 microversion: 2.1 time: 0.045019 Aug 06 13:06:47.523868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1820/3633] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Aug 6 13:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-577736125 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:06:47.698301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:47.699455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:47.734827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:47.739069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:47.740231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:47.741016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:47.741485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:47.741920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:48.098090 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:48.109858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:48.111359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:48.112552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-36594114-76a5-4829-bd66-cc181788bb21 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1741 microversion: 2.20 time: 0.418529 Aug 06 13:06:48.113107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1814/3634] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:47 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1741 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:48.441330 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27c78749-4fa3-4baf-8b81-296798b7bc9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: .version_select at 0x7f541a7d6160>, body: {"keypair": {"name": "tempest-keypair-1565401626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTVtiA6bkGB2L8ZTrHaGwSnqPQfup+uqKofArSwqQ9+j5yXIGaD8AgvAgVWIabZUTuwPbfyacnM7CIgVGISTKZ7GnI+z1XbnPyzhylju59jmQjm68j6yMzrilhp1G7AjQ=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:48.476067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-27c78749-4fa3-4baf-8b81-296798b7bc9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 13:06:48.480784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-27c78749-4fa3-4baf-8b81-296798b7bc9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for user 1125a0b93c9d45ccb2d3f28f188dfd04 and project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 13:06:48.522079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-27c78749-4fa3-4baf-8b81-296798b7bc9b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081592 Aug 06 13:06:48.529794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1821/3635] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Aug 6 13:06:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:48.799622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-761af4d6-78c7-4f31-ba7b-c057697deea3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Action: 'create', calling method: .version_select at 0x7f541a78adc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1137332224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPlqJR/sk/zqmKyp4P7TfFHxkibV0ZYBqZ6K8BcY38FhTSg1yxvQxNm6nGzIcCsK5Z+7XwirXIGMI+koBPgk7vhIMzXojP/v6am99eSv5B4R4GAN2IedUGPPMBVc1EMYw=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:48.824930 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-761af4d6-78c7-4f31-ba7b-c057697deea3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Getting quotas for project f7477fc540f843b4936879b9425896f3. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 13:06:48.828855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-761af4d6-78c7-4f31-ba7b-c057697deea3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Getting quotas for user 3188163f95d04235b5de120354ea4997 and project f7477fc540f843b4936879b9425896f3. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 13:06:48.859665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-761af4d6-78c7-4f31-ba7b-c057697deea3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.065855 Aug 06 13:06:48.860260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1815/3636] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Aug 6 13:06:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:48.980199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1578962281", "imageRef": "d34ee234-d5a9-4621-b219-68a3ccfe2346", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1137332224", "networks": [{"uuid": "6e1730de-e1d8-417b-af04-bbdc1648a656"}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:49.044102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] validate_networks() for [('6e1730de-e1d8-417b-af04-bbdc1648a656', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 13:06:49.139632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:49.140597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:49.148702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:49.150829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:49.152830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:49.154345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:49.157471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:49.158676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:49.405436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:49.415021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:49.417000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:49.418862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2d2adb61-5f44-4537-bfaf-d54ea68b0e64 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.283799 Aug 06 13:06:49.432814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1816/3637] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:49 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:06:49.472440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 13:06:49.473063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 13:06:49.473812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 13:06:49.474386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 13:06:49.474987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 13:06:49.490477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:49.491271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:49.491883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:49.492809 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:49.493280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:49.493872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:49.513819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Getting quotas for project f7477fc540f843b4936879b9425896f3. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 13:06:49.518251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Getting quotas for user 3188163f95d04235b5de120354ea4997 and project f7477fc540f843b4936879b9425896f3. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 13:06:49.530085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 13:06:49.533605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d34ee234-d5a9-4621-b219-68a3ccfe2346',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 13:06:49.592012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-504391ce-7d49-4e74-a37d-ea84ee255eab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616372 Aug 06 13:06:49.593391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1822/3638] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 13:06:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 13:06:49.603931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cd0205d8-2395-486e-9df2-7d04a9cae60b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:49.604917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cd0205d8-2395-486e-9df2-7d04a9cae60b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:49.690395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cd0205d8-2395-486e-9df2-7d04a9cae60b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:49.700533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cd0205d8-2395-486e-9df2-7d04a9cae60b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1259 microversion: 2.1 time: 0.100666 Aug 06 13:06:49.706126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1817/3639] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:49 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1259 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:50.446166 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:50.447218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:50.454676 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:50.457708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:50.459102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:50.460175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:50.462862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:50.463412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:50.518608 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-168789145", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eedc16df-3c43-4b30-b37e-93e76fe94c3d"}], "security_groups": [{"name": "tempest-securitygroup--924539787"}], "key_name": "tempest-keypair-1565401626", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:06:50.653932 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:50.665035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:50.669300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:50.671084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5d62236d-9927-41a7-a313-5dd814a5ee07 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.228712 Aug 06 13:06:50.672382 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1823/3640] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:50 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:06:50.696996 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] validate_networks() for [('eedc16df-3c43-4b30-b37e-93e76fe94c3d', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 13:06:50.725358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-50f38e64-6080-4e59-b46b-08d4a8eeab25 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:50.727268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-50f38e64-6080-4e59-b46b-08d4a8eeab25 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:50.742332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f38e64-6080-4e59-b46b-08d4a8eeab25 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:50.743088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f38e64-6080-4e59-b46b-08d4a8eeab25 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:50.743743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f38e64-6080-4e59-b46b-08d4a8eeab25 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:50.744679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f38e64-6080-4e59-b46b-08d4a8eeab25 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:50.745553 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f38e64-6080-4e59-b46b-08d4a8eeab25 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:50.746170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50f38e64-6080-4e59-b46b-08d4a8eeab25 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:50.847488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-50f38e64-6080-4e59-b46b-08d4a8eeab25 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:50.861915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-50f38e64-6080-4e59-b46b-08d4a8eeab25 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1311 microversion: 2.1 time: 0.140527 Aug 06 13:06:50.863088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1824/3641] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:50 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:06:51.258615 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 13:06:51.259545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 13:06:51.260773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 13:06:51.261451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 13:06:51.262315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 13:06:51.272081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:51.273416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:51.274281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:51.275293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:51.275981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:51.276676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:51.297529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 13:06:51.301613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Getting quotas for user 1125a0b93c9d45ccb2d3f28f188dfd04 and project 7a6de534dbd541828ac211fae35b0ce4. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 13:06:51.315728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 13:06:51.318118 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 13:06:51.367340 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8b67b55-a24c-4aaf-b1e5-dfd7dd66a2c8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.852846 Aug 06 13:06:51.368845 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1818/3642] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 13:06:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 13:06:51.379200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cebf0b98-c0fd-48cc-8c47-e758cfec0bd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:51.380058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cebf0b98-c0fd-48cc-8c47-e758cfec0bd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:51.461398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cebf0b98-c0fd-48cc-8c47-e758cfec0bd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:51.468971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cebf0b98-c0fd-48cc-8c47-e758cfec0bd8 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1241 microversion: 2.1 time: 0.093523 Aug 06 13:06:51.469857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1825/3643] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:51 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:51.696560 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:51.697841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:51.706431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:51.706902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:51.707329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:51.708032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:51.708513 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:51.708934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:51.885911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-566a04c9-a623-4cc7-886b-906fc6c281af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:51.886903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-566a04c9-a623-4cc7-886b-906fc6c281af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:51.901399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-566a04c9-a623-4cc7-886b-906fc6c281af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:51.902153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-566a04c9-a623-4cc7-886b-906fc6c281af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:51.902725 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-566a04c9-a623-4cc7-886b-906fc6c281af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:51.904067 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-566a04c9-a623-4cc7-886b-906fc6c281af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:51.905580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-566a04c9-a623-4cc7-886b-906fc6c281af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:51.906485 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-566a04c9-a623-4cc7-886b-906fc6c281af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:51.911808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:51.921021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:51.922520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:51.929575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d1cdf607-3cdc-4f69-82af-5d736e8b9e89 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.237536 Aug 06 13:06:51.945287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1819/3644] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:51 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:52.027437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-566a04c9-a623-4cc7-886b-906fc6c281af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:52.034857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-566a04c9-a623-4cc7-886b-906fc6c281af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1319 microversion: 2.1 time: 0.154300 Aug 06 13:06:52.035458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1826/3645] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:51 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:06:52.493578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c86d0cbe-e4d6-4225-b8fa-f4d4ecdecda7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:52.494760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c86d0cbe-e4d6-4225-b8fa-f4d4ecdecda7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:52.513429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86d0cbe-e4d6-4225-b8fa-f4d4ecdecda7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:52.516265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86d0cbe-e4d6-4225-b8fa-f4d4ecdecda7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:52.517125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86d0cbe-e4d6-4225-b8fa-f4d4ecdecda7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:52.519214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86d0cbe-e4d6-4225-b8fa-f4d4ecdecda7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:52.522303 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86d0cbe-e4d6-4225-b8fa-f4d4ecdecda7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:52.523106 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c86d0cbe-e4d6-4225-b8fa-f4d4ecdecda7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:52.641868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c86d0cbe-e4d6-4225-b8fa-f4d4ecdecda7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:52.659650 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c86d0cbe-e4d6-4225-b8fa-f4d4ecdecda7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1237 microversion: 2.1 time: 0.170686 Aug 06 13:06:52.661975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1820/3646] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:52 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1237 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:52.960213 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:52.961112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:53.033442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.037726 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.039049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.047306 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.051661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.055669 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.056986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aacccb90-3880-4739-bf87-164a11363fab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:53.058741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aacccb90-3880-4739-bf87-164a11363fab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:53.071524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aacccb90-3880-4739-bf87-164a11363fab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.072498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aacccb90-3880-4739-bf87-164a11363fab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.073751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aacccb90-3880-4739-bf87-164a11363fab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.074661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aacccb90-3880-4739-bf87-164a11363fab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.075297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aacccb90-3880-4739-bf87-164a11363fab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.075896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aacccb90-3880-4739-bf87-164a11363fab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.235217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aacccb90-3880-4739-bf87-164a11363fab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:53.255824 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aacccb90-3880-4739-bf87-164a11363fab tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1317 microversion: 2.1 time: 0.203072 Aug 06 13:06:53.260862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1821/3647] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:53 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:53.388041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:53.397376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:53.399673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:53.407103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b2030402-9170-44ff-99df-8779970432a4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:53.409709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b2030402-9170-44ff-99df-8779970432a4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:53.412004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2dc03a24-29a1-4e0e-b072-650b14ce834f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.447283 Aug 06 13:06:53.413021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1827/3648] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:52 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:53.418785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2030402-9170-44ff-99df-8779970432a4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.419702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2030402-9170-44ff-99df-8779970432a4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.421139 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2030402-9170-44ff-99df-8779970432a4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.422102 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2030402-9170-44ff-99df-8779970432a4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.422909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2030402-9170-44ff-99df-8779970432a4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.424159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2030402-9170-44ff-99df-8779970432a4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.479880 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b2030402-9170-44ff-99df-8779970432a4 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.077102 Aug 06 13:06:53.486529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1822/3649] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:06:53 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:53.629362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-acbf0b09-45d7-4772-9cb5-8518a02882d1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:53.630195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-acbf0b09-45d7-4772-9cb5-8518a02882d1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:53.648617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbf0b09-45d7-4772-9cb5-8518a02882d1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.649477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbf0b09-45d7-4772-9cb5-8518a02882d1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.650294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbf0b09-45d7-4772-9cb5-8518a02882d1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.651649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbf0b09-45d7-4772-9cb5-8518a02882d1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.656454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbf0b09-45d7-4772-9cb5-8518a02882d1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.657142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-acbf0b09-45d7-4772-9cb5-8518a02882d1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.683914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2805443c-50af-4ea2-8211-d63b9baa07cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:53.684763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2805443c-50af-4ea2-8211-d63b9baa07cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:53.687535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:53.697016 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2805443c-50af-4ea2-8211-d63b9baa07cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.697938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2805443c-50af-4ea2-8211-d63b9baa07cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.698869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2805443c-50af-4ea2-8211-d63b9baa07cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.699823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2805443c-50af-4ea2-8211-d63b9baa07cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.700459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2805443c-50af-4ea2-8211-d63b9baa07cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.701227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2805443c-50af-4ea2-8211-d63b9baa07cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.760976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-acbf0b09-45d7-4772-9cb5-8518a02882d1 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments/26c4737f-8c2d-4bce-934c-46ef9ffce317" status: 200 len: 194 microversion: 2.1 time: 0.131808 Aug 06 13:06:53.762143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1828/3650] 10.222.0.20 () {58 vars in 1413 bytes} [Sat Aug 6 13:06:53 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments/26c4737f-8c2d-4bce-934c-46ef9ffce317 => generated 194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:06:53.773869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4b874387-7c0c-4f0e-bbaf-c5375c2fc2e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:53.774753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4b874387-7c0c-4f0e-bbaf-c5375c2fc2e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:53.794183 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b874387-7c0c-4f0e-bbaf-c5375c2fc2e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.795743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b874387-7c0c-4f0e-bbaf-c5375c2fc2e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.803251 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b874387-7c0c-4f0e-bbaf-c5375c2fc2e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.804514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b874387-7c0c-4f0e-bbaf-c5375c2fc2e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:53.805197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b874387-7c0c-4f0e-bbaf-c5375c2fc2e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:53.805864 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4b874387-7c0c-4f0e-bbaf-c5375c2fc2e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:53.849196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2805443c-50af-4ea2-8211-d63b9baa07cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:53.853566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:53.864345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2805443c-50af-4ea2-8211-d63b9baa07cb tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.184926 Aug 06 13:06:53.865994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1823/3651] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:53 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:53.976561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-4b874387-7c0c-4f0e-bbaf-c5375c2fc2e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lazy-loading 'services' on Instance uuid 6531998f-cbb2-4338-97f5-18cab3aa7ab2 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 13:06:54.117408 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4b874387-7c0c-4f0e-bbaf-c5375c2fc2e9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments/26c4737f-8c2d-4bce-934c-46ef9ffce317" status: 202 len: 0 microversion: 2.1 time: 0.347503 Aug 06 13:06:54.122290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1829/3652] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 13:06:53 2022] DELETE /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments/26c4737f-8c2d-4bce-934c-46ef9ffce317 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:06:54.280495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ceba31b5-bf9b-41e5-b978-0a9cb2a40991 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:54.281398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ceba31b5-bf9b-41e5-b978-0a9cb2a40991 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:54.301399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ceba31b5-bf9b-41e5-b978-0a9cb2a40991 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:54.301893 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ceba31b5-bf9b-41e5-b978-0a9cb2a40991 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:54.302339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ceba31b5-bf9b-41e5-b978-0a9cb2a40991 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:54.303045 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ceba31b5-bf9b-41e5-b978-0a9cb2a40991 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:54.303539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ceba31b5-bf9b-41e5-b978-0a9cb2a40991 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:54.303961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ceba31b5-bf9b-41e5-b978-0a9cb2a40991 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:54.478874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:54.481175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:54.512614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:54.536349 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:54.536857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:54.537279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:54.538018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:54.538488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:54.538896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:54.683506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ceba31b5-bf9b-41e5-b978-0a9cb2a40991 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:54.698086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ceba31b5-bf9b-41e5-b978-0a9cb2a40991 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.422186 Aug 06 13:06:54.713601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1824/3653] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:54 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:54.826803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:54.836228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:54.838442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:54.839911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5c52616f-5217-4857-98cb-b82c58871830 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.377306 Aug 06 13:06:54.856544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1830/3654] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:54 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:54.891371 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8f4d8054-2b3d-48b7-a4e4-326bb66d77be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:54.892054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8f4d8054-2b3d-48b7-a4e4-326bb66d77be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:54.952622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f4d8054-2b3d-48b7-a4e4-326bb66d77be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:54.953158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f4d8054-2b3d-48b7-a4e4-326bb66d77be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:54.954071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f4d8054-2b3d-48b7-a4e4-326bb66d77be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:54.954982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f4d8054-2b3d-48b7-a4e4-326bb66d77be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:54.955581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f4d8054-2b3d-48b7-a4e4-326bb66d77be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:54.956132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f4d8054-2b3d-48b7-a4e4-326bb66d77be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:55.046414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8f4d8054-2b3d-48b7-a4e4-326bb66d77be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:55.055718 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8f4d8054-2b3d-48b7-a4e4-326bb66d77be tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.171860 Aug 06 13:06:55.069350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1825/3655] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:54 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:55.720285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1da700c0-bc16-446e-8db0-eee2c328c145 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:55.721065 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1da700c0-bc16-446e-8db0-eee2c328c145 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:55.737171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1da700c0-bc16-446e-8db0-eee2c328c145 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:55.737652 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1da700c0-bc16-446e-8db0-eee2c328c145 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:55.738081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1da700c0-bc16-446e-8db0-eee2c328c145 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:55.738775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1da700c0-bc16-446e-8db0-eee2c328c145 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:55.739218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1da700c0-bc16-446e-8db0-eee2c328c145 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:55.739635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1da700c0-bc16-446e-8db0-eee2c328c145 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:55.868058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:55.868695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:55.878434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:55.879330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:55.889293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:55.889293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:55.889293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:55.889293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:55.992672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1da700c0-bc16-446e-8db0-eee2c328c145 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:56.002622 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1da700c0-bc16-446e-8db0-eee2c328c145 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.285924 Aug 06 13:06:56.017279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1831/3656] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:55 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:56.083546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-79cca690-40d2-41bb-a5f4-417b30210f57 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:56.090551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-79cca690-40d2-41bb-a5f4-417b30210f57 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:56.103441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79cca690-40d2-41bb-a5f4-417b30210f57 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:56.104060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79cca690-40d2-41bb-a5f4-417b30210f57 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:56.104785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79cca690-40d2-41bb-a5f4-417b30210f57 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:56.105812 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79cca690-40d2-41bb-a5f4-417b30210f57 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:56.111145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79cca690-40d2-41bb-a5f4-417b30210f57 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:56.111674 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79cca690-40d2-41bb-a5f4-417b30210f57 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:56.121595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:56.130777 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:56.132276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:56.133654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e621aae7-2d16-4773-be69-da13b8a8057f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.273797 Aug 06 13:06:56.134815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1826/3657] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:55 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:56.228662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-79cca690-40d2-41bb-a5f4-417b30210f57 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:56.242192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-79cca690-40d2-41bb-a5f4-417b30210f57 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.166880 Aug 06 13:06:56.257287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1832/3658] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:56 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:06:57.026292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-abf23a10-655c-438e-bba1-bebe0c6db961 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:57.027760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-abf23a10-655c-438e-bba1-bebe0c6db961 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:57.038157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abf23a10-655c-438e-bba1-bebe0c6db961 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:57.039182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abf23a10-655c-438e-bba1-bebe0c6db961 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:57.039869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abf23a10-655c-438e-bba1-bebe0c6db961 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:57.041150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abf23a10-655c-438e-bba1-bebe0c6db961 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:57.041673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abf23a10-655c-438e-bba1-bebe0c6db961 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:57.042164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abf23a10-655c-438e-bba1-bebe0c6db961 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:57.160637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:57.161342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:57.180437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:57.184666 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:57.185307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:57.186190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:57.188635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:57.188635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:57.337080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-abf23a10-655c-438e-bba1-bebe0c6db961 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:57.346896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-abf23a10-655c-438e-bba1-bebe0c6db961 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.324230 Aug 06 13:06:57.348156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1827/3659] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:57 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:57.353616 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0ff98863-df85-4e71-ba29-95e7ddc6c94d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:57.354512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0ff98863-df85-4e71-ba29-95e7ddc6c94d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:57.371962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff98863-df85-4e71-ba29-95e7ddc6c94d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:57.372499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff98863-df85-4e71-ba29-95e7ddc6c94d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:57.372997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff98863-df85-4e71-ba29-95e7ddc6c94d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:57.373694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff98863-df85-4e71-ba29-95e7ddc6c94d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:57.374159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff98863-df85-4e71-ba29-95e7ddc6c94d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:57.374587 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ff98863-df85-4e71-ba29-95e7ddc6c94d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:57.475197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:57.483433 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:57.493709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0ff98863-df85-4e71-ba29-95e7ddc6c94d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:57.494494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:57.498667 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:57.501496 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0ff98863-df85-4e71-ba29-95e7ddc6c94d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.151821 Aug 06 13:06:57.504621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-50a67b0e-9f8c-45b0-b39a-1b2f6b56c1dc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.344202 Aug 06 13:06:57.505687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1833/3660] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:57 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:57.516727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1828/3661] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:57 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:58.370565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0aad11b5-1928-4146-bf1c-ba217bde98bc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:58.371170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0aad11b5-1928-4146-bf1c-ba217bde98bc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:58.379333 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0aad11b5-1928-4146-bf1c-ba217bde98bc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:58.379918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0aad11b5-1928-4146-bf1c-ba217bde98bc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:58.380370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0aad11b5-1928-4146-bf1c-ba217bde98bc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:58.381126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0aad11b5-1928-4146-bf1c-ba217bde98bc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:58.381568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0aad11b5-1928-4146-bf1c-ba217bde98bc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:58.381988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0aad11b5-1928-4146-bf1c-ba217bde98bc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:58.527346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f93d6758-bcad-452c-a3db-7891015f9ea9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:58.528082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f93d6758-bcad-452c-a3db-7891015f9ea9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:58.541387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f93d6758-bcad-452c-a3db-7891015f9ea9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:58.544087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f93d6758-bcad-452c-a3db-7891015f9ea9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:58.546337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f93d6758-bcad-452c-a3db-7891015f9ea9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:58.548412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f93d6758-bcad-452c-a3db-7891015f9ea9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:58.548412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f93d6758-bcad-452c-a3db-7891015f9ea9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:58.548412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f93d6758-bcad-452c-a3db-7891015f9ea9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:58.575658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0aad11b5-1928-4146-bf1c-ba217bde98bc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:58.586502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0aad11b5-1928-4146-bf1c-ba217bde98bc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.217443 Aug 06 13:06:58.588698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1834/3662] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:58 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:58.603263 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:58.614222 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:58.624056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:58.624569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:58.625000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:58.625691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:58.626135 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:58.626554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:58.646020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f93d6758-bcad-452c-a3db-7891015f9ea9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:58.656809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f93d6758-bcad-452c-a3db-7891015f9ea9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.138487 Aug 06 13:06:58.657409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1829/3663] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:58 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:58.849198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:58.866708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:58.866708 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:58.867496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2694e21d-cc09-4072-82f5-dea0aa5f74e6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.277824 Aug 06 13:06:58.868060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1835/3664] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:58 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:06:59.615912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16d78aa0-6003-40ba-b860-7005c3c1fca5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:59.618066 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16d78aa0-6003-40ba-b860-7005c3c1fca5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:59.629446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16d78aa0-6003-40ba-b860-7005c3c1fca5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:59.630299 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16d78aa0-6003-40ba-b860-7005c3c1fca5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:59.630748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16d78aa0-6003-40ba-b860-7005c3c1fca5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:59.631468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16d78aa0-6003-40ba-b860-7005c3c1fca5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:59.631927 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16d78aa0-6003-40ba-b860-7005c3c1fca5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:59.632407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16d78aa0-6003-40ba-b860-7005c3c1fca5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:59.691353 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-59477b79-ad62-46b7-9d7c-ce0787a2232e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:59.692768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-59477b79-ad62-46b7-9d7c-ce0787a2232e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:59.698887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:06:59.702791 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59477b79-ad62-46b7-9d7c-ce0787a2232e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:59.703853 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59477b79-ad62-46b7-9d7c-ce0787a2232e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:59.711148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59477b79-ad62-46b7-9d7c-ce0787a2232e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:59.711980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59477b79-ad62-46b7-9d7c-ce0787a2232e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:59.712552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59477b79-ad62-46b7-9d7c-ce0787a2232e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:59.713153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-59477b79-ad62-46b7-9d7c-ce0787a2232e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:59.837731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-59477b79-ad62-46b7-9d7c-ce0787a2232e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:59.890385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16d78aa0-6003-40ba-b860-7005c3c1fca5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:06:59.897820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16d78aa0-6003-40ba-b860-7005c3c1fca5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.287301 Aug 06 13:06:59.901563 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-59477b79-ad62-46b7-9d7c-ce0787a2232e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.212681 Aug 06 13:06:59.903311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1836/3665] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:59 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:06:59.908663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:06:59.909462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:06:59.917211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1830/3666] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:06:59 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:06:59.927058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:59.927058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:59.927058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:06:59.927058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:06:59.928822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:06:59.928822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:00.106289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:00.115024 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:00.116557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:00.117720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-357f78db-8368-4c87-a49d-2bb11ea4fabe tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.213005 Aug 06 13:07:00.118279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1837/3667] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:06:59 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:00.919205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61b040ab-d90d-4b0d-b387-0d7c106ead0d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:00.919868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61b040ab-d90d-4b0d-b387-0d7c106ead0d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:00.926792 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61b040ab-d90d-4b0d-b387-0d7c106ead0d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:00.927267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61b040ab-d90d-4b0d-b387-0d7c106ead0d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:00.927709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61b040ab-d90d-4b0d-b387-0d7c106ead0d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:00.928502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61b040ab-d90d-4b0d-b387-0d7c106ead0d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:00.928950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61b040ab-d90d-4b0d-b387-0d7c106ead0d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:00.929372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61b040ab-d90d-4b0d-b387-0d7c106ead0d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:00.930495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ee07b459-484d-4967-96b9-9628b14b8290 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:00.931235 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ee07b459-484d-4967-96b9-9628b14b8290 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:00.937834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee07b459-484d-4967-96b9-9628b14b8290 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:00.938317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee07b459-484d-4967-96b9-9628b14b8290 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:00.938744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee07b459-484d-4967-96b9-9628b14b8290 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:00.939435 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee07b459-484d-4967-96b9-9628b14b8290 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:00.939887 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee07b459-484d-4967-96b9-9628b14b8290 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:00.940328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee07b459-484d-4967-96b9-9628b14b8290 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:01.033606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ee07b459-484d-4967-96b9-9628b14b8290 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:01.041241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ee07b459-484d-4967-96b9-9628b14b8290 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.116066 Aug 06 13:07:01.041815 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1838/3668] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:00 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:01.081196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61b040ab-d90d-4b0d-b387-0d7c106ead0d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:01.088644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61b040ab-d90d-4b0d-b387-0d7c106ead0d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.173936 Aug 06 13:07:01.089201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1831/3669] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:00 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:01.142195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:01.142779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:01.148752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:01.149226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:01.149760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:01.150449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:01.150900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:01.151313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:01.441768 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:01.449169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:01.450683 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:01.452512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d64fbd7e-dd1e-4049-b0d1-0fe712b2de59 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.314814 Aug 06 13:07:01.453308 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1839/3670] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:01 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:02.063811 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:02.071483 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=12 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:02.073309 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-374e05f1-42b4-4b8f-a3ed-eed0b9ed9fb3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:02.074693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-374e05f1-42b4-4b8f-a3ed-eed0b9ed9fb3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:02.084021 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-374e05f1-42b4-4b8f-a3ed-eed0b9ed9fb3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:02.084550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-374e05f1-42b4-4b8f-a3ed-eed0b9ed9fb3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:02.084995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-374e05f1-42b4-4b8f-a3ed-eed0b9ed9fb3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:02.088618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-374e05f1-42b4-4b8f-a3ed-eed0b9ed9fb3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:02.090902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-374e05f1-42b4-4b8f-a3ed-eed0b9ed9fb3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:02.092489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-374e05f1-42b4-4b8f-a3ed-eed0b9ed9fb3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:02.112971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d45af159-cc06-40e7-8724-ae80c64f85c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:02.114741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d45af159-cc06-40e7-8724-ae80c64f85c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:02.127074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=12 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:02.132385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45af159-cc06-40e7-8724-ae80c64f85c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:02.136595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45af159-cc06-40e7-8724-ae80c64f85c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:02.136595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45af159-cc06-40e7-8724-ae80c64f85c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:02.136595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45af159-cc06-40e7-8724-ae80c64f85c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:02.136595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45af159-cc06-40e7-8724-ae80c64f85c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:02.140944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d45af159-cc06-40e7-8724-ae80c64f85c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:02.211334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-374e05f1-42b4-4b8f-a3ed-eed0b9ed9fb3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:02.221091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-374e05f1-42b4-4b8f-a3ed-eed0b9ed9fb3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.157941 Aug 06 13:07:02.222099 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1832/3671] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:02 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:02.389017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d45af159-cc06-40e7-8724-ae80c64f85c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:02.389017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d45af159-cc06-40e7-8724-ae80c64f85c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.199712 Aug 06 13:07:02.389017 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1840/3672] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:02 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:02.474905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:02.475512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:02.481876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:02.482410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:02.482841 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:02.483520 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:02.483967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:02.484417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:02.611052 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:02.618833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:02.620386 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:02.621525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-73e3bbc6-99a1-47af-b9ca-64ab3584e1db tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.150585 Aug 06 13:07:02.622068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1833/3673] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:02 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:03.241792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-40e9210b-bbcc-440e-9d0c-a86fbe15feb9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:03.242337 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-40e9210b-bbcc-440e-9d0c-a86fbe15feb9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:03.249304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40e9210b-bbcc-440e-9d0c-a86fbe15feb9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:03.249780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40e9210b-bbcc-440e-9d0c-a86fbe15feb9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:03.250201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40e9210b-bbcc-440e-9d0c-a86fbe15feb9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:03.250869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40e9210b-bbcc-440e-9d0c-a86fbe15feb9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:03.251310 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40e9210b-bbcc-440e-9d0c-a86fbe15feb9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:03.251722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40e9210b-bbcc-440e-9d0c-a86fbe15feb9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:03.311363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-40e9210b-bbcc-440e-9d0c-a86fbe15feb9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:03.318625 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-40e9210b-bbcc-440e-9d0c-a86fbe15feb9 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.080736 Aug 06 13:07:03.319167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1841/3674] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:03 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:03.378091 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0623a3ae-bce3-4f88-aef5-8eff1be0d17e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:03.378723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0623a3ae-bce3-4f88-aef5-8eff1be0d17e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:03.385063 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0623a3ae-bce3-4f88-aef5-8eff1be0d17e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:03.385539 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0623a3ae-bce3-4f88-aef5-8eff1be0d17e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:03.385978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0623a3ae-bce3-4f88-aef5-8eff1be0d17e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:03.386656 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0623a3ae-bce3-4f88-aef5-8eff1be0d17e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:03.387108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0623a3ae-bce3-4f88-aef5-8eff1be0d17e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:03.387528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0623a3ae-bce3-4f88-aef5-8eff1be0d17e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:03.518163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0623a3ae-bce3-4f88-aef5-8eff1be0d17e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:03.525699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0623a3ae-bce3-4f88-aef5-8eff1be0d17e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.151392 Aug 06 13:07:03.526259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1834/3675] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:03 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:03.643916 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:03.644573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:03.650385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:03.650860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:03.651282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:03.651955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:03.652426 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:03.652847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:03.780709 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:03.788486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:03.789962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:03.791095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0df8231d-4a51-48cf-ae0b-29c462f162a6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.151194 Aug 06 13:07:03.791630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1842/3676] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:03 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:04.338958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9c8fc76-f67b-4dae-8606-2fb2849d373d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:04.339487 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9c8fc76-f67b-4dae-8606-2fb2849d373d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:04.345385 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9c8fc76-f67b-4dae-8606-2fb2849d373d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:04.345863 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9c8fc76-f67b-4dae-8606-2fb2849d373d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:04.346294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9c8fc76-f67b-4dae-8606-2fb2849d373d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:04.346969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9c8fc76-f67b-4dae-8606-2fb2849d373d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:04.347421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9c8fc76-f67b-4dae-8606-2fb2849d373d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:04.347842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9c8fc76-f67b-4dae-8606-2fb2849d373d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:04.409617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9c8fc76-f67b-4dae-8606-2fb2849d373d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:04.416860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9c8fc76-f67b-4dae-8606-2fb2849d373d tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.081831 Aug 06 13:07:04.417410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1835/3677] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:04 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:04.547061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d70931c6-340a-4d4e-b116-942710108e52 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:04.547665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d70931c6-340a-4d4e-b116-942710108e52 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:04.553988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70931c6-340a-4d4e-b116-942710108e52 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:04.554465 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70931c6-340a-4d4e-b116-942710108e52 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:04.554895 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70931c6-340a-4d4e-b116-942710108e52 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:04.555579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70931c6-340a-4d4e-b116-942710108e52 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:04.556028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70931c6-340a-4d4e-b116-942710108e52 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:04.556474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d70931c6-340a-4d4e-b116-942710108e52 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:04.680220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d70931c6-340a-4d4e-b116-942710108e52 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:04.688145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d70931c6-340a-4d4e-b116-942710108e52 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.145407 Aug 06 13:07:04.688724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1843/3678] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:04 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:04.814355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:04.815000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:04.820854 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:04.821332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:04.821763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:04.822438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:04.822887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:04.823313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:04.949664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:04.957389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:04.958861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:04.960000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e9996926-9f67-4172-b948-8432444cd605 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.150198 Aug 06 13:07:04.960580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1836/3679] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:04 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:05.437212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e983e7d6-f610-499f-9ad8-6382f4efb26f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:05.437813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e983e7d6-f610-499f-9ad8-6382f4efb26f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:05.443753 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e983e7d6-f610-499f-9ad8-6382f4efb26f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:05.444228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e983e7d6-f610-499f-9ad8-6382f4efb26f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:05.444692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e983e7d6-f610-499f-9ad8-6382f4efb26f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:05.445369 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e983e7d6-f610-499f-9ad8-6382f4efb26f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:05.445820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e983e7d6-f610-499f-9ad8-6382f4efb26f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:05.446273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e983e7d6-f610-499f-9ad8-6382f4efb26f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:05.507731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e983e7d6-f610-499f-9ad8-6382f4efb26f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:05.515784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e983e7d6-f610-499f-9ad8-6382f4efb26f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.082384 Aug 06 13:07:05.516361 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1844/3680] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:05 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:05.708580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e9c4fc80-a92f-4bfc-9df9-d60ca8f683af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:05.709124 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e9c4fc80-a92f-4bfc-9df9-d60ca8f683af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:05.715355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9c4fc80-a92f-4bfc-9df9-d60ca8f683af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:05.715821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9c4fc80-a92f-4bfc-9df9-d60ca8f683af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:05.716285 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9c4fc80-a92f-4bfc-9df9-d60ca8f683af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:05.716978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9c4fc80-a92f-4bfc-9df9-d60ca8f683af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:05.717423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9c4fc80-a92f-4bfc-9df9-d60ca8f683af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:05.717878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9c4fc80-a92f-4bfc-9df9-d60ca8f683af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:05.845036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e9c4fc80-a92f-4bfc-9df9-d60ca8f683af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:05.852559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e9c4fc80-a92f-4bfc-9df9-d60ca8f683af tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.147942 Aug 06 13:07:05.853122 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1837/3681] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:05 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:05.983529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:05.984056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:05.990394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:05.990862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:05.991285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:05.991963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:05.992431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:05.992855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:06.124167 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:06.132889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:06.134380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:06.135517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3a1a918e-0b46-4236-858a-1f20feaf6d7b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.156416 Aug 06 13:07:06.136068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1845/3682] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:05 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:06.536199 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-11abed32-7e7e-4691-9441-febb3958d8da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:06.536839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-11abed32-7e7e-4691-9441-febb3958d8da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:06.542782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11abed32-7e7e-4691-9441-febb3958d8da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:06.543264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11abed32-7e7e-4691-9441-febb3958d8da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:06.543699 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11abed32-7e7e-4691-9441-febb3958d8da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:06.545047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11abed32-7e7e-4691-9441-febb3958d8da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:06.545506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11abed32-7e7e-4691-9441-febb3958d8da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:06.545962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11abed32-7e7e-4691-9441-febb3958d8da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:06.605411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-11abed32-7e7e-4691-9441-febb3958d8da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:06.613383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-11abed32-7e7e-4691-9441-febb3958d8da tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.081092 Aug 06 13:07:06.613942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1838/3683] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:06 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:06.873099 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-adbbdd7a-bc7c-4463-ad1e-81817f343061 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:06.873621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-adbbdd7a-bc7c-4463-ad1e-81817f343061 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:06.879392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adbbdd7a-bc7c-4463-ad1e-81817f343061 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:06.879866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adbbdd7a-bc7c-4463-ad1e-81817f343061 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:06.880291 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adbbdd7a-bc7c-4463-ad1e-81817f343061 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:06.880990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adbbdd7a-bc7c-4463-ad1e-81817f343061 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:06.881436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adbbdd7a-bc7c-4463-ad1e-81817f343061 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:06.881850 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-adbbdd7a-bc7c-4463-ad1e-81817f343061 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:07.007803 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-adbbdd7a-bc7c-4463-ad1e-81817f343061 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:07.016801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-adbbdd7a-bc7c-4463-ad1e-81817f343061 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.147521 Aug 06 13:07:07.017385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1846/3684] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:06 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:07.157969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:07.158575 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:07.164934 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:07.165416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:07.165855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:07.166534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:07.166982 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:07.167401 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:07.293822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:07.301623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:07.303141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:07.304290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2588f8c2-6c46-4b8f-ae62-3e7bf04f4dbb tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.150225 Aug 06 13:07:07.304872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1839/3685] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:07 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:07.633653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2e67ca8b-2d6b-4e4c-aeeb-eed7449c3e29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:07.634255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2e67ca8b-2d6b-4e4c-aeeb-eed7449c3e29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:07.640148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e67ca8b-2d6b-4e4c-aeeb-eed7449c3e29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:07.640658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e67ca8b-2d6b-4e4c-aeeb-eed7449c3e29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:07.641093 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e67ca8b-2d6b-4e4c-aeeb-eed7449c3e29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:07.641769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e67ca8b-2d6b-4e4c-aeeb-eed7449c3e29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:07.642220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e67ca8b-2d6b-4e4c-aeeb-eed7449c3e29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:07.642639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2e67ca8b-2d6b-4e4c-aeeb-eed7449c3e29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:07.702860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2e67ca8b-2d6b-4e4c-aeeb-eed7449c3e29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:07.710104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2e67ca8b-2d6b-4e4c-aeeb-eed7449c3e29 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.080248 Aug 06 13:07:07.710658 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1847/3686] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:07 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:08.038100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-25e1adc8-65d6-4dd3-a5d1-e08bc34327e2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:08.038700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-25e1adc8-65d6-4dd3-a5d1-e08bc34327e2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:08.045323 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e1adc8-65d6-4dd3-a5d1-e08bc34327e2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:08.045794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e1adc8-65d6-4dd3-a5d1-e08bc34327e2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:08.046248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e1adc8-65d6-4dd3-a5d1-e08bc34327e2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:08.046918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e1adc8-65d6-4dd3-a5d1-e08bc34327e2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:08.047368 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e1adc8-65d6-4dd3-a5d1-e08bc34327e2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:08.047790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e1adc8-65d6-4dd3-a5d1-e08bc34327e2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:08.064865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:08.175579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-25e1adc8-65d6-4dd3-a5d1-e08bc34327e2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:08.182827 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-25e1adc8-65d6-4dd3-a5d1-e08bc34327e2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.148603 Aug 06 13:07:08.183360 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1840/3687] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:08 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:08.327685 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:08.328277 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:08.334452 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:08.334926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:08.335356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:08.336026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:08.336502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:08.336922 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:08.465722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:08.474145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:08.475621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:08.477059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c379ef93-c2ef-458d-b667-60f955205272 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.153703 Aug 06 13:07:08.477603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1848/3688] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:08 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:08.730646 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1c1d03bf-bdeb-4e3b-a34d-94ca6730d5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:08.731279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1c1d03bf-bdeb-4e3b-a34d-94ca6730d5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:08.737221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1d03bf-bdeb-4e3b-a34d-94ca6730d5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:08.737703 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1d03bf-bdeb-4e3b-a34d-94ca6730d5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:08.738132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1d03bf-bdeb-4e3b-a34d-94ca6730d5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:08.738810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1d03bf-bdeb-4e3b-a34d-94ca6730d5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:08.739262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1d03bf-bdeb-4e3b-a34d-94ca6730d5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:08.739683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c1d03bf-bdeb-4e3b-a34d-94ca6730d5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:08.800000 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1c1d03bf-bdeb-4e3b-a34d-94ca6730d5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:08.807334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1c1d03bf-bdeb-4e3b-a34d-94ca6730d5fa tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.080523 Aug 06 13:07:08.807874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1841/3689] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:08 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:09.203048 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bf8b3733-ee35-4cc6-aafa-97fa3f859503 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:09.203648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bf8b3733-ee35-4cc6-aafa-97fa3f859503 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:09.209576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf8b3733-ee35-4cc6-aafa-97fa3f859503 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:09.210046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf8b3733-ee35-4cc6-aafa-97fa3f859503 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:09.210472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf8b3733-ee35-4cc6-aafa-97fa3f859503 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:09.211142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf8b3733-ee35-4cc6-aafa-97fa3f859503 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:09.211585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf8b3733-ee35-4cc6-aafa-97fa3f859503 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:09.212001 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf8b3733-ee35-4cc6-aafa-97fa3f859503 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:09.337380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bf8b3733-ee35-4cc6-aafa-97fa3f859503 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:09.345343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bf8b3733-ee35-4cc6-aafa-97fa3f859503 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.146193 Aug 06 13:07:09.345934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1849/3690] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:09 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:09.499065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:09.499664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:09.506058 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:09.506530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:09.506958 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:09.507676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:09.508074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:09.508517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:09.633580 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:09.641365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:09.642868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:09.644003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-97b9b1e0-e673-4374-9407-e60bfced09e2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.148905 Aug 06 13:07:09.644578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1842/3691] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:09 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:09.828538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6dc490ab-6d77-4b2f-817b-f7df05c19186 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:09.829164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6dc490ab-6d77-4b2f-817b-f7df05c19186 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:09.835053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc490ab-6d77-4b2f-817b-f7df05c19186 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:09.835535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc490ab-6d77-4b2f-817b-f7df05c19186 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:09.835966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc490ab-6d77-4b2f-817b-f7df05c19186 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:09.836670 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc490ab-6d77-4b2f-817b-f7df05c19186 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:09.837119 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc490ab-6d77-4b2f-817b-f7df05c19186 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:09.837538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dc490ab-6d77-4b2f-817b-f7df05c19186 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:09.855839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:09.904587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6dc490ab-6d77-4b2f-817b-f7df05c19186 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:09.911959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6dc490ab-6d77-4b2f-817b-f7df05c19186 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.087729 Aug 06 13:07:09.912552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1850/3692] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:09 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:10.367533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7a912e50-8714-49be-8b73-c943704286fc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:10.368153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7a912e50-8714-49be-8b73-c943704286fc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:10.374981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a912e50-8714-49be-8b73-c943704286fc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:10.375552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a912e50-8714-49be-8b73-c943704286fc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:10.375997 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a912e50-8714-49be-8b73-c943704286fc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:10.376972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a912e50-8714-49be-8b73-c943704286fc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:10.377815 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a912e50-8714-49be-8b73-c943704286fc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:10.378588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a912e50-8714-49be-8b73-c943704286fc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:10.509654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a912e50-8714-49be-8b73-c943704286fc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:10.516872 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7a912e50-8714-49be-8b73-c943704286fc tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.153359 Aug 06 13:07:10.517423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1843/3693] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:10 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:10.666769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:10.667359 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:10.674175 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:10.674641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:10.675091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:10.675762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:10.676204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:10.676643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:10.933010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-639efa6c-6956-4755-a587-fa46818c60e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:10.933789 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-639efa6c-6956-4755-a587-fa46818c60e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:10.939720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-639efa6c-6956-4755-a587-fa46818c60e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:10.940212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-639efa6c-6956-4755-a587-fa46818c60e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:10.940686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-639efa6c-6956-4755-a587-fa46818c60e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:10.941384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-639efa6c-6956-4755-a587-fa46818c60e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:10.941842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-639efa6c-6956-4755-a587-fa46818c60e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:10.942271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-639efa6c-6956-4755-a587-fa46818c60e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:11.003375 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-639efa6c-6956-4755-a587-fa46818c60e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:11.010773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-639efa6c-6956-4755-a587-fa46818c60e7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.081944 Aug 06 13:07:11.011346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1844/3694] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:10 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:11.012892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:11.020879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:11.022469 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:11.023706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0818564f-e776-465c-af89-a1c7e359a54d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.360786 Aug 06 13:07:11.024257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1851/3695] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:10 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:11.539847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8d95ffa3-e772-4bb2-8474-b3cb6742321e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:11.540695 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8d95ffa3-e772-4bb2-8474-b3cb6742321e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:11.547874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d95ffa3-e772-4bb2-8474-b3cb6742321e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:11.548707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d95ffa3-e772-4bb2-8474-b3cb6742321e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:11.549380 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d95ffa3-e772-4bb2-8474-b3cb6742321e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:11.550280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d95ffa3-e772-4bb2-8474-b3cb6742321e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:11.550728 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d95ffa3-e772-4bb2-8474-b3cb6742321e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:11.551169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d95ffa3-e772-4bb2-8474-b3cb6742321e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:11.839884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8d95ffa3-e772-4bb2-8474-b3cb6742321e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:11.847412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8d95ffa3-e772-4bb2-8474-b3cb6742321e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.313011 Aug 06 13:07:11.847983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1845/3696] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:11 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:12.031331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cd12374b-dfd5-458d-8ecf-57ff13cc220a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:12.032111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cd12374b-dfd5-458d-8ecf-57ff13cc220a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:12.039152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd12374b-dfd5-458d-8ecf-57ff13cc220a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:12.039772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd12374b-dfd5-458d-8ecf-57ff13cc220a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:12.040393 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd12374b-dfd5-458d-8ecf-57ff13cc220a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:12.041092 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd12374b-dfd5-458d-8ecf-57ff13cc220a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:12.041651 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd12374b-dfd5-458d-8ecf-57ff13cc220a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:12.042255 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd12374b-dfd5-458d-8ecf-57ff13cc220a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:12.047509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:12.048313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:12.055056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:12.055772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:12.056238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:12.056969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:12.057425 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:12.058053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:12.107980 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cd12374b-dfd5-458d-8ecf-57ff13cc220a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:12.115918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cd12374b-dfd5-458d-8ecf-57ff13cc220a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1299 microversion: 2.1 time: 0.088691 Aug 06 13:07:12.116540 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1852/3697] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:12 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:12.336752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:12.345714 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:12.347376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:12.348591 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-327e6d90-460f-468f-88c7-e1c9b97235f6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1736 microversion: 2.20 time: 0.305558 Aug 06 13:07:12.353067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1846/3698] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:12 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1736 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:12.412754 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-4bd6f141-c997-4c72-8c1a-0ebb6f085348 req-de3eccfe-c517-4504-bd46-3d96e12b826c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9d58a0-ba13-4c19-b4c5-d4cc70058e18", "tag": "9de4834e-e401-4b5c-a66f-d304dddac190"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:12.430211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-4bd6f141-c997-4c72-8c1a-0ebb6f085348 req-de3eccfe-c517-4504-bd46-3d96e12b826c service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:12.430746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-4bd6f141-c997-4c72-8c1a-0ebb6f085348 req-de3eccfe-c517-4504-bd46-3d96e12b826c service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:12.431115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-4bd6f141-c997-4c72-8c1a-0ebb6f085348 req-de3eccfe-c517-4504-bd46-3d96e12b826c service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:12.446831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-4bd6f141-c997-4c72-8c1a-0ebb6f085348 req-de3eccfe-c517-4504-bd46-3d96e12b826c service nova] Creating event network-changed:9de4834e-e401-4b5c-a66f-d304dddac190 for instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 on hv-cinder-85199 Aug 06 13:07:12.463920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-4bd6f141-c997-4c72-8c1a-0ebb6f085348 req-de3eccfe-c517-4504-bd46-3d96e12b826c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054641 Aug 06 13:07:12.464831 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1853/3699] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:07:12.868720 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-820d7144-9214-4de0-88d5-30ae7f33b245 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:12.869298 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-820d7144-9214-4de0-88d5-30ae7f33b245 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:12.875645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820d7144-9214-4de0-88d5-30ae7f33b245 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:12.876123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820d7144-9214-4de0-88d5-30ae7f33b245 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:12.876681 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820d7144-9214-4de0-88d5-30ae7f33b245 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:12.877283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820d7144-9214-4de0-88d5-30ae7f33b245 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:12.877735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820d7144-9214-4de0-88d5-30ae7f33b245 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:12.878159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-820d7144-9214-4de0-88d5-30ae7f33b245 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:13.195318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0ce4ee61-870e-45d1-8038-7af9f1c3ab6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:13.196238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0ce4ee61-870e-45d1-8038-7af9f1c3ab6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:13.203605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ce4ee61-870e-45d1-8038-7af9f1c3ab6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:13.204258 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ce4ee61-870e-45d1-8038-7af9f1c3ab6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:13.204827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ce4ee61-870e-45d1-8038-7af9f1c3ab6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:13.205693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ce4ee61-870e-45d1-8038-7af9f1c3ab6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:13.206245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ce4ee61-870e-45d1-8038-7af9f1c3ab6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:13.206767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0ce4ee61-870e-45d1-8038-7af9f1c3ab6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:13.385310 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-820d7144-9214-4de0-88d5-30ae7f33b245 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:13.393658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-820d7144-9214-4de0-88d5-30ae7f33b245 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.528771 Aug 06 13:07:13.394229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1847/3700] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:12 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:13.399132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:13.399732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:13.405540 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:13.406189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:13.406769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:13.407601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:13.408226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:13.408683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:13.427394 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0ce4ee61-870e-45d1-8038-7af9f1c3ab6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:13.435439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0ce4ee61-870e-45d1-8038-7af9f1c3ab6b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1366 microversion: 2.1 time: 0.244311 Aug 06 13:07:13.436217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1854/3701] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:13 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:13.645917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:13.654032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:13.655527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:13.656713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4bf65c62-9096-47cb-8f2d-1ef97d1d2fee tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1718 microversion: 2.20 time: 0.261288 Aug 06 13:07:13.657274 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1848/3702] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:13 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1718 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:14.414966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fa3e643d-ac7c-45bc-9a11-256774f564e7 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:14.415740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fa3e643d-ac7c-45bc-9a11-256774f564e7 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:14.422281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa3e643d-ac7c-45bc-9a11-256774f564e7 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.423480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa3e643d-ac7c-45bc-9a11-256774f564e7 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.424006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa3e643d-ac7c-45bc-9a11-256774f564e7 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.424818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa3e643d-ac7c-45bc-9a11-256774f564e7 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.425424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa3e643d-ac7c-45bc-9a11-256774f564e7 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.425978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa3e643d-ac7c-45bc-9a11-256774f564e7 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.456267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9042293e-b159-4273-871b-b939707f4c84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:14.456907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9042293e-b159-4273-871b-b939707f4c84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:14.470435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9042293e-b159-4273-871b-b939707f4c84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.470917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9042293e-b159-4273-871b-b939707f4c84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.471377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9042293e-b159-4273-871b-b939707f4c84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.472068 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9042293e-b159-4273-871b-b939707f4c84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.472538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9042293e-b159-4273-871b-b939707f4c84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.472960 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9042293e-b159-4273-871b-b939707f4c84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.632103 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fa3e643d-ac7c-45bc-9a11-256774f564e7 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:14.653317 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fa3e643d-ac7c-45bc-9a11-256774f564e7 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.243117 Aug 06 13:07:14.654492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1855/3703] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:14 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:14.660032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-1630ef07-0d8c-440e-bb69-68444497d4b4 req-53a0de35-e792-49d1-be98-de7c594aa8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7af22f0-39a7-4b2b-9c17-4a6db1207b5d", "tag": "6448a0de-425a-4afd-b83e-ff03fbdc86a1"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:14.669442 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-1630ef07-0d8c-440e-bb69-68444497d4b4 req-53a0de35-e792-49d1-be98-de7c594aa8db service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.670100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-1630ef07-0d8c-440e-bb69-68444497d4b4 req-53a0de35-e792-49d1-be98-de7c594aa8db service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.670523 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-1630ef07-0d8c-440e-bb69-68444497d4b4 req-53a0de35-e792-49d1-be98-de7c594aa8db service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.681987 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-1630ef07-0d8c-440e-bb69-68444497d4b4 req-53a0de35-e792-49d1-be98-de7c594aa8db service nova] Creating event network-changed:6448a0de-425a-4afd-b83e-ff03fbdc86a1 for instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d on hv-cinder-85199 Aug 06 13:07:14.687454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-1630ef07-0d8c-440e-bb69-68444497d4b4 req-53a0de35-e792-49d1-be98-de7c594aa8db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031528 Aug 06 13:07:14.688041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1856/3704] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:07:14.693025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c41cdf1-a67c-4565-8ced-7dccc0558a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:14.693586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c41cdf1-a67c-4565-8ced-7dccc0558a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:14.699458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c41cdf1-a67c-4565-8ced-7dccc0558a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.699933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c41cdf1-a67c-4565-8ced-7dccc0558a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.701010 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c41cdf1-a67c-4565-8ced-7dccc0558a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.701698 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c41cdf1-a67c-4565-8ced-7dccc0558a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.702142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c41cdf1-a67c-4565-8ced-7dccc0558a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.702559 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c41cdf1-a67c-4565-8ced-7dccc0558a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.730497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c41cdf1-a67c-4565-8ced-7dccc0558a75 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments/6f908efe-fd55-46c5-a2a1-41dc02c97d63" status: 200 len: 194 microversion: 2.1 time: 0.041263 Aug 06 13:07:14.731076 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1857/3705] 10.222.0.20 () {58 vars in 1413 bytes} [Sat Aug 6 13:07:14 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments/6f908efe-fd55-46c5-a2a1-41dc02c97d63 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:07:14.737790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:14.738399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:14.741474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9042293e-b159-4273-871b-b939707f4c84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:14.744366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.744990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.745425 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.746146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.746597 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.747161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.750793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9042293e-b159-4273-871b-b939707f4c84 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1366 microversion: 2.1 time: 0.298249 Aug 06 13:07:14.756648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1849/3706] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:14 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:14.761594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b194174-7922-457b-8fd7-d188464b2d1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:14.762079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7b194174-7922-457b-8fd7-d188464b2d1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:14.768432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b194174-7922-457b-8fd7-d188464b2d1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.768910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b194174-7922-457b-8fd7-d188464b2d1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.769347 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b194174-7922-457b-8fd7-d188464b2d1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.770026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b194174-7922-457b-8fd7-d188464b2d1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:14.770477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b194174-7922-457b-8fd7-d188464b2d1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:14.770898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b194174-7922-457b-8fd7-d188464b2d1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:14.850986 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-7b194174-7922-457b-8fd7-d188464b2d1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lazy-loading 'services' on Instance uuid 6531998f-cbb2-4338-97f5-18cab3aa7ab2 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 13:07:14.877163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:14.884988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:14.886495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:14.887649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-560dd84d-7708-48f1-b3be-6996a24a8c5f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1718 microversion: 2.20 time: 0.154202 Aug 06 13:07:14.889208 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1858/3707] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:14 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:14.928264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b194174-7922-457b-8fd7-d188464b2d1e tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments/6f908efe-fd55-46c5-a2a1-41dc02c97d63" status: 202 len: 0 microversion: 2.1 time: 0.170237 Aug 06 13:07:14.928895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1850/3708] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 13:07:14 2022] DELETE /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments/6f908efe-fd55-46c5-a2a1-41dc02c97d63 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:07:15.675159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1f7eab9a-e3e6-4b41-8053-75c3d76a743d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:15.675770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f7eab9a-e3e6-4b41-8053-75c3d76a743d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:15.681689 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f7eab9a-e3e6-4b41-8053-75c3d76a743d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:15.682164 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f7eab9a-e3e6-4b41-8053-75c3d76a743d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:15.682595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f7eab9a-e3e6-4b41-8053-75c3d76a743d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:15.683271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f7eab9a-e3e6-4b41-8053-75c3d76a743d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:15.683720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f7eab9a-e3e6-4b41-8053-75c3d76a743d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:15.684141 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f7eab9a-e3e6-4b41-8053-75c3d76a743d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:15.771795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1a58f8d1-be65-4f2a-815a-619a2ef0c527 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:15.772514 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1a58f8d1-be65-4f2a-815a-619a2ef0c527 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:15.779272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a58f8d1-be65-4f2a-815a-619a2ef0c527 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:15.779753 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a58f8d1-be65-4f2a-815a-619a2ef0c527 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:15.780184 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a58f8d1-be65-4f2a-815a-619a2ef0c527 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:15.780905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a58f8d1-be65-4f2a-815a-619a2ef0c527 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:15.781363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a58f8d1-be65-4f2a-815a-619a2ef0c527 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:15.781787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a58f8d1-be65-4f2a-815a-619a2ef0c527 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:15.811392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1f7eab9a-e3e6-4b41-8053-75c3d76a743d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:15.818790 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1f7eab9a-e3e6-4b41-8053-75c3d76a743d tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.147696 Aug 06 13:07:15.819344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1859/3709] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:15 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:15.909787 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1a58f8d1-be65-4f2a-815a-619a2ef0c527 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:15.911970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:15.912591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:15.917272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1a58f8d1-be65-4f2a-815a-619a2ef0c527 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1366 microversion: 2.1 time: 0.150076 Aug 06 13:07:15.918086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1851/3710] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:15 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:15.918471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:15.919028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:15.919492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:15.920158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:15.920628 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:15.921047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:16.047775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:16.055684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:16.057196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:16.058340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c11bbb00-fc06-478c-a7ca-ffd72d225d24 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1718 microversion: 2.20 time: 0.150223 Aug 06 13:07:16.058886 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1860/3711] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:15 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:16.838921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5056e978-f214-49f6-af46-565b9b2afa83 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:16.839523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5056e978-f214-49f6-af46-565b9b2afa83 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:16.847320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5056e978-f214-49f6-af46-565b9b2afa83 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:16.847818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5056e978-f214-49f6-af46-565b9b2afa83 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:16.848258 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5056e978-f214-49f6-af46-565b9b2afa83 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:16.848984 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5056e978-f214-49f6-af46-565b9b2afa83 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:16.849451 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5056e978-f214-49f6-af46-565b9b2afa83 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:16.849963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5056e978-f214-49f6-af46-565b9b2afa83 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:16.937610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7a9471f1-0d8b-4334-bb8e-75918249cfc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:16.938139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7a9471f1-0d8b-4334-bb8e-75918249cfc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:16.944514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a9471f1-0d8b-4334-bb8e-75918249cfc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:16.945169 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a9471f1-0d8b-4334-bb8e-75918249cfc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:16.945607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a9471f1-0d8b-4334-bb8e-75918249cfc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:16.946298 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a9471f1-0d8b-4334-bb8e-75918249cfc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:16.946751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a9471f1-0d8b-4334-bb8e-75918249cfc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:16.947174 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7a9471f1-0d8b-4334-bb8e-75918249cfc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:17.010921 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5056e978-f214-49f6-af46-565b9b2afa83 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:17.018822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5056e978-f214-49f6-af46-565b9b2afa83 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.183713 Aug 06 13:07:17.019476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1852/3712] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:16 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:17.083639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:17.084255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:17.086623 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7a9471f1-0d8b-4334-bb8e-75918249cfc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:17.090367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:17.091605 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:17.092043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:17.092762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:17.093429 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:17.103300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7a9471f1-0d8b-4334-bb8e-75918249cfc5 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1366 microversion: 2.1 time: 0.161251 Aug 06 13:07:17.103300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1861/3713] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:16 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:17.105180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:17.136461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-b7d483c8-568d-4190-ad03-dd842be17e01 req-fc06699e-0bb5-4738-a8b1-1986daf2d979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9511bf2-6616-4fd6-9739-6c901a1da341", "name": "network-vif-unplugged", "status": "completed", "tag": "5653f9b3-1473-445f-9406-188160ed27ac"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:17.147470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-b7d483c8-568d-4190-ad03-dd842be17e01 req-fc06699e-0bb5-4738-a8b1-1986daf2d979 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:17.148023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-b7d483c8-568d-4190-ad03-dd842be17e01 req-fc06699e-0bb5-4738-a8b1-1986daf2d979 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:17.148535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-b7d483c8-568d-4190-ad03-dd842be17e01 req-fc06699e-0bb5-4738-a8b1-1986daf2d979 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:17.163482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-b7d483c8-568d-4190-ad03-dd842be17e01 req-fc06699e-0bb5-4738-a8b1-1986daf2d979 service nova] Creating event network-vif-unplugged:5653f9b3-1473-445f-9406-188160ed27ac for instance e9511bf2-6616-4fd6-9739-6c901a1da341 on hv-cinder-85199 Aug 06 13:07:17.168497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-b7d483c8-568d-4190-ad03-dd842be17e01 req-fc06699e-0bb5-4738-a8b1-1986daf2d979 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035595 Aug 06 13:07:17.170011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1862/3714] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:07:17.242372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:17.250370 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:17.251871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:17.253067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-962fd1d2-e8e7-4b68-ae8b-151364edf7f2 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1718 microversion: 2.20 time: 0.173527 Aug 06 13:07:17.253623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1853/3715] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:17 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:18.041133 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-edf0c47f-fd7a-4b9a-b368-6a3d2967db10 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:18.041972 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-edf0c47f-fd7a-4b9a-b368-6a3d2967db10 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:18.048962 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edf0c47f-fd7a-4b9a-b368-6a3d2967db10 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:18.049438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edf0c47f-fd7a-4b9a-b368-6a3d2967db10 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:18.049866 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edf0c47f-fd7a-4b9a-b368-6a3d2967db10 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:18.050550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edf0c47f-fd7a-4b9a-b368-6a3d2967db10 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:18.050997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edf0c47f-fd7a-4b9a-b368-6a3d2967db10 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:18.051412 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edf0c47f-fd7a-4b9a-b368-6a3d2967db10 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:18.116825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d95d11d2-6171-4315-a03d-566b0e582e75 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:18.117653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d95d11d2-6171-4315-a03d-566b0e582e75 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:18.127246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d95d11d2-6171-4315-a03d-566b0e582e75 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:18.127875 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d95d11d2-6171-4315-a03d-566b0e582e75 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:18.128661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d95d11d2-6171-4315-a03d-566b0e582e75 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:18.129485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d95d11d2-6171-4315-a03d-566b0e582e75 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:18.130056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d95d11d2-6171-4315-a03d-566b0e582e75 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:18.130621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d95d11d2-6171-4315-a03d-566b0e582e75 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:18.188516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-edf0c47f-fd7a-4b9a-b368-6a3d2967db10 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:18.196000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-edf0c47f-fd7a-4b9a-b368-6a3d2967db10 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.159132 Aug 06 13:07:18.196604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1863/3716] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:18 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:18.265023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d95d11d2-6171-4315-a03d-566b0e582e75 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:18.272196 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d95d11d2-6171-4315-a03d-566b0e582e75 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1366 microversion: 2.1 time: 0.160335 Aug 06 13:07:18.272772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1854/3717] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:18 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:18.276219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:18.276877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:18.282679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:18.283192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:18.283618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:18.284292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:18.284835 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:18.285254 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:18.410104 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:18.417856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:18.419970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:18.421137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-28f13608-431b-4a96-add8-55a932ca72b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1718 microversion: 2.20 time: 0.148893 Aug 06 13:07:18.421693 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1864/3718] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:18 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:19.222830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-737fd1a3-7845-43ca-804c-9d9bf5b612c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:19.223583 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-737fd1a3-7845-43ca-804c-9d9bf5b612c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:19.232051 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737fd1a3-7845-43ca-804c-9d9bf5b612c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:19.232571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737fd1a3-7845-43ca-804c-9d9bf5b612c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:19.233007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737fd1a3-7845-43ca-804c-9d9bf5b612c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:19.233704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737fd1a3-7845-43ca-804c-9d9bf5b612c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:19.234154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737fd1a3-7845-43ca-804c-9d9bf5b612c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:19.234577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-737fd1a3-7845-43ca-804c-9d9bf5b612c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:19.292859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-45c56c36-c136-445f-9a5f-e68066358be3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:19.293494 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-45c56c36-c136-445f-9a5f-e68066358be3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:19.299967 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45c56c36-c136-445f-9a5f-e68066358be3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:19.300488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45c56c36-c136-445f-9a5f-e68066358be3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:19.300923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45c56c36-c136-445f-9a5f-e68066358be3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:19.301605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45c56c36-c136-445f-9a5f-e68066358be3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:19.302056 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45c56c36-c136-445f-9a5f-e68066358be3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:19.302478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45c56c36-c136-445f-9a5f-e68066358be3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:19.362919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-737fd1a3-7845-43ca-804c-9d9bf5b612c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:19.371374 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-737fd1a3-7845-43ca-804c-9d9bf5b612c5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.159296 Aug 06 13:07:19.371938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1855/3719] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:19 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:19.432774 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-45c56c36-c136-445f-9a5f-e68066358be3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:19.440561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-45c56c36-c136-445f-9a5f-e68066358be3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1366 microversion: 2.1 time: 0.151529 Aug 06 13:07:19.441270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1865/3720] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:19 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:19.443168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:19.443786 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:19.449742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:19.450909 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:19.451353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:19.452039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:19.452529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:19.452936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:19.470444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:19.580998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:19.588783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:19.590287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:19.591441 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fe819546-8979-4a8c-8b4f-d8025520b344 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1718 microversion: 2.20 time: 0.152346 Aug 06 13:07:19.592005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1856/3721] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:19 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:20.393416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3da1e20a-3a26-4bbd-b0ce-d6c6c2d8bcc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:20.394195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3da1e20a-3a26-4bbd-b0ce-d6c6c2d8bcc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:20.400767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3da1e20a-3a26-4bbd-b0ce-d6c6c2d8bcc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:20.401598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3da1e20a-3a26-4bbd-b0ce-d6c6c2d8bcc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:20.402054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3da1e20a-3a26-4bbd-b0ce-d6c6c2d8bcc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:20.402734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3da1e20a-3a26-4bbd-b0ce-d6c6c2d8bcc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:20.403179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3da1e20a-3a26-4bbd-b0ce-d6c6c2d8bcc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:20.404134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3da1e20a-3a26-4bbd-b0ce-d6c6c2d8bcc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:20.462379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-06b89a9a-cb96-4dea-ba14-9b277a008419 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:20.462991 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-06b89a9a-cb96-4dea-ba14-9b277a008419 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:20.473240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b89a9a-cb96-4dea-ba14-9b277a008419 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:20.473742 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b89a9a-cb96-4dea-ba14-9b277a008419 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:20.474182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b89a9a-cb96-4dea-ba14-9b277a008419 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:20.474896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b89a9a-cb96-4dea-ba14-9b277a008419 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:20.475387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b89a9a-cb96-4dea-ba14-9b277a008419 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:20.475848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b89a9a-cb96-4dea-ba14-9b277a008419 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:20.556988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3da1e20a-3a26-4bbd-b0ce-d6c6c2d8bcc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:20.564893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3da1e20a-3a26-4bbd-b0ce-d6c6c2d8bcc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.175969 Aug 06 13:07:20.565451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1866/3722] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:20 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:20.615170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:20.615769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:20.621731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:20.622764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:20.623193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:20.623877 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:20.624339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:20.624759 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:20.678449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-06b89a9a-cb96-4dea-ba14-9b277a008419 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:20.687272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-06b89a9a-cb96-4dea-ba14-9b277a008419 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1366 microversion: 2.1 time: 0.229169 Aug 06 13:07:20.687855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1857/3723] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:20 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:20.758227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:20.766542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:20.768035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:20.769287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9ab552ed-8357-4f82-897a-dcf025537c0b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1661 microversion: 2.20 time: 0.158567 Aug 06 13:07:20.770492 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1867/3724] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:20 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:20.792226 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2e4d72b3-015c-4564-b9cd-bd4a5df0c6fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53f92d15-084e-4e46-a4f0-07bb403a05f2"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:20.794725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2e4d72b3-015c-4564-b9cd-bd4a5df0c6fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:20.800674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e4d72b3-015c-4564-b9cd-bd4a5df0c6fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:20.801158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e4d72b3-015c-4564-b9cd-bd4a5df0c6fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:20.801597 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e4d72b3-015c-4564-b9cd-bd4a5df0c6fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:20.802281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e4d72b3-015c-4564-b9cd-bd4a5df0c6fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:20.802733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e4d72b3-015c-4564-b9cd-bd4a5df0c6fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:20.803159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e4d72b3-015c-4564-b9cd-bd4a5df0c6fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.064491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2e4d72b3-015c-4564-b9cd-bd4a5df0c6fa tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.276119 Aug 06 13:07:21.065109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1858/3725] 10.222.0.20 () {62 vars in 1364 bytes} [Sat Aug 6 13:07:20 2022] POST /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/os-volume_attachments => generated 188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 13:07:21.188780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-786efe63-78ff-4c91-af26-956a2823eedd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:21.189268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-786efe63-78ff-4c91-af26-956a2823eedd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:21.195203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-786efe63-78ff-4c91-af26-956a2823eedd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.195682 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-786efe63-78ff-4c91-af26-956a2823eedd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.196111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-786efe63-78ff-4c91-af26-956a2823eedd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.196814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-786efe63-78ff-4c91-af26-956a2823eedd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.197268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-786efe63-78ff-4c91-af26-956a2823eedd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.197687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-786efe63-78ff-4c91-af26-956a2823eedd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.285081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:21.333455 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-68dd33b8-440c-4405-bff5-86bf048e897d req-174fc8d2-9b80-4aee-aca9-6257908d0222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7af22f0-39a7-4b2b-9c17-4a6db1207b5d", "name": "network-vif-plugged", "status": "completed", "tag": "6448a0de-425a-4afd-b83e-ff03fbdc86a1"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:21.348054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-68dd33b8-440c-4405-bff5-86bf048e897d req-174fc8d2-9b80-4aee-aca9-6257908d0222 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.349010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-68dd33b8-440c-4405-bff5-86bf048e897d req-174fc8d2-9b80-4aee-aca9-6257908d0222 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.349232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-68dd33b8-440c-4405-bff5-86bf048e897d req-174fc8d2-9b80-4aee-aca9-6257908d0222 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.364501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-68dd33b8-440c-4405-bff5-86bf048e897d req-174fc8d2-9b80-4aee-aca9-6257908d0222 service nova] Creating event network-vif-plugged:6448a0de-425a-4afd-b83e-ff03fbdc86a1 for instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d on hv-cinder-85199 Aug 06 13:07:21.373685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-68dd33b8-440c-4405-bff5-86bf048e897d req-174fc8d2-9b80-4aee-aca9-6257908d0222 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043974 Aug 06 13:07:21.374731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1859/3726] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:07:21.407092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38084b45-8124-4b2e-b902-82a14d6dcc2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:21.409419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38084b45-8124-4b2e-b902-82a14d6dcc2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:21.416427 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38084b45-8124-4b2e-b902-82a14d6dcc2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.417183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38084b45-8124-4b2e-b902-82a14d6dcc2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.417335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38084b45-8124-4b2e-b902-82a14d6dcc2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.418026 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38084b45-8124-4b2e-b902-82a14d6dcc2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.418473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38084b45-8124-4b2e-b902-82a14d6dcc2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.419486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38084b45-8124-4b2e-b902-82a14d6dcc2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.455899 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38084b45-8124-4b2e-b902-82a14d6dcc2a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053415 Aug 06 13:07:21.457397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1860/3727] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:07:21 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 13:07:21.530760 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-786efe63-78ff-4c91-af26-956a2823eedd tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/os-volume_attachments/53f92d15-084e-4e46-a4f0-07bb403a05f2" status: 202 len: 0 microversion: 2.20 time: 0.346312 Aug 06 13:07:21.534356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1868/3728] 10.222.0.20 () {60 vars in 1457 bytes} [Sat Aug 6 13:07:21 2022] DELETE /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/os-volume_attachments/53f92d15-084e-4e46-a4f0-07bb403a05f2 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:07:21.584400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-710b0cf1-2112-48cf-b828-b93799b92f23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:21.586545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-710b0cf1-2112-48cf-b828-b93799b92f23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:21.587049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7c81e547-6783-495a-a085-ed87ddb9d683 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:21.587720 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7c81e547-6783-495a-a085-ed87ddb9d683 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:21.593690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-710b0cf1-2112-48cf-b828-b93799b92f23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.594173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-710b0cf1-2112-48cf-b828-b93799b92f23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.594612 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-710b0cf1-2112-48cf-b828-b93799b92f23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.595305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-710b0cf1-2112-48cf-b828-b93799b92f23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.595757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-710b0cf1-2112-48cf-b828-b93799b92f23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.596178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-710b0cf1-2112-48cf-b828-b93799b92f23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.600802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c81e547-6783-495a-a085-ed87ddb9d683 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.601618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c81e547-6783-495a-a085-ed87ddb9d683 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.602113 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c81e547-6783-495a-a085-ed87ddb9d683 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.602893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c81e547-6783-495a-a085-ed87ddb9d683 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.603420 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c81e547-6783-495a-a085-ed87ddb9d683 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.603906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c81e547-6783-495a-a085-ed87ddb9d683 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.628529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-710b0cf1-2112-48cf-b828-b93799b92f23 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047758 Aug 06 13:07:21.634351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1861/3729] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:07:21 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 13:07:21.634351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f687f516-a9ca-49de-9229-2cb5acbc1cd8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:21.634572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f687f516-a9ca-49de-9229-2cb5acbc1cd8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:21.640610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f687f516-a9ca-49de-9229-2cb5acbc1cd8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.641095 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f687f516-a9ca-49de-9229-2cb5acbc1cd8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.641526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f687f516-a9ca-49de-9229-2cb5acbc1cd8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.642212 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f687f516-a9ca-49de-9229-2cb5acbc1cd8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.642661 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f687f516-a9ca-49de-9229-2cb5acbc1cd8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.643084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f687f516-a9ca-49de-9229-2cb5acbc1cd8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.709098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f687f516-a9ca-49de-9229-2cb5acbc1cd8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117825) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 13:07:21.748050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7c81e547-6783-495a-a085-ed87ddb9d683 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:21.758704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7c81e547-6783-495a-a085-ed87ddb9d683 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.176174 Aug 06 13:07:21.759392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1869/3730] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:21 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:21.764466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c88e396-bda2-43f1-8f32-f1ef58cc5c11 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:21.765041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c88e396-bda2-43f1-8f32-f1ef58cc5c11 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:21.770789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c88e396-bda2-43f1-8f32-f1ef58cc5c11 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.771343 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c88e396-bda2-43f1-8f32-f1ef58cc5c11 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.771849 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c88e396-bda2-43f1-8f32-f1ef58cc5c11 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.772626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c88e396-bda2-43f1-8f32-f1ef58cc5c11 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.773562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c88e396-bda2-43f1-8f32-f1ef58cc5c11 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.773562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c88e396-bda2-43f1-8f32-f1ef58cc5c11 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.787399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f687f516-a9ca-49de-9229-2cb5acbc1cd8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "POST /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/action" status: 202 len: 0 microversion: 2.20 time: 0.156764 Aug 06 13:07:21.791133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1862/3731] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Aug 6 13:07:21 2022] POST /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:07:21.792684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5f3283a-5c2c-4225-856b-11d4bcf3ee3e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:21.793281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5f3283a-5c2c-4225-856b-11d4bcf3ee3e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:21.799362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f3283a-5c2c-4225-856b-11d4bcf3ee3e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.799842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f3283a-5c2c-4225-856b-11d4bcf3ee3e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.800342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f3283a-5c2c-4225-856b-11d4bcf3ee3e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.800963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f3283a-5c2c-4225-856b-11d4bcf3ee3e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.801408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f3283a-5c2c-4225-856b-11d4bcf3ee3e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.801823 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f3283a-5c2c-4225-856b-11d4bcf3ee3e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.803268 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c88e396-bda2-43f1-8f32-f1ef58cc5c11 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 13:07:21.890049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c88e396-bda2-43f1-8f32-f1ef58cc5c11 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 204 len: 0 microversion: 2.1 time: 0.129314 Aug 06 13:07:21.893681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1870/3732] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:07:21 2022] DELETE /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:07:21.897257 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:21.898554 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:21.906486 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.907154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.907612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:21.908453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:21.908931 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:21.909388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:22.004988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5f3283a-5c2c-4225-856b-11d4bcf3ee3e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:22.016542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5f3283a-5c2c-4225-856b-11d4bcf3ee3e tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1366 microversion: 2.1 time: 0.225269 Aug 06 13:07:22.020535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1863/3733] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:21 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:22.024738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4899518-703f-477b-a704-b9f72ad01edf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:22.025338 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4899518-703f-477b-a704-b9f72ad01edf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:22.033589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4899518-703f-477b-a704-b9f72ad01edf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:22.034145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4899518-703f-477b-a704-b9f72ad01edf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:22.034585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4899518-703f-477b-a704-b9f72ad01edf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:22.035282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4899518-703f-477b-a704-b9f72ad01edf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:22.035731 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4899518-703f-477b-a704-b9f72ad01edf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:22.036146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4899518-703f-477b-a704-b9f72ad01edf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:22.087629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:22.097956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:22.100074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:22.101530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-abd5c405-4028-4332-8cb4-01d22ae336bc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1669 microversion: 2.20 time: 0.209069 Aug 06 13:07:22.102090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1871/3734] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:21 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1669 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:22.191740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b4899518-703f-477b-a704-b9f72ad01edf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:22.199252 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4899518-703f-477b-a704-b9f72ad01edf tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1670 microversion: 2.1 time: 0.180744 Aug 06 13:07:22.199816 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1864/3735] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:22 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:22.779243 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dae5c80d-4273-469b-bb95-6c3a9bad8761 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:22.779756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dae5c80d-4273-469b-bb95-6c3a9bad8761 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:22.786058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae5c80d-4273-469b-bb95-6c3a9bad8761 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:22.786529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae5c80d-4273-469b-bb95-6c3a9bad8761 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:22.786954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae5c80d-4273-469b-bb95-6c3a9bad8761 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:22.787620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae5c80d-4273-469b-bb95-6c3a9bad8761 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:22.788063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae5c80d-4273-469b-bb95-6c3a9bad8761 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:22.788504 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dae5c80d-4273-469b-bb95-6c3a9bad8761 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:22.912671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dae5c80d-4273-469b-bb95-6c3a9bad8761 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:22.920684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dae5c80d-4273-469b-bb95-6c3a9bad8761 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.145325 Aug 06 13:07:22.921238 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1872/3736] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:22 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:23.037549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a06d6b81-6ea0-49e6-83fb-309c6f81d962 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:23.038180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a06d6b81-6ea0-49e6-83fb-309c6f81d962 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:23.045327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a06d6b81-6ea0-49e6-83fb-309c6f81d962 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:23.045964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a06d6b81-6ea0-49e6-83fb-309c6f81d962 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:23.046395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a06d6b81-6ea0-49e6-83fb-309c6f81d962 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:23.047088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a06d6b81-6ea0-49e6-83fb-309c6f81d962 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:23.047541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a06d6b81-6ea0-49e6-83fb-309c6f81d962 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:23.047965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a06d6b81-6ea0-49e6-83fb-309c6f81d962 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:23.125072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:23.125675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:23.131942 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:23.132459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:23.132893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:23.133582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:23.134035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:23.134459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:23.188432 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a06d6b81-6ea0-49e6-83fb-309c6f81d962 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:23.199831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a06d6b81-6ea0-49e6-83fb-309c6f81d962 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1366 microversion: 2.1 time: 0.165890 Aug 06 13:07:23.201130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1865/3737] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:23 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:23.222330 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9f8dbe8c-72f0-4919-89e5-53de4b9c182b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:23.222936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9f8dbe8c-72f0-4919-89e5-53de4b9c182b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:23.230082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f8dbe8c-72f0-4919-89e5-53de4b9c182b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:23.230565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f8dbe8c-72f0-4919-89e5-53de4b9c182b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:23.231002 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f8dbe8c-72f0-4919-89e5-53de4b9c182b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:23.231715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f8dbe8c-72f0-4919-89e5-53de4b9c182b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:23.232164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f8dbe8c-72f0-4919-89e5-53de4b9c182b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:23.232693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f8dbe8c-72f0-4919-89e5-53de4b9c182b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:23.287532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:23.295789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:23.297280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:23.298424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-695b1184-251d-4211-8c40-d95bcae54f97 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1669 microversion: 2.20 time: 0.177383 Aug 06 13:07:23.298986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1873/3738] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:23 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:23.365505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9f8dbe8c-72f0-4919-89e5-53de4b9c182b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:23.372905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9f8dbe8c-72f0-4919-89e5-53de4b9c182b tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1670 microversion: 2.1 time: 0.155169 Aug 06 13:07:23.373458 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1866/3739] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:23 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:23.396577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-93b7104e-4686-4e20-81b8-83676bdea190 req-3ab0cc98-7d11-4a5a-a8b1-39ea2ab4583f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9d58a0-ba13-4c19-b4c5-d4cc70058e18", "name": "network-vif-plugged", "status": "completed", "tag": "9de4834e-e401-4b5c-a66f-d304dddac190"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:23.406399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-93b7104e-4686-4e20-81b8-83676bdea190 req-3ab0cc98-7d11-4a5a-a8b1-39ea2ab4583f service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:23.406863 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-93b7104e-4686-4e20-81b8-83676bdea190 req-3ab0cc98-7d11-4a5a-a8b1-39ea2ab4583f service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:23.407279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-93b7104e-4686-4e20-81b8-83676bdea190 req-3ab0cc98-7d11-4a5a-a8b1-39ea2ab4583f service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:23.417536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-93b7104e-4686-4e20-81b8-83676bdea190 req-3ab0cc98-7d11-4a5a-a8b1-39ea2ab4583f service nova] Creating event network-vif-plugged:9de4834e-e401-4b5c-a66f-d304dddac190 for instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 on hv-cinder-85199 Aug 06 13:07:23.422171 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-93b7104e-4686-4e20-81b8-83676bdea190 req-3ab0cc98-7d11-4a5a-a8b1-39ea2ab4583f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029337 Aug 06 13:07:23.422714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1874/3740] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:07:23.941680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4cefb170-2211-4c2d-ba02-a99a51a5f460 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:23.942278 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4cefb170-2211-4c2d-ba02-a99a51a5f460 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:23.944282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:23.950653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4cefb170-2211-4c2d-ba02-a99a51a5f460 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:23.951135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4cefb170-2211-4c2d-ba02-a99a51a5f460 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:23.951573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4cefb170-2211-4c2d-ba02-a99a51a5f460 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:23.952256 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4cefb170-2211-4c2d-ba02-a99a51a5f460 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:23.952736 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4cefb170-2211-4c2d-ba02-a99a51a5f460 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:23.953160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4cefb170-2211-4c2d-ba02-a99a51a5f460 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:24.081809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4cefb170-2211-4c2d-ba02-a99a51a5f460 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:24.089146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4cefb170-2211-4c2d-ba02-a99a51a5f460 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.151283 Aug 06 13:07:24.089730 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1867/3741] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:23 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:24.222376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-90dd1870-ded0-4db6-8cbe-dcd8985d4bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:24.223054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-90dd1870-ded0-4db6-8cbe-dcd8985d4bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:24.229386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90dd1870-ded0-4db6-8cbe-dcd8985d4bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:24.229856 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90dd1870-ded0-4db6-8cbe-dcd8985d4bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:24.230533 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90dd1870-ded0-4db6-8cbe-dcd8985d4bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:24.231731 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90dd1870-ded0-4db6-8cbe-dcd8985d4bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:24.232173 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90dd1870-ded0-4db6-8cbe-dcd8985d4bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:24.232629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90dd1870-ded0-4db6-8cbe-dcd8985d4bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:24.321074 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:24.321683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:24.327937 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:24.328450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:24.328914 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:24.329604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:24.330055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:24.330508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:24.362466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-90dd1870-ded0-4db6-8cbe-dcd8985d4bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:24.370851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-90dd1870-ded0-4db6-8cbe-dcd8985d4bf1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1366 microversion: 2.1 time: 0.153221 Aug 06 13:07:24.371409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1875/3742] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:24 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:24.393645 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6c60151d-6486-4549-8168-2939a4ae3b17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:24.394241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6c60151d-6486-4549-8168-2939a4ae3b17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:24.400110 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c60151d-6486-4549-8168-2939a4ae3b17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:24.400711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c60151d-6486-4549-8168-2939a4ae3b17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:24.401139 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c60151d-6486-4549-8168-2939a4ae3b17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:24.401823 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c60151d-6486-4549-8168-2939a4ae3b17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:24.402543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c60151d-6486-4549-8168-2939a4ae3b17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:24.403479 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6c60151d-6486-4549-8168-2939a4ae3b17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:24.482207 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:24.494561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:24.496390 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:24.497947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7e86588e-5a6b-4758-874b-1ea4c9d58bf4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1669 microversion: 2.20 time: 0.180408 Aug 06 13:07:24.498412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1868/3743] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:24 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1669 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:24.548059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6c60151d-6486-4549-8168-2939a4ae3b17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:24.555635 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6c60151d-6486-4549-8168-2939a4ae3b17 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1670 microversion: 2.1 time: 0.165804 Aug 06 13:07:24.556195 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1876/3744] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:24 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:25.110110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13f35aff-c521-4849-ad1a-7a164116826e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:25.110724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-13f35aff-c521-4849-ad1a-7a164116826e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:25.117407 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f35aff-c521-4849-ad1a-7a164116826e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:25.117890 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f35aff-c521-4849-ad1a-7a164116826e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:25.118324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f35aff-c521-4849-ad1a-7a164116826e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:25.119012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f35aff-c521-4849-ad1a-7a164116826e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:25.119464 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f35aff-c521-4849-ad1a-7a164116826e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:25.120022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f35aff-c521-4849-ad1a-7a164116826e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:25.294881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-13f35aff-c521-4849-ad1a-7a164116826e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:25.302515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-13f35aff-c521-4849-ad1a-7a164116826e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.196169 Aug 06 13:07:25.303267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1869/3745] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:25 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:25.391841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f3adfd04-fa04-49bc-9732-78549a15cc19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:25.392564 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f3adfd04-fa04-49bc-9732-78549a15cc19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:25.395059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:25.400472 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3adfd04-fa04-49bc-9732-78549a15cc19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:25.401088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3adfd04-fa04-49bc-9732-78549a15cc19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:25.401585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3adfd04-fa04-49bc-9732-78549a15cc19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:25.402342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3adfd04-fa04-49bc-9732-78549a15cc19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:25.402861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3adfd04-fa04-49bc-9732-78549a15cc19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:25.403360 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3adfd04-fa04-49bc-9732-78549a15cc19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:25.520294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:25.521044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:25.527022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:25.527502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:25.528164 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:25.528628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:25.529073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:25.529488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:25.534541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:25.535327 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f3adfd04-fa04-49bc-9732-78549a15cc19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:25.544392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f3adfd04-fa04-49bc-9732-78549a15cc19 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1555 microversion: 2.1 time: 0.156014 Aug 06 13:07:25.544524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1877/3746] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:25 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:25.565011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0c366346-91e5-44cf-97f9-00b27240ee08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:25.565502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0c366346-91e5-44cf-97f9-00b27240ee08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:25.571287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c366346-91e5-44cf-97f9-00b27240ee08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:25.571771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c366346-91e5-44cf-97f9-00b27240ee08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:25.572200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c366346-91e5-44cf-97f9-00b27240ee08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:25.572917 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c366346-91e5-44cf-97f9-00b27240ee08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:25.573367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c366346-91e5-44cf-97f9-00b27240ee08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:25.573787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c366346-91e5-44cf-97f9-00b27240ee08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:25.650826 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0c366346-91e5-44cf-97f9-00b27240ee08 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089947 Aug 06 13:07:25.651418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1878/3747] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Aug 6 13:07:25 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:07:25.661063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1b17a73-fe3c-4e16-8c5e-4bc431286cfb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:25.662240 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b1b17a73-fe3c-4e16-8c5e-4bc431286cfb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:25.668376 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1b17a73-fe3c-4e16-8c5e-4bc431286cfb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:25.669455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1b17a73-fe3c-4e16-8c5e-4bc431286cfb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:25.669961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1b17a73-fe3c-4e16-8c5e-4bc431286cfb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:25.670654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1b17a73-fe3c-4e16-8c5e-4bc431286cfb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:25.671134 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1b17a73-fe3c-4e16-8c5e-4bc431286cfb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:25.671561 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1b17a73-fe3c-4e16-8c5e-4bc431286cfb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:25.804112 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1b17a73-fe3c-4e16-8c5e-4bc431286cfb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:25.812269 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b1b17a73-fe3c-4e16-8c5e-4bc431286cfb tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1670 microversion: 2.1 time: 0.159672 Aug 06 13:07:25.812862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1879/3748] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:25 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:25.873762 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:25.881860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:25.883366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:25.884572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a95b1693-cc01-4e7b-839e-e6bdd9aea326 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.368158 Aug 06 13:07:25.885414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1870/3749] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:25 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:26.323120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8a0c94d6-68ee-45bd-bfe8-9a4fe15c26a4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:26.323716 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8a0c94d6-68ee-45bd-bfe8-9a4fe15c26a4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:26.330380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a0c94d6-68ee-45bd-bfe8-9a4fe15c26a4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:26.330869 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a0c94d6-68ee-45bd-bfe8-9a4fe15c26a4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:26.331296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a0c94d6-68ee-45bd-bfe8-9a4fe15c26a4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:26.331988 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a0c94d6-68ee-45bd-bfe8-9a4fe15c26a4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:26.332470 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a0c94d6-68ee-45bd-bfe8-9a4fe15c26a4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:26.332885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a0c94d6-68ee-45bd-bfe8-9a4fe15c26a4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:26.481318 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8a0c94d6-68ee-45bd-bfe8-9a4fe15c26a4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:26.488961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8a0c94d6-68ee-45bd-bfe8-9a4fe15c26a4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1359 microversion: 2.1 time: 0.169642 Aug 06 13:07:26.489614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1880/3750] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:26 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:26.833523 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4ef630df-5ad8-4830-87d0-7ec6277a6c09 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:26.834121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4ef630df-5ad8-4830-87d0-7ec6277a6c09 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:26.840564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef630df-5ad8-4830-87d0-7ec6277a6c09 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:26.841377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef630df-5ad8-4830-87d0-7ec6277a6c09 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:26.841817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef630df-5ad8-4830-87d0-7ec6277a6c09 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:26.842654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef630df-5ad8-4830-87d0-7ec6277a6c09 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:26.843113 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef630df-5ad8-4830-87d0-7ec6277a6c09 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:26.843535 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4ef630df-5ad8-4830-87d0-7ec6277a6c09 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:26.907091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:26.907822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:26.913789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:26.914344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:26.914846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:26.915544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:26.915994 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:26.916526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:26.944419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4ef630df-5ad8-4830-87d0-7ec6277a6c09 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6844f315435f48f68488a2f0459bf155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931a52d9cda40b89d15804b69b5a2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:26.953463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4ef630df-5ad8-4830-87d0-7ec6277a6c09 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 200 len: 1603 microversion: 2.1 time: 0.123548 Aug 06 13:07:26.954548 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1871/3751] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:26 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 1603 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:27.061675 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-0344053e-5025-49bf-a2c2-e7a5f738267e req-31605917-a095-4726-89d3-97e7aa651f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6531998f-cbb2-4338-97f5-18cab3aa7ab2", "name": "network-vif-deleted", "tag": "ad800de6-b900-499b-94b5-ddc1af8f2ddc"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:27.071756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0344053e-5025-49bf-a2c2-e7a5f738267e req-31605917-a095-4726-89d3-97e7aa651f7b service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:27.072241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0344053e-5025-49bf-a2c2-e7a5f738267e req-31605917-a095-4726-89d3-97e7aa651f7b service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:27.072704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0344053e-5025-49bf-a2c2-e7a5f738267e req-31605917-a095-4726-89d3-97e7aa651f7b service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:27.074474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:27.085592 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:27.087462 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:27.087582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-0344053e-5025-49bf-a2c2-e7a5f738267e req-31605917-a095-4726-89d3-97e7aa651f7b service nova] Creating event network-vif-deleted:ad800de6-b900-499b-94b5-ddc1af8f2ddc for instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 on hv-cinder-85199 Aug 06 13:07:27.089101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d4a563d9-a8e1-406f-ae67-5bb5690e72f0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.185921 Aug 06 13:07:27.090011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1881/3752] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:26 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:27.101367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-0344053e-5025-49bf-a2c2-e7a5f738267e req-31605917-a095-4726-89d3-97e7aa651f7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045276 Aug 06 13:07:27.102293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1872/3753] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:07:27.510074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-56d80bf6-0ad3-432f-a020-3a190eaae83a tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:27.511232 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-56d80bf6-0ad3-432f-a020-3a190eaae83a tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:27.518117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56d80bf6-0ad3-432f-a020-3a190eaae83a tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:27.518841 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56d80bf6-0ad3-432f-a020-3a190eaae83a tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:27.519414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56d80bf6-0ad3-432f-a020-3a190eaae83a tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:27.520250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56d80bf6-0ad3-432f-a020-3a190eaae83a tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:27.521061 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56d80bf6-0ad3-432f-a020-3a190eaae83a tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:27.521630 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-56d80bf6-0ad3-432f-a020-3a190eaae83a tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:27.670574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-56d80bf6-0ad3-432f-a020-3a190eaae83a tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:27.672969 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:27.680621 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-56d80bf6-0ad3-432f-a020-3a190eaae83a tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1550 microversion: 2.1 time: 0.174467 Aug 06 13:07:27.681205 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1882/3754] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:27 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1550 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:07:27.701961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5797151c-8594-4fef-93d9-07b96094e30c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:27.702652 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5797151c-8594-4fef-93d9-07b96094e30c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:27.708972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5797151c-8594-4fef-93d9-07b96094e30c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:27.709454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5797151c-8594-4fef-93d9-07b96094e30c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:27.710049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5797151c-8594-4fef-93d9-07b96094e30c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:27.710745 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5797151c-8594-4fef-93d9-07b96094e30c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:27.711198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5797151c-8594-4fef-93d9-07b96094e30c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:27.711621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5797151c-8594-4fef-93d9-07b96094e30c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:27.950534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5797151c-8594-4fef-93d9-07b96094e30c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:27.972564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5797151c-8594-4fef-93d9-07b96094e30c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1550 microversion: 2.1 time: 0.275134 Aug 06 13:07:27.975107 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:27.976212 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:27.977619 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1873/3755] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:27 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1550 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:27.999511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:28.008337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:28.009477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:28.010051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:28.010557 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:28.011395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:28.012047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:28.012609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:28.018685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Searching by: {'deleted': False, 'project_id': 'f7477fc540f843b4936879b9425896f3'} {{(pid=117825) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 13:07:28.034689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:28.035491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:28.036097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:28.037019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:28.037645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:28.038241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:28.044003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] HTTP exception thrown: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Request method failure captured: Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 HTTP/1.1 Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l9ASzYOrdynOcpGTCHUzenVs2Knr4W1z2Gdl4MYHQYRxH48QognycuutJZefHKyFMrH1A5VhSfVvfk41m1JFBUe87XXTDhsWwkuG0elJnI4nx1dKx-wba2s0i-eNMevh5LnfELNDYfU14m4qD9g-EVWEAsvgmtRCYHLM1rHTcooiGg Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 4931a52d9cda40b89d15804b69b5a2d7 Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:07:28.047008 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 4931a52d9cda40b89d15804b69b5a2d7 Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeTestJSON-1856976912-project Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 6844f315435f48f68488a2f0459bf155 Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeTestJSON-1856976912-project Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:28.048115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '6531998f-cbb2-4338-97f5-18cab3aa7ab2'} Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:07:28.048741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:28.050179 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:07:28.051041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Returning 404 to user: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:07:28.051041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-78d00805-6827-4523-ae96-6af36134edb5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 404 len: 111 microversion: 2.1 time: 0.078248 Aug 06 13:07:28.058927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1883/3756] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:27 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:07:28.078019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c619262-c5ad-4f64-86df-3afbb68d73d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '.version_select at 0x7f541a7d69d0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:28.123496 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c619262-c5ad-4f64-86df-3afbb68d73d5 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92887787" status: 202 len: 0 microversion: 2.1 time: 0.062166 Aug 06 13:07:28.132736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1884/3757] 10.222.0.20 () {58 vars in 1215 bytes} [Sat Aug 6 13:07:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92887787 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:07:28.137997 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:28.138611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:28.147409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:28.147909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:28.148371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:28.149089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:28.149542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:28.149978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:28.224104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.multi_cell_list [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117825) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 13:07:28.367313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-95877e2f-cba2-4a88-8443-cacc5fe26121 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.372098 Aug 06 13:07:28.368025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1874/3758] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Aug 6 13:07:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:07:28.379078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8d7ab642-0973-4021-bd20-fc168e72ef3e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:28.379674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8d7ab642-0973-4021-bd20-fc168e72ef3e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:28.391500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d7ab642-0973-4021-bd20-fc168e72ef3e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:28.392435 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d7ab642-0973-4021-bd20-fc168e72ef3e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:28.393190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d7ab642-0973-4021-bd20-fc168e72ef3e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:28.396673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d7ab642-0973-4021-bd20-fc168e72ef3e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:28.398295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d7ab642-0973-4021-bd20-fc168e72ef3e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:28.399165 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d7ab642-0973-4021-bd20-fc168e72ef3e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:28.474744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:28.488892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:28.491777 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:28.493381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aceadd28-2bd4-4548-8381-325092ea3a87 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.359257 Aug 06 13:07:28.494311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1885/3759] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:28 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:28.685618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8d7ab642-0973-4021-bd20-fc168e72ef3e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:28.696803 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8d7ab642-0973-4021-bd20-fc168e72ef3e tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1550 microversion: 2.1 time: 0.320922 Aug 06 13:07:28.700734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1875/3760] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:28 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1550 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:29.140068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-5dd3657b-6426-4d8b-9b8f-54f44ca512b0 req-d4193374-b20c-49d5-be31-5ef077d03bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7af22f0-39a7-4b2b-9c17-4a6db1207b5d", "tag": "6448a0de-425a-4afd-b83e-ff03fbdc86a1"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:29.158532 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-5dd3657b-6426-4d8b-9b8f-54f44ca512b0 req-d4193374-b20c-49d5-be31-5ef077d03bc0 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:29.159006 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-5dd3657b-6426-4d8b-9b8f-54f44ca512b0 req-d4193374-b20c-49d5-be31-5ef077d03bc0 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:29.159460 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-5dd3657b-6426-4d8b-9b8f-54f44ca512b0 req-d4193374-b20c-49d5-be31-5ef077d03bc0 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:29.203427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-5dd3657b-6426-4d8b-9b8f-54f44ca512b0 req-d4193374-b20c-49d5-be31-5ef077d03bc0 service nova] Creating event network-changed:6448a0de-425a-4afd-b83e-ff03fbdc86a1 for instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d on hv-cinder-85199 Aug 06 13:07:29.215339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-5dd3657b-6426-4d8b-9b8f-54f44ca512b0 req-d4193374-b20c-49d5-be31-5ef077d03bc0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080308 Aug 06 13:07:29.216648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1886/3761] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:07:29.516920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:29.517757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:29.524766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:29.525373 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:29.525901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:29.526707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:29.527267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:29.528784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:29.682843 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:29.697916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:29.697916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:29.697916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d312b09-d21b-4384-a81c-14f6df4ce3b1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.183006 Aug 06 13:07:29.709894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1876/3762] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:29 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:30.487982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9456872c-1d36-47a5-bf91-a879c531d139 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1814f95-5a11-4934-aad2-53091f549b38"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:30.490654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9456872c-1d36-47a5-bf91-a879c531d139 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:30.497714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9456872c-1d36-47a5-bf91-a879c531d139 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:30.498374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9456872c-1d36-47a5-bf91-a879c531d139 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:30.499000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9456872c-1d36-47a5-bf91-a879c531d139 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:30.499865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9456872c-1d36-47a5-bf91-a879c531d139 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:30.500505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9456872c-1d36-47a5-bf91-a879c531d139 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:30.501100 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9456872c-1d36-47a5-bf91-a879c531d139 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:30.732715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:30.735183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:30.743155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:30.743912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:30.744542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:30.745377 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:30.745969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:30.746571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:30.893918 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:30.905414 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:30.907355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:30.908549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-57b92a94-4272-475e-bbad-91ad939d7510 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.184875 Aug 06 13:07:30.909463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1877/3763] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:30 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:31.793452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:31.794655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:31.801651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:31.802143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:31.802578 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:31.803273 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:31.803723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:31.804145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:31.818593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] HTTP exception thrown: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Request method failure captured: Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 HTTP/1.1 Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l9ASzYOrdynOcpGTCHUzenVs2Knr4W1z2Gdl4MYHQYRxH48QognycuutJZefHKyFMrH1A5VhSfVvfk41m1JFBUe87XXTDhsWwkuG0elJnI4nx1dKx-wba2s0i-eNMevh5LnfELNDYfU14m4qD9g-EVWEAsvgmtRCYHLM1rHTcooiGg Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 4931a52d9cda40b89d15804b69b5a2d7 Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:07:31.820586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 4931a52d9cda40b89d15804b69b5a2d7 Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeTestJSON-1856976912-project Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 6844f315435f48f68488a2f0459bf155 Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeTestJSON-1856976912-project Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:31.821869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '6531998f-cbb2-4338-97f5-18cab3aa7ab2'} Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:07:31.822582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:31.823637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:31.825677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Returning 404 to user: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:07:31.825677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0d6bbf2f-5174-42e1-8da3-078f60b66ad9 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 404 len: 111 microversion: 2.1 time: 0.033323 Aug 06 13:07:31.825677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1878/3764] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:07:31 2022] DELETE /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:07:31.831511 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:31.832114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: 6531998f-cbb2-4338-97f5-18cab3aa7ab2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:31.838073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:31.838552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:31.838985 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:31.839683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:31.840183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:31.840713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:31.855393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] HTTP exception thrown: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Request method failure captured: Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 HTTP/1.1 Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l9ASzYOrdynOcpGTCHUzenVs2Knr4W1z2Gdl4MYHQYRxH48QognycuutJZefHKyFMrH1A5VhSfVvfk41m1JFBUe87XXTDhsWwkuG0elJnI4nx1dKx-wba2s0i-eNMevh5LnfELNDYfU14m4qD9g-EVWEAsvgmtRCYHLM1rHTcooiGg Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 4931a52d9cda40b89d15804b69b5a2d7 Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:07:31.857098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 4931a52d9cda40b89d15804b69b5a2d7 Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeTestJSON-1856976912-project Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 6844f315435f48f68488a2f0459bf155 Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeTestJSON-1856976912-project Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:31.858147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '6531998f-cbb2-4338-97f5-18cab3aa7ab2'} Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:07:31.858755 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. Aug 06 13:07:31.859931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:31.860929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Returning 404 to user: Instance 6531998f-cbb2-4338-97f5-18cab3aa7ab2 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:07:31.860929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a5716195-ec12-4075-8ebb-894d20c0f97d tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2" status: 404 len: 111 microversion: 2.1 time: 0.030578 Aug 06 13:07:31.861452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1879/3765] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:31 2022] GET /compute/v2.1/servers/6531998f-cbb2-4338-97f5-18cab3aa7ab2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 13:07:31.931395 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:31.932103 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:31.939322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:31.939969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:31.940817 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:31.942082 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:31.942679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:31.943141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:32.125372 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:32.133748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:32.135238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:32.136424 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5acbf65-d674-4747-8f14-57948271cf7d tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.209314 Aug 06 13:07:32.137628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1880/3766] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:31 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:33.039447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:33.040114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:33.046225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:33.046906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:33.047489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:33.048348 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:33.049190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:33.049939 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:33.063972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] HTTP exception thrown: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Request method failure captured: Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c HTTP/1.1 Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l9ASzYOrdynOcpGTCHUzenVs2Knr4W1z2Gdl4MYHQYRxH48QognycuutJZefHKyFMrH1A5VhSfVvfk41m1JFBUe87XXTDhsWwkuG0elJnI4nx1dKx-wba2s0i-eNMevh5LnfELNDYfU14m4qD9g-EVWEAsvgmtRCYHLM1rHTcooiGg Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 4931a52d9cda40b89d15804b69b5a2d7 Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:07:33.065571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 4931a52d9cda40b89d15804b69b5a2d7 Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeTestJSON-1856976912-project Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 6844f315435f48f68488a2f0459bf155 Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeTestJSON-1856976912-project Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. Aug 06 13:07:33.066919 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'efe4447d-8246-4c34-8a89-98d7c5ac616c'} Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:07:33.067668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. Aug 06 13:07:33.069017 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:33.070233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Returning 404 to user: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:07:33.070233 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b38629e3-e068-4cb0-9169-8cfac8dfd93a tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 404 len: 111 microversion: 2.1 time: 0.031743 Aug 06 13:07:33.070623 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1881/3767] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:07:33 2022] DELETE /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 13:07:33.076904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:33.077533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] [instance: efe4447d-8246-4c34-8a89-98d7c5ac616c] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:33.083782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:33.084262 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:33.084727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:33.085415 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:33.085878 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:33.086284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:33.101329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] HTTP exception thrown: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Request method failure captured: Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c HTTP/1.1 Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l9ASzYOrdynOcpGTCHUzenVs2Knr4W1z2Gdl4MYHQYRxH48QognycuutJZefHKyFMrH1A5VhSfVvfk41m1JFBUe87XXTDhsWwkuG0elJnI4nx1dKx-wba2s0i-eNMevh5LnfELNDYfU14m4qD9g-EVWEAsvgmtRCYHLM1rHTcooiGg Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 4931a52d9cda40b89d15804b69b5a2d7 Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:07:33.102956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4931a52d9cda40b89d15804b69b5a2d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 4931a52d9cda40b89d15804b69b5a2d7 Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1856976912 Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeTestJSON-1856976912-project Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 6844f315435f48f68488a2f0459bf155 Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeTestJSON-1856976912-project Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. Aug 06 13:07:33.104245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'efe4447d-8246-4c34-8a89-98d7c5ac616c'} Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:07:33.104956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. Aug 06 13:07:33.106283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:07:33.107297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] Returning 404 to user: Instance efe4447d-8246-4c34-8a89-98d7c5ac616c could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:07:33.107297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3f81857-e344-4e55-8a6a-db974623e544 tempest-AttachVolumeTestJSON-1856976912 tempest-AttachVolumeTestJSON-1856976912-project] 10.222.0.20 "GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c" status: 404 len: 111 microversion: 2.1 time: 0.032584 Aug 06 13:07:33.107297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1882/3768] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:33 2022] GET /compute/v2.1/servers/efe4447d-8246-4c34-8a89-98d7c5ac616c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:07:33.160214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:33.160864 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:33.167861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:33.168604 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:33.169204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:33.170069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:33.170673 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:33.171382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:33.422423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:33.431570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:33.433295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:33.435191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-96b68525-6772-49a1-a827-97072db4b2b5 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.278809 Aug 06 13:07:33.435744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1883/3769] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:33 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:34.461331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:34.463019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:34.472073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:34.473036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:34.473712 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:34.474898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:34.475567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:34.476477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:34.737912 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:34.763324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:34.771495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:34.772938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3206ca66-68e7-49b5-8aa7-dc0c917278d4 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.316271 Aug 06 13:07:34.784546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1884/3770] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:34 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:35.809586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:35.810239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:35.829071 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:35.831665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:35.832510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:35.834534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:35.836289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:35.840593 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:36.130146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:36.139729 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:36.141260 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:36.142950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-20896eed-f751-49ad-8f5f-a275f83a2164 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.340931 Aug 06 13:07:36.149865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1885/3771] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:35 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:37.175187 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:37.176129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:37.182693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:37.188717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:37.189240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:37.190131 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:37.190491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:37.190920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:37.406337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:37.416067 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:37.418829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:37.420198 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dbfc17a4-c61c-4c13-b929-670ff338580c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.257102 Aug 06 13:07:37.429112 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1886/3772] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:37 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:38.442831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:38.443471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:38.445421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:38.451411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:38.451798 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:38.452231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:38.452943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:38.453397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:38.453821 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:38.587316 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:38.595738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:38.597280 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:38.598423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c8d948bb-196a-4b68-bb15-e0bf0c7a674b tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.159395 Aug 06 13:07:38.598973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1887/3773] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:38 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:39.622019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:39.622651 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:39.629007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:39.629482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:39.629910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:39.630579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:39.631023 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:39.631438 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:39.760478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:39.768813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:39.770312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:39.771465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-af3aa36d-7b90-407c-9e00-1e9e463d0132 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.153337 Aug 06 13:07:39.772025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1888/3774] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:39 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:40.496595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:40.609248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=17 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:40.795104 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:40.795709 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:40.802157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:40.802637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:40.803064 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:40.803747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:40.804191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:40.804647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:40.939883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:40.943302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:40.948528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:40.950043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:40.951215 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1c765a1e-cde0-4a19-8d5e-70223fe05ed1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.160439 Aug 06 13:07:40.951780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1889/3775] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:40 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:41.976206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:41.976849 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:41.983499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:41.983978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:41.984437 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:41.985123 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:41.985585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:41.985995 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:42.128079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:42.135940 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:42.137966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:42.139105 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8b7799a9-9206-4840-86ba-4499ac859ea7 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.167143 Aug 06 13:07:42.139648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1890/3776] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:41 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:43.162446 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:43.163048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:43.169891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:43.170363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:43.170793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:43.171471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:43.171917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:43.172357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:43.325172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:43.332871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:43.334342 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:43.335475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-82235139-f2db-4c3f-94ce-5fa649985f32 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.176866 Aug 06 13:07:43.336027 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1891/3777] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:43 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:44.359205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:44.359796 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:44.366097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:44.366571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:44.366998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:44.367664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:44.368111 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:44.368554 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:44.493942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:44.502688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:44.504176 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:44.505353 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1cc74be0-37d8-442c-aeaa-dc43f9f28c09 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.150543 Aug 06 13:07:44.505901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1892/3778] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:44 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:45.527532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:45.528156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:45.534704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:45.535174 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:45.535598 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:45.536268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:45.536739 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:45.537154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:45.663485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:45.672108 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:45.673682 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:45.674956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e6c38fb2-c654-4562-bbf9-f9ff8bf9fbf0 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.151247 Aug 06 13:07:45.675558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1893/3779] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:45 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:46.697613 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:46.698286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:46.705433 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:46.705904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:46.706331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:46.707005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:46.707447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:46.707867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:46.842694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:46.850966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:46.852471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:46.853625 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27c76c41-eae4-4b87-9c0b-9f516a84685e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.159935 Aug 06 13:07:46.854173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1894/3780] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:46 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:47.877896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:47.878507 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:47.885012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:47.885538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:47.885978 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:47.886669 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:47.887125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:47.888134 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:48.018031 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:48.026147 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:48.027637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:48.028830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dcfc9845-28cb-415e-818a-1fe8f2f81491 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.154783 Aug 06 13:07:48.029388 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1895/3781] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:47 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:49.050715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:49.051302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:49.057858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:49.058337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:49.058770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:49.059942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:49.060416 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:49.060839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:49.399794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9456872c-1d36-47a5-bf91-a879c531d139 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "POST /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 18.915849 Aug 06 13:07:49.406691 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1887/3782] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 13:07:30 2022] POST /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments => generated 194 bytes in 18924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:07:49.454013 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:49.468515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:49.470693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:49.472246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ef546885-fb7e-4ae0-9588-98971944716e tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.425330 Aug 06 13:07:49.489632 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1896/3783] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:49 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:07:50.497711 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:50.498399 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:50.505374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:50.505852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:50.506283 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:50.506960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:50.507405 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:50.507906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:50.658274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:50.666182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:50.667668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:50.668929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b8112e2e-2f56-4c66-bb4c-f90457260a53 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.175835 Aug 06 13:07:50.669551 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1888/3784] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:50 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:51.692903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:51.693581 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:51.700403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:51.700889 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:51.701321 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:51.702079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:51.702529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:51.702946 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:51.843100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:51.851468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:51.853159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:51.854304 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-519d8074-02b8-4cb0-a331-1153eb551ab8 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.165177 Aug 06 13:07:51.854853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1897/3785] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:51 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:52.982681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:52.983392 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:52.990993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:52.991929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:52.992770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:52.993828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:52.994466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:52.995081 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:53.130918 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:53.138675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:53.140653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:53.142072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f61dc8c6-7b96-41b8-8ec7-193f13885978 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.268351 Aug 06 13:07:53.142634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1889/3786] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:52 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:53.376704 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-53e470b7-6b81-496c-9d0e-ec7432c3b941 req-12ab46ed-5517-4ec3-8dbb-c1233881f259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9511bf2-6616-4fd6-9739-6c901a1da341", "name": "network-vif-plugged", "status": "completed", "tag": "5653f9b3-1473-445f-9406-188160ed27ac"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:53.387200 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-53e470b7-6b81-496c-9d0e-ec7432c3b941 req-12ab46ed-5517-4ec3-8dbb-c1233881f259 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:53.387683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-53e470b7-6b81-496c-9d0e-ec7432c3b941 req-12ab46ed-5517-4ec3-8dbb-c1233881f259 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:53.388110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-53e470b7-6b81-496c-9d0e-ec7432c3b941 req-12ab46ed-5517-4ec3-8dbb-c1233881f259 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:53.399193 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-53e470b7-6b81-496c-9d0e-ec7432c3b941 req-12ab46ed-5517-4ec3-8dbb-c1233881f259 service nova] Creating event network-vif-plugged:5653f9b3-1473-445f-9406-188160ed27ac for instance e9511bf2-6616-4fd6-9739-6c901a1da341 on hv-cinder-85199 Aug 06 13:07:53.404383 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-53e470b7-6b81-496c-9d0e-ec7432c3b941 req-12ab46ed-5517-4ec3-8dbb-c1233881f259 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031909 Aug 06 13:07:53.405055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1898/3787] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:07:54.163871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:54.164407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:54.170694 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:54.171172 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:54.171601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:54.172271 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:54.172741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:54.173157 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:54.523377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:54.531587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:54.533131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:54.534293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-72c5d813-1021-4c0e-aa37-68b72ff379d9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.374335 Aug 06 13:07:54.535163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1890/3788] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:54 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:55.557541 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:55.558314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:55.560334 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=64 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:07:55.565781 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:55.566261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:55.566692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:55.567376 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:55.567825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:55.568246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:55.708001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:55.716707 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:55.719022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:55.720271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2c87f1c3-acd2-40f5-b9f2-2311bdec8cde tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1727 microversion: 2.20 time: 0.167404 Aug 06 13:07:55.720926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1899/3789] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:55 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:56.743052 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:56.743662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:56.749986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:56.750463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:56.750892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:56.751571 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:56.752021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:56.752476 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:56.884986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:56.893927 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:56.895959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:56.897377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5fd1165c-acad-4fc6-a34b-6ebb76d281d1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1714 microversion: 2.20 time: 0.158225 Aug 06 13:07:56.897904 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1891/3790] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:07:56 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:07:58.059660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e5612a5b-256a-44c7-97b2-6986d54e12d5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:07:58.060259 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e5612a5b-256a-44c7-97b2-6986d54e12d5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:07:58.066618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5612a5b-256a-44c7-97b2-6986d54e12d5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:58.067084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5612a5b-256a-44c7-97b2-6986d54e12d5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:58.067509 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5612a5b-256a-44c7-97b2-6986d54e12d5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:58.068178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5612a5b-256a-44c7-97b2-6986d54e12d5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:58.068658 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5612a5b-256a-44c7-97b2-6986d54e12d5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:58.069073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5612a5b-256a-44c7-97b2-6986d54e12d5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:58.194078 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e5612a5b-256a-44c7-97b2-6986d54e12d5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:07:58.202944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e5612a5b-256a-44c7-97b2-6986d54e12d5 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1596 microversion: 2.1 time: 0.147025 Aug 06 13:07:58.203536 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1900/3791] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:07:58 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1596 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:07:59.916847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-628dd242-874f-4c77-ab65-0f0fe675d9c5 req-f41338b3-8c6e-441e-96bb-ffb0357e74c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9d58a0-ba13-4c19-b4c5-d4cc70058e18", "tag": "9de4834e-e401-4b5c-a66f-d304dddac190"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:07:59.926755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-628dd242-874f-4c77-ab65-0f0fe675d9c5 req-f41338b3-8c6e-441e-96bb-ffb0357e74c4 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:07:59.927247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-628dd242-874f-4c77-ab65-0f0fe675d9c5 req-f41338b3-8c6e-441e-96bb-ffb0357e74c4 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:07:59.927665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-628dd242-874f-4c77-ab65-0f0fe675d9c5 req-f41338b3-8c6e-441e-96bb-ffb0357e74c4 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:07:59.939547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-628dd242-874f-4c77-ab65-0f0fe675d9c5 req-f41338b3-8c6e-441e-96bb-ffb0357e74c4 service nova] Creating event network-changed:9de4834e-e401-4b5c-a66f-d304dddac190 for instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 on hv-cinder-85199 Aug 06 13:07:59.944596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-628dd242-874f-4c77-ab65-0f0fe675d9c5 req-f41338b3-8c6e-441e-96bb-ffb0357e74c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034098 Aug 06 13:07:59.945211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1892/3792] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:08:01.146471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-14bdc200-4a61-4d5c-9773-b1c86c08d2e4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-772329303"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:08:01.147053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-14bdc200-4a61-4d5c-9773-b1c86c08d2e4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:08:01.153998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14bdc200-4a61-4d5c-9773-b1c86c08d2e4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:08:01.155150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14bdc200-4a61-4d5c-9773-b1c86c08d2e4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:08:01.155617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14bdc200-4a61-4d5c-9773-b1c86c08d2e4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:08:01.156525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14bdc200-4a61-4d5c-9773-b1c86c08d2e4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:08:01.157151 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14bdc200-4a61-4d5c-9773-b1c86c08d2e4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:08:01.157750 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14bdc200-4a61-4d5c-9773-b1c86c08d2e4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:08:01.285577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.network.security_group_api [None req-14bdc200-4a61-4d5c-9773-b1c86c08d2e4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Adding security group a1df2a1a-3197-4afd-9a67-c5e541cd3a12 to port 9de4834e-e401-4b5c-a66f-d304dddac190 Aug 06 13:08:01.593592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-14bdc200-4a61-4d5c-9773-b1c86c08d2e4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "POST /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/action" status: 202 len: 0 microversion: 2.1 time: 0.451128 Aug 06 13:08:01.594227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1901/3793] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 13:08:01 2022] POST /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:08:01.602571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-82dbe064-67fc-4810-a628-1f80a78fa151 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:08:01.603182 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-82dbe064-67fc-4810-a628-1f80a78fa151 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:08:01.603311 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-0de559e9-15b4-46c7-9390-a24d9b19e38b req-76ec638e-d023-4e5d-a47f-e5aa627efa8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9d58a0-ba13-4c19-b4c5-d4cc70058e18", "tag": "9de4834e-e401-4b5c-a66f-d304dddac190"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:08:01.610502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82dbe064-67fc-4810-a628-1f80a78fa151 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:08:01.611047 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82dbe064-67fc-4810-a628-1f80a78fa151 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:08:01.611490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82dbe064-67fc-4810-a628-1f80a78fa151 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:08:01.612195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82dbe064-67fc-4810-a628-1f80a78fa151 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:08:01.612724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82dbe064-67fc-4810-a628-1f80a78fa151 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:08:01.613185 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82dbe064-67fc-4810-a628-1f80a78fa151 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:08:01.614168 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-0de559e9-15b4-46c7-9390-a24d9b19e38b req-76ec638e-d023-4e5d-a47f-e5aa627efa8c service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:08:01.614913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-0de559e9-15b4-46c7-9390-a24d9b19e38b req-76ec638e-d023-4e5d-a47f-e5aa627efa8c service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:08:01.615339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-0de559e9-15b4-46c7-9390-a24d9b19e38b req-76ec638e-d023-4e5d-a47f-e5aa627efa8c service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:08:01.632045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-0de559e9-15b4-46c7-9390-a24d9b19e38b req-76ec638e-d023-4e5d-a47f-e5aa627efa8c service nova] Creating event network-changed:9de4834e-e401-4b5c-a66f-d304dddac190 for instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 on hv-cinder-85199 Aug 06 13:08:01.639142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-0de559e9-15b4-46c7-9390-a24d9b19e38b req-76ec638e-d023-4e5d-a47f-e5aa627efa8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040232 Aug 06 13:08:01.640096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1893/3794] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:08:01.879345 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-82dbe064-67fc-4810-a628-1f80a78fa151 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:08:01.893129 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-82dbe064-67fc-4810-a628-1f80a78fa151 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1761 microversion: 2.1 time: 0.294824 Aug 06 13:08:01.894394 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1902/3795] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:08:01 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1761 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:09:13.051018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=12 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:09:13.051757 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:09:13.283418 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cb215801-6b83-4a55-8fe5-f2c41ce6f4e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:13.284000 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cb215801-6b83-4a55-8fe5-f2c41ce6f4e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:13.290055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb215801-6b83-4a55-8fe5-f2c41ce6f4e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:13.290527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb215801-6b83-4a55-8fe5-f2c41ce6f4e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:13.290956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb215801-6b83-4a55-8fe5-f2c41ce6f4e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:13.291639 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb215801-6b83-4a55-8fe5-f2c41ce6f4e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:13.292085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb215801-6b83-4a55-8fe5-f2c41ce6f4e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:13.292536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb215801-6b83-4a55-8fe5-f2c41ce6f4e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:13.316401 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cb215801-6b83-4a55-8fe5-f2c41ce6f4e3 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/ips" status: 200 len: 148 microversion: 2.1 time: 0.267476 Aug 06 13:09:13.316938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1894/3796] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Aug 6 13:09:13 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/ips => generated 148 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:09:13.354221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=7 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:09:13.354976 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=72 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:09:13.359460 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9146408-59e1-4bb7-bde3-6b83d373d09f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:13.362208 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9146408-59e1-4bb7-bde3-6b83d373d09f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:13.368944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9146408-59e1-4bb7-bde3-6b83d373d09f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:13.369428 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9146408-59e1-4bb7-bde3-6b83d373d09f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:13.369871 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9146408-59e1-4bb7-bde3-6b83d373d09f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:13.370565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9146408-59e1-4bb7-bde3-6b83d373d09f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:13.371020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9146408-59e1-4bb7-bde3-6b83d373d09f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:13.371445 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9146408-59e1-4bb7-bde3-6b83d373d09f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:13.407691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9146408-59e1-4bb7-bde3-6b83d373d09f tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052324 Aug 06 13:09:13.407691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1903/3797] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Aug 6 13:09:13 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:13.468468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-29c81984-565d-4d69-88f5-478e4a4502f9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:13.468966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-29c81984-565d-4d69-88f5-478e4a4502f9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:13.475582 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29c81984-565d-4d69-88f5-478e4a4502f9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:13.476071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29c81984-565d-4d69-88f5-478e4a4502f9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:13.476607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29c81984-565d-4d69-88f5-478e4a4502f9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:13.477427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29c81984-565d-4d69-88f5-478e4a4502f9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:13.478058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29c81984-565d-4d69-88f5-478e4a4502f9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:13.478664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29c81984-565d-4d69-88f5-478e4a4502f9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:13.506580 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-29c81984-565d-4d69-88f5-478e4a4502f9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 13:09:13.604126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-29c81984-565d-4d69-88f5-478e4a4502f9 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 204 len: 0 microversion: 2.20 time: 0.139097 Aug 06 13:09:13.605468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1895/3798] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Aug 6 13:09:13 2022] DELETE /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 13:09:13.614533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:13.615158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:13.621225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:13.621702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:13.622140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:13.622804 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:13.623450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:13.623800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:13.753225 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:13.761301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:13.762807 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:13.763944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a716e75b-82cb-4528-9936-876a3b207fb1 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.154012 Aug 06 13:09:13.764532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1904/3799] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:09:13 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:09:14.654530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2690712c-28aa-4311-8374-24380969b6c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e60bab4-6c0f-4cd3-836d-f7fd92aee402"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:09:14.656971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2690712c-28aa-4311-8374-24380969b6c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:14.663280 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2690712c-28aa-4311-8374-24380969b6c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:14.663743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2690712c-28aa-4311-8374-24380969b6c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:14.664165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2690712c-28aa-4311-8374-24380969b6c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:14.664858 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2690712c-28aa-4311-8374-24380969b6c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:14.665299 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2690712c-28aa-4311-8374-24380969b6c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:14.665712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2690712c-28aa-4311-8374-24380969b6c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:14.790039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:14.790674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:14.797116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:14.798096 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:14.798529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:14.799213 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:14.799667 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:14.800092 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:15.058455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2690712c-28aa-4311-8374-24380969b6c6 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "POST /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407987 Aug 06 13:09:15.059079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1896/3800] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Aug 6 13:09:14 2022] POST /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:09:15.218293 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:15.226887 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:15.228408 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:15.229564 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a342aba5-d022-40a6-8385-98d58603b0c6 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1720 microversion: 2.20 time: 0.443371 Aug 06 13:09:15.230130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1905/3801] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:09:14 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1720 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 13:09:16.254620 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:16.255313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:16.261542 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:16.262075 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:16.262511 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:16.263196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:16.263649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:16.264074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:16.329537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:16.337567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:16.339101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '257ddc018c33406aa47e7e7129943ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ce267dd4f15447fae8aef5e99cbb018', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:16.340249 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9b462e6d-9ad1-4426-8593-0b3fe273cd37 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 200 len: 1653 microversion: 2.20 time: 0.090983 Aug 06 13:09:16.340820 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1897/3802] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:09:16 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 1653 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 13:09:16.480653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-999e249a-7186-4d47-b020-05a12710abad req-ea0bbf69-7d7b-4fd1-a867-835e62c4d4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9511bf2-6616-4fd6-9739-6c901a1da341", "name": "network-vif-deleted", "tag": "5653f9b3-1473-445f-9406-188160ed27ac"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:09:16.491868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-999e249a-7186-4d47-b020-05a12710abad req-ea0bbf69-7d7b-4fd1-a867-835e62c4d4eb service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:16.492488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-999e249a-7186-4d47-b020-05a12710abad req-ea0bbf69-7d7b-4fd1-a867-835e62c4d4eb service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:16.492917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-999e249a-7186-4d47-b020-05a12710abad req-ea0bbf69-7d7b-4fd1-a867-835e62c4d4eb service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:16.507245 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-999e249a-7186-4d47-b020-05a12710abad req-ea0bbf69-7d7b-4fd1-a867-835e62c4d4eb service nova] Creating event network-vif-deleted:5653f9b3-1473-445f-9406-188160ed27ac for instance e9511bf2-6616-4fd6-9739-6c901a1da341 on hv-cinder-85199 Aug 06 13:09:16.512952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-999e249a-7186-4d47-b020-05a12710abad req-ea0bbf69-7d7b-4fd1-a867-835e62c4d4eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036373 Aug 06 13:09:16.513549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1906/3803] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:09:17.128368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-669557d2-72d7-4b9f-b94a-ca3a86d406b4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:09:17.130706 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-669557d2-72d7-4b9f-b94a-ca3a86d406b4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:17.137979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-669557d2-72d7-4b9f-b94a-ca3a86d406b4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:17.138468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-669557d2-72d7-4b9f-b94a-ca3a86d406b4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:17.138907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-669557d2-72d7-4b9f-b94a-ca3a86d406b4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:17.139610 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-669557d2-72d7-4b9f-b94a-ca3a86d406b4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:17.140058 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-669557d2-72d7-4b9f-b94a-ca3a86d406b4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:17.140512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-669557d2-72d7-4b9f-b94a-ca3a86d406b4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:17.215355 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-669557d2-72d7-4b9f-b94a-ca3a86d406b4 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "POST /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/action" status: 202 len: 0 microversion: 2.1 time: 0.090684 Aug 06 13:09:17.219976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1898/3804] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 13:09:17 2022] POST /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:09:17.226081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c51b2d40-7b82-418d-998b-9f6d0f605f71 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:17.226766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c51b2d40-7b82-418d-998b-9f6d0f605f71 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:17.233397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b2d40-7b82-418d-998b-9f6d0f605f71 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:17.234140 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b2d40-7b82-418d-998b-9f6d0f605f71 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:17.234766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b2d40-7b82-418d-998b-9f6d0f605f71 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:17.235453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b2d40-7b82-418d-998b-9f6d0f605f71 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:17.235902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b2d40-7b82-418d-998b-9f6d0f605f71 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:17.236337 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51b2d40-7b82-418d-998b-9f6d0f605f71 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:17.366409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:17.367829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:17.374398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:17.374874 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:17.375839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:17.376614 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:17.377274 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:17.377697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:17.392264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] HTTP exception thrown: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Request method failure captured: Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 HTTP/1.1 Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7YRLHrps4E9HQpM4Tl4jo0aDiqF3UVg2SnZeZ2OP8c7akuDqlwNohPVjjRFrygVdt5d9qC9tXJQXtBF692RQxnpnGiaQ8UHc3wf9AY3vCk-4kIo2nyR62FgZMs22dzPa79yt7YiAhpTC5c-EUylWyFcKVy7Khj47bI95FSgYZdYus Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9ce267dd4f15447fae8aef5e99cbb018 Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:09:17.393958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9ce267dd4f15447fae8aef5e99cbb018 Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeShelveTestJSON-1430867352-project Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 257ddc018c33406aa47e7e7129943ae3 Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430867352-project Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:17.395250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'e9511bf2-6616-4fd6-9739-6c901a1da341'} Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:17.395990 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:17.397586 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:17.398778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Returning 404 to user: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:17.398778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f131e75f-aa77-4d75-9904-310440ea626c tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 404 len: 111 microversion: 2.20 time: 0.033498 Aug 06 13:09:17.398778 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1899/3805] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:09:17 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 13:09:17.404123 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c8db261d-47ab-4db7-99b0-8ca1d5952b12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '.version_select at 0x7f541a824dc0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:17.426543 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c8db261d-47ab-4db7-99b0-8ca1d5952b12 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-326204628" status: 204 len: 0 microversion: 2.20 time: 0.026008 Aug 06 13:09:17.427738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1900/3806] 10.222.0.20 () {60 vars in 1259 bytes} [Sat Aug 6 13:09:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-326204628 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 06 13:09:17.498489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c51b2d40-7b82-418d-998b-9f6d0f605f71 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:17.507727 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c51b2d40-7b82-418d-998b-9f6d0f605f71 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1753 microversion: 2.1 time: 0.285959 Aug 06 13:09:17.508436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1907/3807] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:17 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1753 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:18.533834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d9b286ad-5883-4776-a3bd-8402da5c676c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:18.534722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d9b286ad-5883-4776-a3bd-8402da5c676c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:18.541608 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9b286ad-5883-4776-a3bd-8402da5c676c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:18.542085 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9b286ad-5883-4776-a3bd-8402da5c676c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:18.542520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9b286ad-5883-4776-a3bd-8402da5c676c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:18.543196 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9b286ad-5883-4776-a3bd-8402da5c676c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:18.543648 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9b286ad-5883-4776-a3bd-8402da5c676c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:18.544080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9b286ad-5883-4776-a3bd-8402da5c676c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:18.682497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d9b286ad-5883-4776-a3bd-8402da5c676c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:18.690562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d9b286ad-5883-4776-a3bd-8402da5c676c tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.162814 Aug 06 13:09:18.691121 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1901/3808] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:18 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:09:19.194891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:19.195366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:19.201735 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:19.202206 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:19.202633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:19.203972 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:19.204449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:19.204865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:19.218255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] HTTP exception thrown: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Request method failure captured: Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 HTTP/1.1 Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7YRLHrps4E9HQpM4Tl4jo0aDiqF3UVg2SnZeZ2OP8c7akuDqlwNohPVjjRFrygVdt5d9qC9tXJQXtBF692RQxnpnGiaQ8UHc3wf9AY3vCk-4kIo2nyR62FgZMs22dzPa79yt7YiAhpTC5c-EUylWyFcKVy7Khj47bI95FSgYZdYus Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9ce267dd4f15447fae8aef5e99cbb018 Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:09:19.219931 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9ce267dd4f15447fae8aef5e99cbb018 Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeShelveTestJSON-1430867352-project Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 257ddc018c33406aa47e7e7129943ae3 Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430867352-project Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:19.221320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'e9511bf2-6616-4fd6-9739-6c901a1da341'} Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:19.225238 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:19.226738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:19.227779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Returning 404 to user: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:19.227779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cbd04560-a0b6-478d-bcc4-26d1c2ba3317 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 404 len: 111 microversion: 2.20 time: 0.030253 Aug 06 13:09:19.227779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1908/3809] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Aug 6 13:09:19 2022] DELETE /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 13:09:19.230374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:19.231293 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: e9511bf2-6616-4fd6-9739-6c901a1da341] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:19.239475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:19.239957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:19.240422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:19.241116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:19.241568 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:19.241992 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:19.255883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] HTTP exception thrown: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Request method failure captured: Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 HTTP/1.1 Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7YRLHrps4E9HQpM4Tl4jo0aDiqF3UVg2SnZeZ2OP8c7akuDqlwNohPVjjRFrygVdt5d9qC9tXJQXtBF692RQxnpnGiaQ8UHc3wf9AY3vCk-4kIo2nyR62FgZMs22dzPa79yt7YiAhpTC5c-EUylWyFcKVy7Khj47bI95FSgYZdYus Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9ce267dd4f15447fae8aef5e99cbb018 Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:09:19.257500 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9ce267dd4f15447fae8aef5e99cbb018 Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeShelveTestJSON-1430867352-project Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 257ddc018c33406aa47e7e7129943ae3 Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430867352-project Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:19.258859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'e9511bf2-6616-4fd6-9739-6c901a1da341'} Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:19.259503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. Aug 06 13:09:19.260902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:19.261993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Returning 404 to user: Instance e9511bf2-6616-4fd6-9739-6c901a1da341 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:19.261993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c6a0e7a5-71e4-4f42-a6b7-288050e1b334 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341" status: 404 len: 111 microversion: 2.20 time: 0.032565 Aug 06 13:09:19.261993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1902/3810] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:09:19 2022] GET /compute/v2.1/servers/e9511bf2-6616-4fd6-9739-6c901a1da341 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 13:09:19.712448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a1cf77dc-a876-411e-8af1-c795473d6507 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:19.713053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a1cf77dc-a876-411e-8af1-c795473d6507 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:19.719384 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1cf77dc-a876-411e-8af1-c795473d6507 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:19.719862 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1cf77dc-a876-411e-8af1-c795473d6507 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:19.720294 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1cf77dc-a876-411e-8af1-c795473d6507 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:19.720988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1cf77dc-a876-411e-8af1-c795473d6507 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:19.721442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1cf77dc-a876-411e-8af1-c795473d6507 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:19.721860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1cf77dc-a876-411e-8af1-c795473d6507 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:19.863901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a1cf77dc-a876-411e-8af1-c795473d6507 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:19.871848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a1cf77dc-a876-411e-8af1-c795473d6507 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.163262 Aug 06 13:09:19.872430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1909/3811] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:19 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:20.393701 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:20.394248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:20.400642 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:20.401248 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:20.405756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:20.405756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:20.405756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:20.405756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:20.416762 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] HTTP exception thrown: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Request method failure captured: Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f HTTP/1.1 Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7YRLHrps4E9HQpM4Tl4jo0aDiqF3UVg2SnZeZ2OP8c7akuDqlwNohPVjjRFrygVdt5d9qC9tXJQXtBF692RQxnpnGiaQ8UHc3wf9AY3vCk-4kIo2nyR62FgZMs22dzPa79yt7YiAhpTC5c-EUylWyFcKVy7Khj47bI95FSgYZdYus Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9ce267dd4f15447fae8aef5e99cbb018 Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:09:20.418292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9ce267dd4f15447fae8aef5e99cbb018 Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeShelveTestJSON-1430867352-project Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 257ddc018c33406aa47e7e7129943ae3 Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430867352-project Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. Aug 06 13:09:20.419755 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'dc407ff3-fc1e-44bf-9c20-73203361a20f'} Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:20.420556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. Aug 06 13:09:20.421861 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:20.423270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Returning 404 to user: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:20.423270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ee0e419a-9cd2-4843-89ed-3f66ff724cfc tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 404 len: 111 microversion: 2.20 time: 0.030427 Aug 06 13:09:20.423270 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1903/3812] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Aug 6 13:09:20 2022] DELETE /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 13:09:20.427794 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:20.428486 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] [instance: dc407ff3-fc1e-44bf-9c20-73203361a20f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:20.434756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:20.435264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:20.435691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:20.436387 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:20.436831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:20.437244 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:20.450594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] HTTP exception thrown: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Request method failure captured: Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f HTTP/1.1 Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7YRLHrps4E9HQpM4Tl4jo0aDiqF3UVg2SnZeZ2OP8c7akuDqlwNohPVjjRFrygVdt5d9qC9tXJQXtBF692RQxnpnGiaQ8UHc3wf9AY3vCk-4kIo2nyR62FgZMs22dzPa79yt7YiAhpTC5c-EUylWyFcKVy7Khj47bI95FSgYZdYus Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9ce267dd4f15447fae8aef5e99cbb018 Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:09:20.452073 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ce267dd4f15447fae8aef5e99cbb018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9ce267dd4f15447fae8aef5e99cbb018 Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430867352 Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeShelveTestJSON-1430867352-project Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 257ddc018c33406aa47e7e7129943ae3 Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430867352-project Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. Aug 06 13:09:20.454116 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'dc407ff3-fc1e-44bf-9c20-73203361a20f'} Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:20.458065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. Aug 06 13:09:20.459774 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:20.460967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] Returning 404 to user: Instance dc407ff3-fc1e-44bf-9c20-73203361a20f could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:20.460967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-af0582bb-c035-460d-bdc1-2f8064133760 tempest-AttachVolumeShelveTestJSON-1430867352 tempest-AttachVolumeShelveTestJSON-1430867352-project] 10.222.0.20 "GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f" status: 404 len: 111 microversion: 2.20 time: 0.029372 Aug 06 13:09:20.460967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1910/3813] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Aug 6 13:09:20 2022] GET /compute/v2.1/servers/dc407ff3-fc1e-44bf-9c20-73203361a20f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 13:09:20.893059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-26f7a27e-0ea8-4731-82a5-4bb917d25df6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:20.893659 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-26f7a27e-0ea8-4731-82a5-4bb917d25df6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:20.899478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26f7a27e-0ea8-4731-82a5-4bb917d25df6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:20.899949 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26f7a27e-0ea8-4731-82a5-4bb917d25df6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:20.900403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26f7a27e-0ea8-4731-82a5-4bb917d25df6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:20.901102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26f7a27e-0ea8-4731-82a5-4bb917d25df6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:20.901548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26f7a27e-0ea8-4731-82a5-4bb917d25df6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:20.901960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-26f7a27e-0ea8-4731-82a5-4bb917d25df6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:21.379111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-26f7a27e-0ea8-4731-82a5-4bb917d25df6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:21.387040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-26f7a27e-0ea8-4731-82a5-4bb917d25df6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.497894 Aug 06 13:09:21.387627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1904/3814] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:20 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:22.410032 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3aacfe4f-116f-4698-8149-a3fba6464b51 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:22.412231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3aacfe4f-116f-4698-8149-a3fba6464b51 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:22.419761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aacfe4f-116f-4698-8149-a3fba6464b51 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:22.421264 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aacfe4f-116f-4698-8149-a3fba6464b51 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:22.421975 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aacfe4f-116f-4698-8149-a3fba6464b51 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:22.423473 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aacfe4f-116f-4698-8149-a3fba6464b51 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:22.424036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aacfe4f-116f-4698-8149-a3fba6464b51 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:22.424577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3aacfe4f-116f-4698-8149-a3fba6464b51 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:22.632087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3aacfe4f-116f-4698-8149-a3fba6464b51 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:22.640115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3aacfe4f-116f-4698-8149-a3fba6464b51 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.235283 Aug 06 13:09:22.643757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1911/3815] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:22 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:22.736054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0f58d382-91ea-4a2d-ad3c-0c909e8e3adc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:22.736712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0f58d382-91ea-4a2d-ad3c-0c909e8e3adc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:22.743116 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f58d382-91ea-4a2d-ad3c-0c909e8e3adc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:22.743589 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f58d382-91ea-4a2d-ad3c-0c909e8e3adc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:22.744012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f58d382-91ea-4a2d-ad3c-0c909e8e3adc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:22.744715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f58d382-91ea-4a2d-ad3c-0c909e8e3adc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:22.745159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f58d382-91ea-4a2d-ad3c-0c909e8e3adc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:22.745575 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f58d382-91ea-4a2d-ad3c-0c909e8e3adc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:22.835358 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-0f58d382-91ea-4a2d-ad3c-0c909e8e3adc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lazy-loading 'services' on Instance uuid a7af22f0-39a7-4b2b-9c17-4a6db1207b5d {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 13:09:22.918340 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0f58d382-91ea-4a2d-ad3c-0c909e8e3adc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/os-volume_attachments/5e60bab4-6c0f-4cd3-836d-f7fd92aee402" status: 202 len: 0 microversion: 2.1 time: 0.185902 Aug 06 13:09:22.919830 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1905/3816] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 13:09:22 2022] DELETE /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/os-volume_attachments/5e60bab4-6c0f-4cd3-836d-f7fd92aee402 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:09:22.928344 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e88a8861-b8a1-467a-82b1-8e3d4fbadb82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:22.930865 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e88a8861-b8a1-467a-82b1-8e3d4fbadb82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:22.942790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e88a8861-b8a1-467a-82b1-8e3d4fbadb82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:22.943292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e88a8861-b8a1-467a-82b1-8e3d4fbadb82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:22.943738 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e88a8861-b8a1-467a-82b1-8e3d4fbadb82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:22.944477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e88a8861-b8a1-467a-82b1-8e3d4fbadb82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:22.944965 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e88a8861-b8a1-467a-82b1-8e3d4fbadb82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:22.945392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e88a8861-b8a1-467a-82b1-8e3d4fbadb82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:22.977232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e88a8861-b8a1-467a-82b1-8e3d4fbadb82 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053370 Aug 06 13:09:22.977833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1912/3817] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:09:22 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:09:23.672842 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9b937e6c-7b1d-479b-bb1a-0f60e993ca0b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:23.673550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9b937e6c-7b1d-479b-bb1a-0f60e993ca0b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:23.682644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b937e6c-7b1d-479b-bb1a-0f60e993ca0b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:23.683136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b937e6c-7b1d-479b-bb1a-0f60e993ca0b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:23.683737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b937e6c-7b1d-479b-bb1a-0f60e993ca0b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:23.684495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b937e6c-7b1d-479b-bb1a-0f60e993ca0b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:23.684951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b937e6c-7b1d-479b-bb1a-0f60e993ca0b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:23.685878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9b937e6c-7b1d-479b-bb1a-0f60e993ca0b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:23.865901 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9b937e6c-7b1d-479b-bb1a-0f60e993ca0b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:23.874722 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9b937e6c-7b1d-479b-bb1a-0f60e993ca0b tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.215018 Aug 06 13:09:23.889707 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1906/3818] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:23 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:23.991765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-09cefb14-b539-47e9-88d3-8a96b2a9058a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:24.004117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-09cefb14-b539-47e9-88d3-8a96b2a9058a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:24.020351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09cefb14-b539-47e9-88d3-8a96b2a9058a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:24.021097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09cefb14-b539-47e9-88d3-8a96b2a9058a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:24.021691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09cefb14-b539-47e9-88d3-8a96b2a9058a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:24.022551 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09cefb14-b539-47e9-88d3-8a96b2a9058a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:24.023160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09cefb14-b539-47e9-88d3-8a96b2a9058a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:24.023855 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09cefb14-b539-47e9-88d3-8a96b2a9058a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:24.065688 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-09cefb14-b539-47e9-88d3-8a96b2a9058a tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079533 Aug 06 13:09:24.066752 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1913/3819] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:09:23 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 13:09:24.135079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7b758433-52aa-46c8-afa8-49c2b7b01b1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:24.135646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7b758433-52aa-46c8-afa8-49c2b7b01b1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:24.142624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b758433-52aa-46c8-afa8-49c2b7b01b1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:24.143115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b758433-52aa-46c8-afa8-49c2b7b01b1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:24.143552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b758433-52aa-46c8-afa8-49c2b7b01b1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:24.144252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b758433-52aa-46c8-afa8-49c2b7b01b1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:24.144804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b758433-52aa-46c8-afa8-49c2b7b01b1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:24.145227 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b758433-52aa-46c8-afa8-49c2b7b01b1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:24.170618 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7b758433-52aa-46c8-afa8-49c2b7b01b1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 13:09:24.216603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:09:24.248912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7b758433-52aa-46c8-afa8-49c2b7b01b1f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 204 len: 0 microversion: 2.1 time: 0.118046 Aug 06 13:09:24.250450 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1907/3820] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:09:24 2022] DELETE /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:09:24.258617 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f8897908-daee-46ea-bd31-11397b351006 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:24.259229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f8897908-daee-46ea-bd31-11397b351006 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:24.265177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8897908-daee-46ea-bd31-11397b351006 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:24.266231 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8897908-daee-46ea-bd31-11397b351006 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:24.266674 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8897908-daee-46ea-bd31-11397b351006 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:24.267364 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8897908-daee-46ea-bd31-11397b351006 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:24.267820 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8897908-daee-46ea-bd31-11397b351006 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:24.268249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f8897908-daee-46ea-bd31-11397b351006 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:24.406967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f8897908-daee-46ea-bd31-11397b351006 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:24.415084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f8897908-daee-46ea-bd31-11397b351006 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1679 microversion: 2.1 time: 0.160477 Aug 06 13:09:24.415733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1914/3821] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:24 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:24.896847 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4ae4b15b-a88b-443a-a390-40713a8993e6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:24.897601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4ae4b15b-a88b-443a-a390-40713a8993e6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:24.903797 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ae4b15b-a88b-443a-a390-40713a8993e6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:24.904287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ae4b15b-a88b-443a-a390-40713a8993e6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:24.904728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ae4b15b-a88b-443a-a390-40713a8993e6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:24.905410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ae4b15b-a88b-443a-a390-40713a8993e6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:24.905854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ae4b15b-a88b-443a-a390-40713a8993e6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:24.906766 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ae4b15b-a88b-443a-a390-40713a8993e6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:25.058477 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4ae4b15b-a88b-443a-a390-40713a8993e6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:25.066724 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4ae4b15b-a88b-443a-a390-40713a8993e6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.174220 Aug 06 13:09:25.067290 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1908/3822] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:24 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:25.438343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9e6be9de-5d16-4837-896d-c0dfc9df1307 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:25.438956 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9e6be9de-5d16-4837-896d-c0dfc9df1307 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:25.445806 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6be9de-5d16-4837-896d-c0dfc9df1307 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:25.446287 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6be9de-5d16-4837-896d-c0dfc9df1307 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:25.446705 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6be9de-5d16-4837-896d-c0dfc9df1307 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:25.447400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6be9de-5d16-4837-896d-c0dfc9df1307 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:25.447858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6be9de-5d16-4837-896d-c0dfc9df1307 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:25.448282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6be9de-5d16-4837-896d-c0dfc9df1307 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:25.591969 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9e6be9de-5d16-4837-896d-c0dfc9df1307 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:25.600248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9e6be9de-5d16-4837-896d-c0dfc9df1307 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1679 microversion: 2.1 time: 0.165981 Aug 06 13:09:25.600859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1915/3823] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:25 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:26.086868 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b52bd15f-bcf8-4dbf-93ca-c606a9b0cc64 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:26.087466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b52bd15f-bcf8-4dbf-93ca-c606a9b0cc64 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:26.093834 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b52bd15f-bcf8-4dbf-93ca-c606a9b0cc64 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:26.094303 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b52bd15f-bcf8-4dbf-93ca-c606a9b0cc64 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:26.094735 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b52bd15f-bcf8-4dbf-93ca-c606a9b0cc64 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:26.095409 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b52bd15f-bcf8-4dbf-93ca-c606a9b0cc64 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:26.095855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b52bd15f-bcf8-4dbf-93ca-c606a9b0cc64 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:26.096273 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b52bd15f-bcf8-4dbf-93ca-c606a9b0cc64 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:26.239490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b52bd15f-bcf8-4dbf-93ca-c606a9b0cc64 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:26.247483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b52bd15f-bcf8-4dbf-93ca-c606a9b0cc64 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.164429 Aug 06 13:09:26.248051 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1909/3824] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:26 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:26.629227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-be5eb5a3-7c9f-42ff-84c7-27d5e1f0596b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:26.629227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-be5eb5a3-7c9f-42ff-84c7-27d5e1f0596b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:26.629227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5eb5a3-7c9f-42ff-84c7-27d5e1f0596b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:26.629227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5eb5a3-7c9f-42ff-84c7-27d5e1f0596b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:26.629848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5eb5a3-7c9f-42ff-84c7-27d5e1f0596b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:26.629928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5eb5a3-7c9f-42ff-84c7-27d5e1f0596b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:26.630398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5eb5a3-7c9f-42ff-84c7-27d5e1f0596b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:26.630822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be5eb5a3-7c9f-42ff-84c7-27d5e1f0596b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:26.836989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-be5eb5a3-7c9f-42ff-84c7-27d5e1f0596b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1125a0b93c9d45ccb2d3f28f188dfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6de534dbd541828ac211fae35b0ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:26.846683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-be5eb5a3-7c9f-42ff-84c7-27d5e1f0596b tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 200 len: 1679 microversion: 2.1 time: 0.228660 Aug 06 13:09:26.847559 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1916/3825] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:26 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:27.117828 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-a0501eed-0768-4026-bda9-fe6f7a32132f req-1bdcc7c0-f720-47ef-9e6b-ef843a6debc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7af22f0-39a7-4b2b-9c17-4a6db1207b5d", "name": "network-vif-deleted", "tag": "6448a0de-425a-4afd-b83e-ff03fbdc86a1"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:09:27.125939 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-a0501eed-0768-4026-bda9-fe6f7a32132f req-1bdcc7c0-f720-47ef-9e6b-ef843a6debc8 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:27.126292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-a0501eed-0768-4026-bda9-fe6f7a32132f req-1bdcc7c0-f720-47ef-9e6b-ef843a6debc8 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:27.126715 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-a0501eed-0768-4026-bda9-fe6f7a32132f req-1bdcc7c0-f720-47ef-9e6b-ef843a6debc8 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:27.138649 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-a0501eed-0768-4026-bda9-fe6f7a32132f req-1bdcc7c0-f720-47ef-9e6b-ef843a6debc8 service nova] Creating event network-vif-deleted:6448a0de-425a-4afd-b83e-ff03fbdc86a1 for instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d on hv-cinder-85199 Aug 06 13:09:27.144892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-a0501eed-0768-4026-bda9-fe6f7a32132f req-1bdcc7c0-f720-47ef-9e6b-ef843a6debc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035778 Aug 06 13:09:27.149226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1910/3826] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:09:27.270039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-69eb2af3-acba-4345-ad38-2d0cfea467bb tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:27.270950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-69eb2af3-acba-4345-ad38-2d0cfea467bb tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:27.277760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69eb2af3-acba-4345-ad38-2d0cfea467bb tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:27.278987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69eb2af3-acba-4345-ad38-2d0cfea467bb tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:27.279687 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69eb2af3-acba-4345-ad38-2d0cfea467bb tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:27.280601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69eb2af3-acba-4345-ad38-2d0cfea467bb tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:27.281291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69eb2af3-acba-4345-ad38-2d0cfea467bb tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:27.281902 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69eb2af3-acba-4345-ad38-2d0cfea467bb tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:27.431409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-69eb2af3-acba-4345-ad38-2d0cfea467bb tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:27.439757 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-69eb2af3-acba-4345-ad38-2d0cfea467bb tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.174320 Aug 06 13:09:27.440336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1917/3827] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:27 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:27.869111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:27.869824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:27.876237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:27.876758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:27.877197 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:27.877894 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:27.878350 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:27.878776 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:27.892773 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d HTTP/1.1 Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:09:27.894432 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:27.895806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'a7af22f0-39a7-4b2b-9c17-4a6db1207b5d'} Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:27.896591 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:27.897636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:27.898552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:27.898552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-91cfd991-0212-458c-b23d-5fd5e4b43422 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 404 len: 111 microversion: 2.1 time: 0.031139 Aug 06 13:09:27.898552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1911/3828] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:27 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:09:27.904833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c2ec99f2-75a9-459a-8a0f-0cf839a279dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '.version_select at 0x7f541aad1550>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:27.925886 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c2ec99f2-75a9-459a-8a0f-0cf839a279dc tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1565401626" status: 202 len: 0 microversion: 2.1 time: 0.024787 Aug 06 13:09:27.926506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1918/3829] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Aug 6 13:09:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1565401626 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:09:28.462089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3ac98fde-f237-48db-b892-a739992434b3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:28.464930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3ac98fde-f237-48db-b892-a739992434b3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:28.477233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ac98fde-f237-48db-b892-a739992434b3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:28.482371 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ac98fde-f237-48db-b892-a739992434b3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:28.483018 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ac98fde-f237-48db-b892-a739992434b3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:28.483840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ac98fde-f237-48db-b892-a739992434b3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:28.485003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ac98fde-f237-48db-b892-a739992434b3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:28.485789 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ac98fde-f237-48db-b892-a739992434b3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:28.685710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3ac98fde-f237-48db-b892-a739992434b3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:28.694439 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3ac98fde-f237-48db-b892-a739992434b3 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.236668 Aug 06 13:09:28.694984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1912/3830] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:28 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:09:29.718784 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-05ff3e54-c6b9-40ab-ae3b-47506bf91fb8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:29.719566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-05ff3e54-c6b9-40ab-ae3b-47506bf91fb8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:29.729083 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:29.729657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:29.730476 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05ff3e54-c6b9-40ab-ae3b-47506bf91fb8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:29.731033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05ff3e54-c6b9-40ab-ae3b-47506bf91fb8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:29.731725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05ff3e54-c6b9-40ab-ae3b-47506bf91fb8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:29.732834 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05ff3e54-c6b9-40ab-ae3b-47506bf91fb8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:29.733562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05ff3e54-c6b9-40ab-ae3b-47506bf91fb8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:29.733562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05ff3e54-c6b9-40ab-ae3b-47506bf91fb8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:29.737262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:29.737827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:29.739643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:29.739643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:29.739643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:29.742600 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:29.763367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d HTTP/1.1 Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:09:29.765818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:29.767013 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'a7af22f0-39a7-4b2b-9c17-4a6db1207b5d'} Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:29.767646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:29.768801 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:29.773079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:29.774095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-35b42113-3479-41a3-8c3e-079bcbab3834 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 404 len: 111 microversion: 2.1 time: 0.049179 Aug 06 13:09:29.775026 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1913/3831] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:09:29 2022] DELETE /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 13:09:29.783286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:29.784102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: a7af22f0-39a7-4b2b-9c17-4a6db1207b5d] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:29.791587 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:29.792241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:29.793011 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:29.793857 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:29.794473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:29.795047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:29.821881 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d HTTP/1.1 Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:09:29.823780 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:29.825156 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'a7af22f0-39a7-4b2b-9c17-4a6db1207b5d'} Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:29.825925 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. Aug 06 13:09:29.827180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:29.830047 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance a7af22f0-39a7-4b2b-9c17-4a6db1207b5d could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:29.830902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2bb335e6-7802-4adc-a059-2dd03970445f tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d" status: 404 len: 111 microversion: 2.1 time: 0.052036 Aug 06 13:09:29.831444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1914/3832] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:29 2022] GET /compute/v2.1/servers/a7af22f0-39a7-4b2b-9c17-4a6db1207b5d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:09:29.897284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05ff3e54-c6b9-40ab-ae3b-47506bf91fb8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:29.906119 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-05ff3e54-c6b9-40ab-ae3b-47506bf91fb8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.193594 Aug 06 13:09:29.920101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1919/3833] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:29 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:30.926808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bc289a1c-7ce2-4b02-bad0-511ae3c737df tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:30.927413 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bc289a1c-7ce2-4b02-bad0-511ae3c737df tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:30.933908 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc289a1c-7ce2-4b02-bad0-511ae3c737df tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:30.934387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc289a1c-7ce2-4b02-bad0-511ae3c737df tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:30.934822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc289a1c-7ce2-4b02-bad0-511ae3c737df tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:30.935503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc289a1c-7ce2-4b02-bad0-511ae3c737df tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:30.935958 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc289a1c-7ce2-4b02-bad0-511ae3c737df tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:30.936414 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bc289a1c-7ce2-4b02-bad0-511ae3c737df tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:30.991992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:30.992510 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:30.999295 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:31.000286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:31.001125 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:31.001447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:31.001906 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:31.002333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:31.016485 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 HTTP/1.1 Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:09:31.018038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:09:31.019482 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'b858f51c-0983-4ec0-85a2-d955c78aff33'} Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:31.021030 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:09:31.022079 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.023680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:31.023680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-28061722-72d9-4afc-94c4-c962a9c4aec7 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 404 len: 111 microversion: 2.1 time: 0.031299 Aug 06 13:09:31.023680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1920/3834] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:09:30 2022] DELETE /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 13:09:31.027700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:31.028324 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: b858f51c-0983-4ec0-85a2-d955c78aff33] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:31.034346 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:31.034828 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:31.035268 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:31.035959 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:31.036447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:31.036877 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:31.050076 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 HTTP/1.1 Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:09:31.051584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:09:31.052936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'b858f51c-0983-4ec0-85a2-d955c78aff33'} Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:31.053696 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. Aug 06 13:09:31.055001 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.056057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance b858f51c-0983-4ec0-85a2-d955c78aff33 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:31.056057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b1604848-f7a6-4a0e-97cb-07514c1314a1 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33" status: 404 len: 111 microversion: 2.1 time: 0.029047 Aug 06 13:09:31.056057 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1921/3835] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:31 2022] GET /compute/v2.1/servers/b858f51c-0983-4ec0-85a2-d955c78aff33 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:09:31.061255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:31.061737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:31.067957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:31.068467 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:31.068903 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:31.069585 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:31.070039 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:31.070461 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:31.084137 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bc289a1c-7ce2-4b02-bad0-511ae3c737df tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:31.084756 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 HTTP/1.1 Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:09:31.086399 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 13:09:31.087680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '0c96e9f1-196d-4e86-a163-58a64e30ae58'} Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:31.088463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 13:09:31.089701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.090947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:31.090947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27cbffd2-0ac9-4809-8f26-96b5f6816248 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 404 len: 111 microversion: 2.1 time: 0.030805 Aug 06 13:09:31.092378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bc289a1c-7ce2-4b02-bad0-511ae3c737df tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.169342 Aug 06 13:09:31.092561 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1922/3836] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:09:31 2022] DELETE /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 13:09:31.092930 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1915/3837] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:30 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:31.101649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:31.102276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: 0c96e9f1-196d-4e86-a163-58a64e30ae58] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:31.108088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:31.108589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:31.109019 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:31.109697 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:31.110145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:31.110574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:31.123462 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 HTTP/1.1 Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:09:31.125472 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 13:09:31.126926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '0c96e9f1-196d-4e86-a163-58a64e30ae58'} Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:31.127708 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. Aug 06 13:09:31.128981 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:31.130117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance 0c96e9f1-196d-4e86-a163-58a64e30ae58 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:31.130117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8a5d14be-a408-44ef-8de0-688f869c10ee tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58" status: 404 len: 111 microversion: 2.1 time: 0.029015 Aug 06 13:09:31.130117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1923/3838] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:31 2022] GET /compute/v2.1/servers/0c96e9f1-196d-4e86-a163-58a64e30ae58 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 13:09:32.113429 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-730a9a49-4c36-486b-af2f-1463d1f7b157 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:32.113944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-730a9a49-4c36-486b-af2f-1463d1f7b157 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:32.120428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-730a9a49-4c36-486b-af2f-1463d1f7b157 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:32.120913 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-730a9a49-4c36-486b-af2f-1463d1f7b157 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:32.121346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-730a9a49-4c36-486b-af2f-1463d1f7b157 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:32.122028 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-730a9a49-4c36-486b-af2f-1463d1f7b157 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:32.122503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-730a9a49-4c36-486b-af2f-1463d1f7b157 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:32.122906 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-730a9a49-4c36-486b-af2f-1463d1f7b157 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:32.264240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:32.264710 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-730a9a49-4c36-486b-af2f-1463d1f7b157 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:32.264818 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:32.271594 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:32.272069 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:32.272542 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:32.273090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-730a9a49-4c36-486b-af2f-1463d1f7b157 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.163550 Aug 06 13:09:32.273227 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:32.273637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1916/3839] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:32 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:32.273770 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:32.274160 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:32.289203 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 HTTP/1.1 Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:09:32.290725 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. Aug 06 13:09:32.292088 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'acfe37e0-b98f-49eb-aef9-6e6279dae867'} Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:32.292897 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. Aug 06 13:09:32.294325 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:09:32.295647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:32.295647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bdea7d7a-bc2e-4067-aeb6-ef4a05025429 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 404 len: 111 microversion: 2.1 time: 0.031699 Aug 06 13:09:32.295647 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1924/3840] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:09:32 2022] DELETE /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 13:09:32.300441 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:32.301035 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] [instance: acfe37e0-b98f-49eb-aef9-6e6279dae867] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:32.306764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:32.307230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:32.307654 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:32.308339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:32.308785 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:32.309198 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:32.321971 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] HTTP exception thrown: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Request method failure captured: Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 HTTP/1.1 Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7ZaKF4RBY-hFNyahsp2dragim69DKFP7RX9xDJzahHqq3FWawtMtWb3HGo6A0qbI_9vJ29Vnj2tB4v7yBHFy-XVOw33DtWmXncn4Vm-qDwyegySI5J5BFz77DP8KO6rAdAznDjb4XwL0I5Cp4fMWE3HJzwOWMywxjzoCP_qMFp5_4 Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:09:32.323451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6de534dbd541828ac211fae35b0ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 7a6de534dbd541828ac211fae35b0ce4 Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-23625941 Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 1125a0b93c9d45ccb2d3f28f188dfd04 Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-23625941-project Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. Aug 06 13:09:32.324859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'acfe37e0-b98f-49eb-aef9-6e6279dae867'} Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:09:32.325626 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. Aug 06 13:09:32.326891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:09:32.329556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] Returning 404 to user: Instance acfe37e0-b98f-49eb-aef9-6e6279dae867 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:09:32.329556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-52798fef-b15a-4ca5-ad79-31818f0c4417 tempest-AttachVolumeNegativeTest-23625941 tempest-AttachVolumeNegativeTest-23625941-project] 10.222.0.20 "GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867" status: 404 len: 111 microversion: 2.1 time: 0.028134 Aug 06 13:09:32.329556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1917/3841] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:32 2022] GET /compute/v2.1/servers/acfe37e0-b98f-49eb-aef9-6e6279dae867 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 13:09:33.295357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-31fe5526-5533-40f6-92ab-30fab77610d8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:33.295962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-31fe5526-5533-40f6-92ab-30fab77610d8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:33.302471 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31fe5526-5533-40f6-92ab-30fab77610d8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:33.303135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31fe5526-5533-40f6-92ab-30fab77610d8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:33.303565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31fe5526-5533-40f6-92ab-30fab77610d8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:33.304249 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31fe5526-5533-40f6-92ab-30fab77610d8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:33.304723 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31fe5526-5533-40f6-92ab-30fab77610d8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:33.305146 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31fe5526-5533-40f6-92ab-30fab77610d8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:33.810477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-31fe5526-5533-40f6-92ab-30fab77610d8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:33.814396 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:09:33.823491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-31fe5526-5533-40f6-92ab-30fab77610d8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1758 microversion: 2.1 time: 0.532655 Aug 06 13:09:33.824643 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1925/3842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:33 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1758 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:09:34.846458 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fbd1958a-e04b-41f1-873f-a827f0824fc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:09:34.847063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fbd1958a-e04b-41f1-873f-a827f0824fc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:09:34.854366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbd1958a-e04b-41f1-873f-a827f0824fc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:34.854854 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbd1958a-e04b-41f1-873f-a827f0824fc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:34.855332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbd1958a-e04b-41f1-873f-a827f0824fc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:34.856016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbd1958a-e04b-41f1-873f-a827f0824fc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:09:34.856556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbd1958a-e04b-41f1-873f-a827f0824fc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:09:34.857082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fbd1958a-e04b-41f1-873f-a827f0824fc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:09:35.006481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fbd1958a-e04b-41f1-873f-a827f0824fc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:09:35.014728 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fbd1958a-e04b-41f1-873f-a827f0824fc6 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1761 microversion: 2.1 time: 0.172843 Aug 06 13:09:35.015813 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1918/3843] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:09:34 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1761 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:23.574291 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:10:23.574812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:10:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:10:42.334365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:10:42.338403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1864183350", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "networks": [{"uuid": "b4a8c070-6227-49eb-8b66-3dd6d3241c21"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:10:42.390459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] validate_networks() for [('b4a8c070-6227-49eb-8b66-3dd6d3241c21', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 13:10:43.006204 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 13:10:43.006622 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 13:10:43.007089 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 13:10:43.007490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 13:10:43.007894 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 13:10:43.016966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:43.017436 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:43.017861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:43.018573 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:43.019020 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:43.019434 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:43.036629 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Getting quotas for project b8ba2e48caca474f860946df0c9d0baa. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 13:10:43.040525 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Getting quotas for user 4f71cfae23f74c96b1cf3329804f369e and project b8ba2e48caca474f860946df0c9d0baa. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 13:10:43.051163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 13:10:43.053397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 13:10:43.103269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e9db9a38-729a-4869-8f10-2746a381f0fd tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771048 Aug 06 13:10:43.103895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1926/3844] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 13:10:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 13:10:43.112562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:10:43.113431 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:10:43.117490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-700a69fa-ddce-4c9c-a4c6-27ac44ebd351 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:43.118178 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-700a69fa-ddce-4c9c-a4c6-27ac44ebd351 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:43.178344 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-700a69fa-ddce-4c9c-a4c6-27ac44ebd351 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:43.186144 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-700a69fa-ddce-4c9c-a4c6-27ac44ebd351 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1214 microversion: 2.1 time: 0.074768 Aug 06 13:10:43.192348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1919/3845] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:43 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:10:44.207884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f6ab2b7f-0a6d-4f88-8d9e-284d75d87956 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:44.208626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f6ab2b7f-0a6d-4f88-8d9e-284d75d87956 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:44.214825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6ab2b7f-0a6d-4f88-8d9e-284d75d87956 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:44.215311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6ab2b7f-0a6d-4f88-8d9e-284d75d87956 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:44.215726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6ab2b7f-0a6d-4f88-8d9e-284d75d87956 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:44.216469 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6ab2b7f-0a6d-4f88-8d9e-284d75d87956 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:44.217501 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6ab2b7f-0a6d-4f88-8d9e-284d75d87956 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:44.217926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6ab2b7f-0a6d-4f88-8d9e-284d75d87956 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:44.297836 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f6ab2b7f-0a6d-4f88-8d9e-284d75d87956 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:44.305844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f6ab2b7f-0a6d-4f88-8d9e-284d75d87956 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1274 microversion: 2.1 time: 0.102553 Aug 06 13:10:44.306431 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1927/3846] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:44 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:45.326695 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eeea2763-b693-4248-8e45-452f8bcd5252 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:45.327292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eeea2763-b693-4248-8e45-452f8bcd5252 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:45.333763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeea2763-b693-4248-8e45-452f8bcd5252 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:45.334241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeea2763-b693-4248-8e45-452f8bcd5252 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:45.334664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeea2763-b693-4248-8e45-452f8bcd5252 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:45.335339 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeea2763-b693-4248-8e45-452f8bcd5252 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:45.335788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeea2763-b693-4248-8e45-452f8bcd5252 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:45.336203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eeea2763-b693-4248-8e45-452f8bcd5252 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:45.465741 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eeea2763-b693-4248-8e45-452f8bcd5252 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:45.476189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-f393c339-badb-49f5-aa74-3e748b202a35 req-9e7ed35b-637b-4258-8045-280d807e491a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd73bb7-17ef-48d0-96e2-b28f825997af", "tag": "c1c1f94a-17db-4ad8-bf2e-7f9b9d8ec43e"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:10:45.482660 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eeea2763-b693-4248-8e45-452f8bcd5252 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1314 microversion: 2.1 time: 0.159178 Aug 06 13:10:45.487038 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f393c339-badb-49f5-aa74-3e748b202a35 req-9e7ed35b-637b-4258-8045-280d807e491a service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:45.487517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f393c339-badb-49f5-aa74-3e748b202a35 req-9e7ed35b-637b-4258-8045-280d807e491a service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:45.487943 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f393c339-badb-49f5-aa74-3e748b202a35 req-9e7ed35b-637b-4258-8045-280d807e491a service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:45.499091 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1920/3847] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:45 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:45.499302 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-f393c339-badb-49f5-aa74-3e748b202a35 req-9e7ed35b-637b-4258-8045-280d807e491a service nova] Creating event network-changed:c1c1f94a-17db-4ad8-bf2e-7f9b9d8ec43e for instance 9bd73bb7-17ef-48d0-96e2-b28f825997af on hv-cinder-85199 Aug 06 13:10:45.503881 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-f393c339-badb-49f5-aa74-3e748b202a35 req-9e7ed35b-637b-4258-8045-280d807e491a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032649 Aug 06 13:10:45.504489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1928/3848] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:10:46.503758 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-15964e68-7f40-41a6-a297-dc17a34adb9a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:46.504282 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-15964e68-7f40-41a6-a297-dc17a34adb9a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:46.510184 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15964e68-7f40-41a6-a297-dc17a34adb9a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:46.510653 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15964e68-7f40-41a6-a297-dc17a34adb9a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:46.511078 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15964e68-7f40-41a6-a297-dc17a34adb9a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:46.511746 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15964e68-7f40-41a6-a297-dc17a34adb9a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:46.512190 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15964e68-7f40-41a6-a297-dc17a34adb9a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:46.512640 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15964e68-7f40-41a6-a297-dc17a34adb9a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:46.650079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-15964e68-7f40-41a6-a297-dc17a34adb9a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:46.657935 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-15964e68-7f40-41a6-a297-dc17a34adb9a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1314 microversion: 2.1 time: 0.158333 Aug 06 13:10:46.658489 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1921/3849] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:46 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:47.680083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5defe328-606c-4d19-91c9-8dd590f742fe tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:47.680808 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5defe328-606c-4d19-91c9-8dd590f742fe tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:47.687546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5defe328-606c-4d19-91c9-8dd590f742fe tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:47.688024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5defe328-606c-4d19-91c9-8dd590f742fe tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:47.688508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5defe328-606c-4d19-91c9-8dd590f742fe tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:47.689190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5defe328-606c-4d19-91c9-8dd590f742fe tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:47.689644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5defe328-606c-4d19-91c9-8dd590f742fe tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:47.690075 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5defe328-606c-4d19-91c9-8dd590f742fe tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:47.821180 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5defe328-606c-4d19-91c9-8dd590f742fe tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:47.828595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5defe328-606c-4d19-91c9-8dd590f742fe tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1314 microversion: 2.1 time: 0.153186 Aug 06 13:10:47.829158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1929/3850] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:47 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:48.849170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1661aba-fdb4-4a96-b99e-4908fa85d0e7 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:48.849846 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b1661aba-fdb4-4a96-b99e-4908fa85d0e7 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:48.856245 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1661aba-fdb4-4a96-b99e-4908fa85d0e7 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:48.857363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1661aba-fdb4-4a96-b99e-4908fa85d0e7 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:48.857787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1661aba-fdb4-4a96-b99e-4908fa85d0e7 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:48.858463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1661aba-fdb4-4a96-b99e-4908fa85d0e7 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:48.858905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1661aba-fdb4-4a96-b99e-4908fa85d0e7 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:48.859323 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1661aba-fdb4-4a96-b99e-4908fa85d0e7 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:48.999415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1661aba-fdb4-4a96-b99e-4908fa85d0e7 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:49.006940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b1661aba-fdb4-4a96-b99e-4908fa85d0e7 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1314 microversion: 2.1 time: 0.161803 Aug 06 13:10:49.007506 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1922/3851] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:48 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:50.027029 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4caaedf6-1b2c-4e5a-8fb5-0a86249e8343 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:50.027640 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4caaedf6-1b2c-4e5a-8fb5-0a86249e8343 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:50.034100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4caaedf6-1b2c-4e5a-8fb5-0a86249e8343 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:50.034586 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4caaedf6-1b2c-4e5a-8fb5-0a86249e8343 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:50.035024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4caaedf6-1b2c-4e5a-8fb5-0a86249e8343 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:50.035715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4caaedf6-1b2c-4e5a-8fb5-0a86249e8343 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:50.036169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4caaedf6-1b2c-4e5a-8fb5-0a86249e8343 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:50.036633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4caaedf6-1b2c-4e5a-8fb5-0a86249e8343 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:50.260492 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4caaedf6-1b2c-4e5a-8fb5-0a86249e8343 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:50.267857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4caaedf6-1b2c-4e5a-8fb5-0a86249e8343 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1314 microversion: 2.1 time: 0.244732 Aug 06 13:10:50.268440 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1930/3852] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:50 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:51.291437 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0f04228b-9feb-4fe2-8c76-6d230639c283 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:51.292909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0f04228b-9feb-4fe2-8c76-6d230639c283 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:51.300415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f04228b-9feb-4fe2-8c76-6d230639c283 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:51.300976 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f04228b-9feb-4fe2-8c76-6d230639c283 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:51.301636 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f04228b-9feb-4fe2-8c76-6d230639c283 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:51.302570 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f04228b-9feb-4fe2-8c76-6d230639c283 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:51.303279 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f04228b-9feb-4fe2-8c76-6d230639c283 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:51.303934 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f04228b-9feb-4fe2-8c76-6d230639c283 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:51.447487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0f04228b-9feb-4fe2-8c76-6d230639c283 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:51.454827 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0f04228b-9feb-4fe2-8c76-6d230639c283 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1314 microversion: 2.1 time: 0.168534 Aug 06 13:10:51.455378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1923/3853] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:51 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:52.314526 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5afd299d-f674-4efd-b69c-04eaf48203ea tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-772329303"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:10:52.315156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5afd299d-f674-4efd-b69c-04eaf48203ea tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:52.321494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5afd299d-f674-4efd-b69c-04eaf48203ea tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:52.321970 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5afd299d-f674-4efd-b69c-04eaf48203ea tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:52.322400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5afd299d-f674-4efd-b69c-04eaf48203ea tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:52.323084 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5afd299d-f674-4efd-b69c-04eaf48203ea tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:52.323530 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5afd299d-f674-4efd-b69c-04eaf48203ea tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:52.323952 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5afd299d-f674-4efd-b69c-04eaf48203ea tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:52.446265 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.network.security_group_api [None req-5afd299d-f674-4efd-b69c-04eaf48203ea tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Removing security group a1df2a1a-3197-4afd-9a67-c5e541cd3a12 from port 9de4834e-e401-4b5c-a66f-d304dddac190 Aug 06 13:10:52.474981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a2e71611-70e3-4acd-b832-0c9a3429e26c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:52.475583 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a2e71611-70e3-4acd-b832-0c9a3429e26c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:52.481839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e71611-70e3-4acd-b832-0c9a3429e26c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:52.482319 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e71611-70e3-4acd-b832-0c9a3429e26c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:52.482747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e71611-70e3-4acd-b832-0c9a3429e26c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:52.483427 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e71611-70e3-4acd-b832-0c9a3429e26c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:52.483876 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e71611-70e3-4acd-b832-0c9a3429e26c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:52.484295 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2e71611-70e3-4acd-b832-0c9a3429e26c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:52.614419 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2e71611-70e3-4acd-b832-0c9a3429e26c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:52.621938 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a2e71611-70e3-4acd-b832-0c9a3429e26c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1314 microversion: 2.1 time: 0.150937 Aug 06 13:10:52.623007 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1924/3854] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:52 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:10:52.748973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5afd299d-f674-4efd-b69c-04eaf48203ea tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "POST /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/action" status: 202 len: 0 microversion: 2.1 time: 0.438182 Aug 06 13:10:52.749621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1931/3855] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 13:10:52 2022] POST /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:10:52.757851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-8912ae6e-54ac-4cdd-b310-5828f65cd799 req-11ff787c-bd9c-4903-b0c9-427877a6edb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9d58a0-ba13-4c19-b4c5-d4cc70058e18", "tag": "9de4834e-e401-4b5c-a66f-d304dddac190"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:10:52.767680 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-8912ae6e-54ac-4cdd-b310-5828f65cd799 req-11ff787c-bd9c-4903-b0c9-427877a6edb0 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:52.768161 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-8912ae6e-54ac-4cdd-b310-5828f65cd799 req-11ff787c-bd9c-4903-b0c9-427877a6edb0 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:52.768612 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-8912ae6e-54ac-4cdd-b310-5828f65cd799 req-11ff787c-bd9c-4903-b0c9-427877a6edb0 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:52.783384 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-8912ae6e-54ac-4cdd-b310-5828f65cd799 req-11ff787c-bd9c-4903-b0c9-427877a6edb0 service nova] Creating event network-changed:9de4834e-e401-4b5c-a66f-d304dddac190 for instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 on hv-cinder-85199 Aug 06 13:10:52.789345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-8912ae6e-54ac-4cdd-b310-5828f65cd799 req-11ff787c-bd9c-4903-b0c9-427877a6edb0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034872 Aug 06 13:10:52.790475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1925/3856] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:10:53.577054 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-6e31857d-35b1-4b4a-b7f1-e31743061a91 req-8bbe5680-4a29-4f66-aba1-c835616bd78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd73bb7-17ef-48d0-96e2-b28f825997af", "name": "network-vif-plugged", "status": "completed", "tag": "c1c1f94a-17db-4ad8-bf2e-7f9b9d8ec43e"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:10:53.603339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:10:53.604267 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:10:53.608239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6e31857d-35b1-4b4a-b7f1-e31743061a91 req-8bbe5680-4a29-4f66-aba1-c835616bd78d service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:53.608983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6e31857d-35b1-4b4a-b7f1-e31743061a91 req-8bbe5680-4a29-4f66-aba1-c835616bd78d service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:53.609603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6e31857d-35b1-4b4a-b7f1-e31743061a91 req-8bbe5680-4a29-4f66-aba1-c835616bd78d service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:53.622683 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-6e31857d-35b1-4b4a-b7f1-e31743061a91 req-8bbe5680-4a29-4f66-aba1-c835616bd78d service nova] Creating event network-vif-plugged:c1c1f94a-17db-4ad8-bf2e-7f9b9d8ec43e for instance 9bd73bb7-17ef-48d0-96e2-b28f825997af on hv-cinder-85199 Aug 06 13:10:53.628389 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-6e31857d-35b1-4b4a-b7f1-e31743061a91 req-8bbe5680-4a29-4f66-aba1-c835616bd78d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055300 Aug 06 13:10:53.629599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1932/3857] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:10:53.644672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ef2a5a63-b8a6-4658-a471-f04a02d8b16a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:53.645584 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ef2a5a63-b8a6-4658-a471-f04a02d8b16a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:53.647742 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:10:53.654673 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef2a5a63-b8a6-4658-a471-f04a02d8b16a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:53.655438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef2a5a63-b8a6-4658-a471-f04a02d8b16a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:53.655974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef2a5a63-b8a6-4658-a471-f04a02d8b16a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:53.656810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef2a5a63-b8a6-4658-a471-f04a02d8b16a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:53.657495 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef2a5a63-b8a6-4658-a471-f04a02d8b16a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:53.664745 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef2a5a63-b8a6-4658-a471-f04a02d8b16a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:53.895159 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ef2a5a63-b8a6-4658-a471-f04a02d8b16a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:53.905247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ef2a5a63-b8a6-4658-a471-f04a02d8b16a tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1314 microversion: 2.1 time: 0.265886 Aug 06 13:10:53.906146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1926/3858] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:53 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:54.009726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b3886fc0-f66b-4309-86a3-9f4bac04f640 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:54.010333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b3886fc0-f66b-4309-86a3-9f4bac04f640 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:54.026448 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3886fc0-f66b-4309-86a3-9f4bac04f640 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:54.027008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3886fc0-f66b-4309-86a3-9f4bac04f640 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:54.027397 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3886fc0-f66b-4309-86a3-9f4bac04f640 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:54.028115 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3886fc0-f66b-4309-86a3-9f4bac04f640 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:54.029175 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3886fc0-f66b-4309-86a3-9f4bac04f640 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:54.029610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3886fc0-f66b-4309-86a3-9f4bac04f640 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:54.139025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-b3886fc0-f66b-4309-86a3-9f4bac04f640 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lazy-loading 'services' on Instance uuid 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 13:10:54.243363 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b3886fc0-f66b-4309-86a3-9f4bac04f640 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments/a1814f95-5a11-4934-aad2-53091f549b38" status: 202 len: 0 microversion: 2.1 time: 0.239082 Aug 06 13:10:54.248405 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1933/3859] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 13:10:54 2022] DELETE /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments/a1814f95-5a11-4934-aad2-53091f549b38 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:10:54.255648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd353e22-ecfd-4c89-8ec7-d4ebc880cece tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:54.258162 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd353e22-ecfd-4c89-8ec7-d4ebc880cece tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:54.269329 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd353e22-ecfd-4c89-8ec7-d4ebc880cece tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:54.270009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd353e22-ecfd-4c89-8ec7-d4ebc880cece tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:54.271114 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd353e22-ecfd-4c89-8ec7-d4ebc880cece tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:54.272081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd353e22-ecfd-4c89-8ec7-d4ebc880cece tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:54.272884 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd353e22-ecfd-4c89-8ec7-d4ebc880cece tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:54.273503 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd353e22-ecfd-4c89-8ec7-d4ebc880cece tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:54.287961 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-d371d03e-a534-4dc4-b5e4-d19188255a1a req-12af2c02-b700-478c-a3e3-5b3708cad45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9d58a0-ba13-4c19-b4c5-d4cc70058e18", "tag": "9de4834e-e401-4b5c-a66f-d304dddac190"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:10:54.298579 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-d371d03e-a534-4dc4-b5e4-d19188255a1a req-12af2c02-b700-478c-a3e3-5b3708cad45a service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:54.299054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-d371d03e-a534-4dc4-b5e4-d19188255a1a req-12af2c02-b700-478c-a3e3-5b3708cad45a service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:54.299481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-d371d03e-a534-4dc4-b5e4-d19188255a1a req-12af2c02-b700-478c-a3e3-5b3708cad45a service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:54.314506 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd353e22-ecfd-4c89-8ec7-d4ebc880cece tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064305 Aug 06 13:10:54.321292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1934/3860] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:10:54 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:10:54.328940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-d371d03e-a534-4dc4-b5e4-d19188255a1a req-12af2c02-b700-478c-a3e3-5b3708cad45a service nova] Creating event network-changed:9de4834e-e401-4b5c-a66f-d304dddac190 for instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 on hv-cinder-85199 Aug 06 13:10:54.339281 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-d371d03e-a534-4dc4-b5e4-d19188255a1a req-12af2c02-b700-478c-a3e3-5b3708cad45a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324559 Aug 06 13:10:54.339892 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1927/3861] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:10:54.927301 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61939df3-20b2-4c92-9156-676447cc2bd8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:54.927955 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61939df3-20b2-4c92-9156-676447cc2bd8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:54.936500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61939df3-20b2-4c92-9156-676447cc2bd8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:54.937197 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61939df3-20b2-4c92-9156-676447cc2bd8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:54.937814 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61939df3-20b2-4c92-9156-676447cc2bd8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:54.938684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61939df3-20b2-4c92-9156-676447cc2bd8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:54.939136 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61939df3-20b2-4c92-9156-676447cc2bd8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:54.939916 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61939df3-20b2-4c92-9156-676447cc2bd8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:55.132768 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61939df3-20b2-4c92-9156-676447cc2bd8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:55.142722 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61939df3-20b2-4c92-9156-676447cc2bd8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1314 microversion: 2.1 time: 0.219988 Aug 06 13:10:55.143883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1935/3862] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:54 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:55.328517 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-be3d0223-7090-4008-b7eb-60471a0ddfee tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:55.330737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-be3d0223-7090-4008-b7eb-60471a0ddfee tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:55.337497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be3d0223-7090-4008-b7eb-60471a0ddfee tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:55.337981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be3d0223-7090-4008-b7eb-60471a0ddfee tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:55.338573 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be3d0223-7090-4008-b7eb-60471a0ddfee tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:55.339415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be3d0223-7090-4008-b7eb-60471a0ddfee tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:55.340064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be3d0223-7090-4008-b7eb-60471a0ddfee tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:55.340672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-be3d0223-7090-4008-b7eb-60471a0ddfee tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:55.373398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-be3d0223-7090-4008-b7eb-60471a0ddfee tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049160 Aug 06 13:10:55.373936 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1928/3863] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:10:55 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:10:56.163771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6ef0dccd-0709-476e-a2ae-214b43bed30e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:56.164422 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6ef0dccd-0709-476e-a2ae-214b43bed30e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:56.178470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ef0dccd-0709-476e-a2ae-214b43bed30e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:56.179272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ef0dccd-0709-476e-a2ae-214b43bed30e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:56.179879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ef0dccd-0709-476e-a2ae-214b43bed30e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:56.180795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ef0dccd-0709-476e-a2ae-214b43bed30e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:56.181840 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ef0dccd-0709-476e-a2ae-214b43bed30e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:56.182411 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ef0dccd-0709-476e-a2ae-214b43bed30e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:56.390237 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ae6f8896-6bb6-46f2-90a3-073a3f25edad tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:56.393804 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ae6f8896-6bb6-46f2-90a3-073a3f25edad tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:56.402430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae6f8896-6bb6-46f2-90a3-073a3f25edad tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:56.403176 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae6f8896-6bb6-46f2-90a3-073a3f25edad tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:56.403763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae6f8896-6bb6-46f2-90a3-073a3f25edad tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:56.404644 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae6f8896-6bb6-46f2-90a3-073a3f25edad tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:56.405244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae6f8896-6bb6-46f2-90a3-073a3f25edad tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:56.405808 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ae6f8896-6bb6-46f2-90a3-073a3f25edad tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:56.443154 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ae6f8896-6bb6-46f2-90a3-073a3f25edad tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061078 Aug 06 13:10:56.448514 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1929/3864] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:10:56 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:10:56.462191 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6ef0dccd-0709-476e-a2ae-214b43bed30e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:56.474779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6ef0dccd-0709-476e-a2ae-214b43bed30e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1498 microversion: 2.1 time: 0.315073 Aug 06 13:10:56.475601 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1936/3865] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:56 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1498 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:56.978751 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb216334-514b-4907-926c-6785edb945c0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:56.987118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb216334-514b-4907-926c-6785edb945c0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:57.003328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb216334-514b-4907-926c-6785edb945c0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:57.003817 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb216334-514b-4907-926c-6785edb945c0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:57.004244 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb216334-514b-4907-926c-6785edb945c0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:57.004953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb216334-514b-4907-926c-6785edb945c0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:57.005546 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb216334-514b-4907-926c-6785edb945c0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:57.005959 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb216334-514b-4907-926c-6785edb945c0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:57.033788 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb216334-514b-4907-926c-6785edb945c0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 13:10:57.135180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb216334-514b-4907-926c-6785edb945c0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 204 len: 0 microversion: 2.1 time: 0.160189 Aug 06 13:10:57.136101 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1930/3866] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:10:56 2022] DELETE /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:10:57.144660 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ce7ad8bd-e9bf-4bc4-828c-bcd49338b69c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:57.145305 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ce7ad8bd-e9bf-4bc4-828c-bcd49338b69c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:57.151570 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7ad8bd-e9bf-4bc4-828c-bcd49338b69c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:57.152048 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7ad8bd-e9bf-4bc4-828c-bcd49338b69c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:57.152505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7ad8bd-e9bf-4bc4-828c-bcd49338b69c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:57.153868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7ad8bd-e9bf-4bc4-828c-bcd49338b69c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:57.154480 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7ad8bd-e9bf-4bc4-828c-bcd49338b69c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:57.155121 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce7ad8bd-e9bf-4bc4-828c-bcd49338b69c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:57.356869 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ce7ad8bd-e9bf-4bc4-828c-bcd49338b69c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:57.365532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ce7ad8bd-e9bf-4bc4-828c-bcd49338b69c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1504 microversion: 2.1 time: 0.225002 Aug 06 13:10:57.366654 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1937/3867] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:57 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:57.456120 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7ecab110-b80f-4454-b72b-7faa6af9f416 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:57.458475 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7ecab110-b80f-4454-b72b-7faa6af9f416 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:57.464744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7ecab110-b80f-4454-b72b-7faa6af9f416 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:57.465236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7ecab110-b80f-4454-b72b-7faa6af9f416 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:57.465704 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7ecab110-b80f-4454-b72b-7faa6af9f416 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:57.466598 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7ecab110-b80f-4454-b72b-7faa6af9f416 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:57.467045 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7ecab110-b80f-4454-b72b-7faa6af9f416 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:57.467770 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7ecab110-b80f-4454-b72b-7faa6af9f416 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:57.497596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7ecab110-b80f-4454-b72b-7faa6af9f416 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045145 Aug 06 13:10:57.498165 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1931/3868] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Aug 6 13:10:57 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 13:10:57.508529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:57.509313 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:57.514936 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:57.515421 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:57.515848 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:57.517126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:57.517988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:57.518577 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:57.596192 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] HTTP exception thrown: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 is not attached to volume a1814f95-5a11-4934-aad2-53091f549b38 Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Request method failure captured: Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments/a1814f95-5a11-4934-aad2-53091f549b38 HTTP/1.1 Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7mdY_qw8nTo8yoGhbcy-Z_KwHvRz1BBPRA_Oie2NRPAeTJ1bToAt8xV9BsB8ugTHYI47NRpWKSZO2ObWLdCQFETIHbXMmSNCxWOkD6PlCTPTwSH1K4bC6_F9iPHPtJl9XQ1nCEEUdQv7X4cs2H8vY9DCOrgu34_6kjvB6IH90X1vc6A Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: f7477fc540f843b4936879b9425896f3 Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestMinimumBasicScenario-49485465 Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:10:57.609951 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7477fc540f843b4936879b9425896f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7477fc540f843b4936879b9425896f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7477fc540f843b4936879b9425896f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7477fc540f843b4936879b9425896f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestMinimumBasicScenario-49485465 Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: f7477fc540f843b4936879b9425896f3 Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestMinimumBasicScenario-49485465 Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-TestMinimumBasicScenario-49485465-project Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 3188163f95d04235b5de120354ea4997 Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestMinimumBasicScenario-49485465-project Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:10:57.611211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 is not attached to volume a1814f95-5a11-4934-aad2-53091f549b38 Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '4f9d58a0-ba13-4c19-b4c5-d4cc70058e18', 'id': 'a1814f95-5a11-4934-aad2-53091f549b38'} Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a1814f95-5a11-4934-aad2-53091f549b38. Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:10:57.611908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 is not attached to volume a1814f95-5a11-4934-aad2-53091f549b38 Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 is not attached to volume a1814f95-5a11-4934-aad2-53091f549b38 Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:10:57.613037 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Returning 404 to user: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 is not attached to volume a1814f95-5a11-4934-aad2-53091f549b38 {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:10:57.614545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1391cf40-17c6-4b10-b9dd-eeceb1682472 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments/a1814f95-5a11-4934-aad2-53091f549b38" status: 404 len: 154 microversion: 2.1 time: 0.109610 Aug 06 13:10:57.616822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1938/3869] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Aug 6 13:10:57 2022] DELETE /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18/os-volume_attachments/a1814f95-5a11-4934-aad2-53091f549b38 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 13:10:58.388201 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6e290dd2-3f04-4070-8be1-c93e542ffbb0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:58.389080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6e290dd2-3f04-4070-8be1-c93e542ffbb0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:58.395289 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e290dd2-3f04-4070-8be1-c93e542ffbb0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:58.395954 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e290dd2-3f04-4070-8be1-c93e542ffbb0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:58.396697 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e290dd2-3f04-4070-8be1-c93e542ffbb0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:58.397678 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e290dd2-3f04-4070-8be1-c93e542ffbb0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:58.398131 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e290dd2-3f04-4070-8be1-c93e542ffbb0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:58.398703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e290dd2-3f04-4070-8be1-c93e542ffbb0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:58.644395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6e290dd2-3f04-4070-8be1-c93e542ffbb0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:58.653440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6e290dd2-3f04-4070-8be1-c93e542ffbb0 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1504 microversion: 2.1 time: 0.269275 Aug 06 13:10:58.654025 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1932/3870] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:58 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:58.788024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-40068d0b-1a62-413f-b21a-f71290424167 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:58.788553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-40068d0b-1a62-413f-b21a-f71290424167 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:58.798635 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-1a62-413f-b21a-f71290424167 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:58.799289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-1a62-413f-b21a-f71290424167 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:58.799941 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-1a62-413f-b21a-f71290424167 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:58.800833 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-1a62-413f-b21a-f71290424167 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:58.801426 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-1a62-413f-b21a-f71290424167 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:58.802007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-1a62-413f-b21a-f71290424167 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:58.842529 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-40068d0b-1a62-413f-b21a-f71290424167 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 13:10:58.940168 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-40068d0b-1a62-413f-b21a-f71290424167 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 204 len: 0 microversion: 2.1 time: 0.155551 Aug 06 13:10:58.940809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1939/3871] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:10:58 2022] DELETE /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:10:58.951252 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5ed88ac0-c8e7-4b82-ba1a-fd1fafef55ae tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:58.951929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5ed88ac0-c8e7-4b82-ba1a-fd1fafef55ae tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:58.960461 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ed88ac0-c8e7-4b82-ba1a-fd1fafef55ae tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:58.961325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ed88ac0-c8e7-4b82-ba1a-fd1fafef55ae tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:58.962529 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ed88ac0-c8e7-4b82-ba1a-fd1fafef55ae tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:58.963468 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ed88ac0-c8e7-4b82-ba1a-fd1fafef55ae tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:58.965891 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ed88ac0-c8e7-4b82-ba1a-fd1fafef55ae tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:58.966775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5ed88ac0-c8e7-4b82-ba1a-fd1fafef55ae tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:59.174714 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5ed88ac0-c8e7-4b82-ba1a-fd1fafef55ae tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:59.194032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5ed88ac0-c8e7-4b82-ba1a-fd1fafef55ae tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1556 microversion: 2.1 time: 0.247776 Aug 06 13:10:59.195180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1933/3872] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:58 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1556 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:10:59.347210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-05b33f3a-58eb-4042-ac46-e2d72c0cc788 req-827848ef-5866-465e-9f73-03ffe239789a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd73bb7-17ef-48d0-96e2-b28f825997af", "name": "network-vif-deleted", "tag": "c1c1f94a-17db-4ad8-bf2e-7f9b9d8ec43e"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:10:59.358284 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-05b33f3a-58eb-4042-ac46-e2d72c0cc788 req-827848ef-5866-465e-9f73-03ffe239789a service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:59.358766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-05b33f3a-58eb-4042-ac46-e2d72c0cc788 req-827848ef-5866-465e-9f73-03ffe239789a service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:59.359740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-05b33f3a-58eb-4042-ac46-e2d72c0cc788 req-827848ef-5866-465e-9f73-03ffe239789a service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:59.372255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-05b33f3a-58eb-4042-ac46-e2d72c0cc788 req-827848ef-5866-465e-9f73-03ffe239789a service nova] Creating event network-vif-deleted:c1c1f94a-17db-4ad8-bf2e-7f9b9d8ec43e for instance 9bd73bb7-17ef-48d0-96e2-b28f825997af on hv-cinder-85199 Aug 06 13:10:59.377592 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-05b33f3a-58eb-4042-ac46-e2d72c0cc788 req-827848ef-5866-465e-9f73-03ffe239789a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034281 Aug 06 13:10:59.378177 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1940/3873] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:10:59.674454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6be8ef12-7b93-481a-9fe0-d9f529b68c76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:10:59.675063 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6be8ef12-7b93-481a-9fe0-d9f529b68c76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:10:59.686593 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6be8ef12-7b93-481a-9fe0-d9f529b68c76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:59.687088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6be8ef12-7b93-481a-9fe0-d9f529b68c76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:59.687526 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6be8ef12-7b93-481a-9fe0-d9f529b68c76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:59.688230 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6be8ef12-7b93-481a-9fe0-d9f529b68c76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:10:59.688712 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6be8ef12-7b93-481a-9fe0-d9f529b68c76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:10:59.689138 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6be8ef12-7b93-481a-9fe0-d9f529b68c76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:10:59.767544 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6be8ef12-7b93-481a-9fe0-d9f529b68c76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:10:59.775677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6be8ef12-7b93-481a-9fe0-d9f529b68c76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1462 microversion: 2.1 time: 0.105255 Aug 06 13:10:59.776509 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1934/3874] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:10:59 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:00.220155 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e38e9120-9eb2-4bee-aa77-eb03b7bdff11 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:00.220888 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e38e9120-9eb2-4bee-aa77-eb03b7bdff11 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:00.228853 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e38e9120-9eb2-4bee-aa77-eb03b7bdff11 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:00.229505 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e38e9120-9eb2-4bee-aa77-eb03b7bdff11 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:00.230049 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e38e9120-9eb2-4bee-aa77-eb03b7bdff11 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:00.230904 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e38e9120-9eb2-4bee-aa77-eb03b7bdff11 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:00.232178 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e38e9120-9eb2-4bee-aa77-eb03b7bdff11 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:00.232724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e38e9120-9eb2-4bee-aa77-eb03b7bdff11 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:00.505690 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e38e9120-9eb2-4bee-aa77-eb03b7bdff11 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:00.514694 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e38e9120-9eb2-4bee-aa77-eb03b7bdff11 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1556 microversion: 2.1 time: 0.299228 Aug 06 13:11:00.515271 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1941/3875] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:00 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1556 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:00.797896 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:00.799073 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:00.806109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:00.806740 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:00.807220 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:00.808204 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:00.808926 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:00.810068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:00.850516 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:00.851004 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:00.851436 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:00.851875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lazy-loading 'fault' on Instance uuid 9bd73bb7-17ef-48d0-96e2-b28f825997af {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 13:11:01.149163 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:01.154865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:01.164264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-376088a7-d61f-4c4c-bced-ec2029ec5f80 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 200 len: 1304 microversion: 2.1 time: 0.370068 Aug 06 13:11:01.165459 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1935/3876] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:00 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 1304 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:01.546336 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-038af89e-e8ec-4d89-9188-6665d7bcf574 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:01.546950 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-038af89e-e8ec-4d89-9188-6665d7bcf574 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:01.566065 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038af89e-e8ec-4d89-9188-6665d7bcf574 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:01.566737 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038af89e-e8ec-4d89-9188-6665d7bcf574 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:01.567896 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038af89e-e8ec-4d89-9188-6665d7bcf574 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:01.568926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038af89e-e8ec-4d89-9188-6665d7bcf574 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:01.569649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038af89e-e8ec-4d89-9188-6665d7bcf574 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:01.571332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-038af89e-e8ec-4d89-9188-6665d7bcf574 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:01.832043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-038af89e-e8ec-4d89-9188-6665d7bcf574 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3188163f95d04235b5de120354ea4997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7477fc540f843b4936879b9425896f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:01.844938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-038af89e-e8ec-4d89-9188-6665d7bcf574 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 200 len: 1556 microversion: 2.1 time: 0.303937 Aug 06 13:11:01.846022 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1942/3877] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:01 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 1556 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:01.992738 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-9b8329ea-73d3-4f3c-a4c9-a038c39de44b req-d6d3a0fd-2c8c-43ae-bd17-12150b595de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9d58a0-ba13-4c19-b4c5-d4cc70058e18", "name": "network-vif-deleted", "tag": "9de4834e-e401-4b5c-a66f-d304dddac190"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:11:02.011556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9b8329ea-73d3-4f3c-a4c9-a038c39de44b req-d6d3a0fd-2c8c-43ae-bd17-12150b595de2 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:02.012160 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9b8329ea-73d3-4f3c-a4c9-a038c39de44b req-d6d3a0fd-2c8c-43ae-bd17-12150b595de2 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:02.013236 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9b8329ea-73d3-4f3c-a4c9-a038c39de44b req-d6d3a0fd-2c8c-43ae-bd17-12150b595de2 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:02.030503 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-9b8329ea-73d3-4f3c-a4c9-a038c39de44b req-d6d3a0fd-2c8c-43ae-bd17-12150b595de2 service nova] Creating event network-vif-deleted:9de4834e-e401-4b5c-a66f-d304dddac190 for instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 on hv-cinder-85199 Aug 06 13:11:02.039068 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-9b8329ea-73d3-4f3c-a4c9-a038c39de44b req-d6d3a0fd-2c8c-43ae-bd17-12150b595de2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051137 Aug 06 13:11:02.040733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1936/3878] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:11:02.198527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:02.205968 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 9bd73bb7-17ef-48d0-96e2-b28f825997af] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:02.218949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:02.219800 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:02.220599 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:02.221550 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:02.223543 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:02.224239 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:02.229639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:02.257289 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] HTTP exception thrown: Instance 9bd73bb7-17ef-48d0-96e2-b28f825997af could not be found. Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Request method failure captured: Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af HTTP/1.1 Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7mhPGvCo3OLobHBryN9sQZwQBXgfy01HqDf_jjPnN3U_RcKpboswS4GM_uMunv5Za2Z4njml6moJOQSl1QWk4YuHdQSluOg2J-kAPLVN8FqTAgX6VSjnMcGeHxSjOE13rM8FFngAVoHXAW2ScERm5yoR-CKAbKWkqQ6oW6OK0AdBreM Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: b8ba2e48caca474f860946df0c9d0baa Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesActionsTest-1886370287 Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:11:02.274867 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8ba2e48caca474f860946df0c9d0baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b8ba2e48caca474f860946df0c9d0baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8ba2e48caca474f860946df0c9d0baa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b8ba2e48caca474f860946df0c9d0baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesActionsTest-1886370287 Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: b8ba2e48caca474f860946df0c9d0baa Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesActionsTest-1886370287 Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesActionsTest-1886370287-project Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 4f71cfae23f74c96b1cf3329804f369e Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesActionsTest-1886370287-project Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance 9bd73bb7-17ef-48d0-96e2-b28f825997af could not be found. Aug 06 13:11:02.276442 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '9bd73bb7-17ef-48d0-96e2-b28f825997af'} Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd73bb7-17ef-48d0-96e2-b28f825997af could not be found. Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:11:02.277463 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd73bb7-17ef-48d0-96e2-b28f825997af could not be found. Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd73bb7-17ef-48d0-96e2-b28f825997af could not be found. Aug 06 13:11:02.279311 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:11:02.280519 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Returning 404 to user: Instance 9bd73bb7-17ef-48d0-96e2-b28f825997af could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:11:02.282553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1ec9781b-3133-4b73-9148-4d0fde975cef tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af" status: 404 len: 111 microversion: 2.1 time: 0.097783 Aug 06 13:11:02.283257 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1943/3879] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:02 2022] GET /compute/v2.1/servers/9bd73bb7-17ef-48d0-96e2-b28f825997af => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:11:02.475049 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-735057110", "imageRef": "217657d9-68e9-4831-ac3e-444bba105969", "flavorRef": "452", "networks": [{"uuid": "b4a8c070-6227-49eb-8b66-3dd6d3241c21"}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:11:02.631060 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] validate_networks() for [('b4a8c070-6227-49eb-8b66-3dd6d3241c21', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 13:11:02.870891 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:02.871500 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] [instance: 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:02.879392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:02.880081 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:02.880734 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:02.881499 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:02.882107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:02.882686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:02.897676 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] HTTP exception thrown: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 could not be found. Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Request method failure captured: Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 HTTP/1.1 Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7mdY_qw8nTo8yoGhbcy-Z_KwHvRz1BBPRA_Oie2NRPAeTJ1bToAt8xV9BsB8ugTHYI47NRpWKSZO2ObWLdCQFETIHbXMmSNCxWOkD6PlCTPTwSH1K4bC6_F9iPHPtJl9XQ1nCEEUdQv7X4cs2H8vY9DCOrgu34_6kjvB6IH90X1vc6A Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: f7477fc540f843b4936879b9425896f3 Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestMinimumBasicScenario-49485465 Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:11:02.899595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7477fc540f843b4936879b9425896f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7477fc540f843b4936879b9425896f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7477fc540f843b4936879b9425896f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7477fc540f843b4936879b9425896f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestMinimumBasicScenario-49485465 Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: f7477fc540f843b4936879b9425896f3 Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestMinimumBasicScenario-49485465 Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-TestMinimumBasicScenario-49485465-project Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 3188163f95d04235b5de120354ea4997 Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestMinimumBasicScenario-49485465-project Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 could not be found. Aug 06 13:11:02.901040 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '4f9d58a0-ba13-4c19-b4c5-d4cc70058e18'} Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 could not be found. Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:11:02.901711 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 could not be found. Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 could not be found. Aug 06 13:11:02.902898 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:11:02.908842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Returning 404 to user: Instance 4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:11:02.910117 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa107fca-ded0-42a0-820b-435921ca88e8 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18" status: 404 len: 111 microversion: 2.1 time: 0.043440 Aug 06 13:11:02.911444 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1944/3880] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:02 2022] GET /compute/v2.1/servers/4f9d58a0-ba13-4c19-b4c5-d4cc70058e18 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 13:11:02.920232 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-de841797-929b-4700-913d-2d86843bbda2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] Calling method '.version_select at 0x7f541ad31670>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:02.945322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-de841797-929b-4700-913d-2d86843bbda2 tempest-TestMinimumBasicScenario-49485465 tempest-TestMinimumBasicScenario-49485465-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1137332224" status: 202 len: 0 microversion: 2.1 time: 0.029639 Aug 06 13:11:02.947351 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1945/3881] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Aug 6 13:11:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1137332224 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:11:03.600737 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 13:11:03.601218 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 13:11:03.601616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 13:11:03.602022 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 13:11:03.602478 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 13:11:03.619572 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:03.620787 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:03.621662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:03.623825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:03.624528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:03.625443 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:03.664818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Getting quotas for project b8ba2e48caca474f860946df0c9d0baa. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 13:11:03.676779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Getting quotas for user 4f71cfae23f74c96b1cf3329804f369e and project b8ba2e48caca474f860946df0c9d0baa. Resources: {'cores', 'instances', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 13:11:03.703547 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 13:11:03.707982 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='217657d9-68e9-4831-ac3e-444bba105969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 13:11:03.797793 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-25372187-5356-43f1-9ef6-9a5270159b49 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331324 Aug 06 13:11:03.799111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1937/3882] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 13:11:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 13:11:03.813579 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b56533e-da35-452f-881f-ead1a0ceba45 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:03.816562 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7b56533e-da35-452f-881f-ead1a0ceba45 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:04.098283 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7b56533e-da35-452f-881f-ead1a0ceba45 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:04.108773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b56533e-da35-452f-881f-ead1a0ceba45 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1213 microversion: 2.1 time: 0.302244 Aug 06 13:11:04.124763 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1946/3883] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:03 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1213 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:05.129033 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7052c739-bfd5-440e-b6f0-b8315f2312bb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:05.130264 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7052c739-bfd5-440e-b6f0-b8315f2312bb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:05.138481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7052c739-bfd5-440e-b6f0-b8315f2312bb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:05.139296 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7052c739-bfd5-440e-b6f0-b8315f2312bb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:05.139970 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7052c739-bfd5-440e-b6f0-b8315f2312bb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:05.140902 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7052c739-bfd5-440e-b6f0-b8315f2312bb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:05.141677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7052c739-bfd5-440e-b6f0-b8315f2312bb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:05.142321 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7052c739-bfd5-440e-b6f0-b8315f2312bb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:05.218814 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7052c739-bfd5-440e-b6f0-b8315f2312bb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:05.226818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7052c739-bfd5-440e-b6f0-b8315f2312bb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1265 microversion: 2.1 time: 0.101529 Aug 06 13:11:05.240594 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1938/3884] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:05 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:06.216167 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bf743502-b817-44c8-92ca-81d09c1c1491 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Action: 'create', calling method: .version_select at 0x7f541f21cca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1937561453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6xnl5eV+WPT7JYbwVfDMcE3GeFBNDzrsaWnauoN5Yf/pdBc3gvy9JiS8hOT221JAisGDxKz+gJqlsffEpqMnGTyXqxuJSIXFz+xPGOy1yfxzAtg1EJ4WPiU0PxluDshA=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:11:06.247541 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a991fe01-d7a5-4e72-a802-5a79de8ebb7c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:06.248956 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a991fe01-d7a5-4e72-a802-5a79de8ebb7c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:06.272024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-bf743502-b817-44c8-92ca-81d09c1c1491 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Getting quotas for project 06e0dc4c7d244821bd974b0dea3fc631. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 13:11:06.272527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a991fe01-d7a5-4e72-a802-5a79de8ebb7c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:06.273021 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a991fe01-d7a5-4e72-a802-5a79de8ebb7c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:06.273451 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a991fe01-d7a5-4e72-a802-5a79de8ebb7c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:06.274145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a991fe01-d7a5-4e72-a802-5a79de8ebb7c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:06.274765 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a991fe01-d7a5-4e72-a802-5a79de8ebb7c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:06.275332 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a991fe01-d7a5-4e72-a802-5a79de8ebb7c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:06.278532 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-bf743502-b817-44c8-92ca-81d09c1c1491 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Getting quotas for user 2dacef0fd30a43d2b29a2eeb67884ec1 and project 06e0dc4c7d244821bd974b0dea3fc631. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 13:11:06.322195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bf743502-b817-44c8-92ca-81d09c1c1491 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.417338 Aug 06 13:11:06.325327 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1947/3885] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Aug 6 13:11:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:11:06.374380 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a991fe01-d7a5-4e72-a802-5a79de8ebb7c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:06.392596 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a991fe01-d7a5-4e72-a802-5a79de8ebb7c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1271 microversion: 2.1 time: 0.149040 Aug 06 13:11:06.393177 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1939/3886] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:06 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:11:07.419012 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d708d0e4-9c3f-4158-87b5-eacda1f157cb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:07.420409 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d708d0e4-9c3f-4158-87b5-eacda1f157cb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:07.428552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d708d0e4-9c3f-4158-87b5-eacda1f157cb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:07.429308 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d708d0e4-9c3f-4158-87b5-eacda1f157cb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:07.429842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d708d0e4-9c3f-4158-87b5-eacda1f157cb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:07.430610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d708d0e4-9c3f-4158-87b5-eacda1f157cb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:07.431602 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d708d0e4-9c3f-4158-87b5-eacda1f157cb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:07.432354 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d708d0e4-9c3f-4158-87b5-eacda1f157cb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:07.732361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d708d0e4-9c3f-4158-87b5-eacda1f157cb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:07.748172 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d708d0e4-9c3f-4158-87b5-eacda1f157cb tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1313 microversion: 2.1 time: 0.337200 Aug 06 13:11:07.749282 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1948/3887] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:07 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:07.847313 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-4f132ad9-924a-4f56-b373-4d1373b4dbcf req-9b211193-ebcf-4a80-9352-da47b179de03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362b3178-e4ba-4ae2-a9a5-52676cb23184", "tag": "8b04cd69-4c48-4bd3-b2a3-2fb952b8066c"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:11:07.869032 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-4f132ad9-924a-4f56-b373-4d1373b4dbcf req-9b211193-ebcf-4a80-9352-da47b179de03 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:07.870108 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-4f132ad9-924a-4f56-b373-4d1373b4dbcf req-9b211193-ebcf-4a80-9352-da47b179de03 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:07.871088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-4f132ad9-924a-4f56-b373-4d1373b4dbcf req-9b211193-ebcf-4a80-9352-da47b179de03 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:07.888650 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-4f132ad9-924a-4f56-b373-4d1373b4dbcf req-9b211193-ebcf-4a80-9352-da47b179de03 service nova] Creating event network-changed:8b04cd69-4c48-4bd3-b2a3-2fb952b8066c for instance 362b3178-e4ba-4ae2-a9a5-52676cb23184 on hv-cinder-85199 Aug 06 13:11:07.898604 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-4f132ad9-924a-4f56-b373-4d1373b4dbcf req-9b211193-ebcf-4a80-9352-da47b179de03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055968 Aug 06 13:11:07.900087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1940/3888] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:11:08.770793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d0ef034e-8eb2-407f-ad02-e6cf5fe2eba2 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:08.772403 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d0ef034e-8eb2-407f-ad02-e6cf5fe2eba2 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:08.785083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0ef034e-8eb2-407f-ad02-e6cf5fe2eba2 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:08.788801 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0ef034e-8eb2-407f-ad02-e6cf5fe2eba2 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:08.789358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0ef034e-8eb2-407f-ad02-e6cf5fe2eba2 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:08.790143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0ef034e-8eb2-407f-ad02-e6cf5fe2eba2 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:08.790668 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0ef034e-8eb2-407f-ad02-e6cf5fe2eba2 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:08.791156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0ef034e-8eb2-407f-ad02-e6cf5fe2eba2 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:09.076726 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d0ef034e-8eb2-407f-ad02-e6cf5fe2eba2 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:09.084228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d0ef034e-8eb2-407f-ad02-e6cf5fe2eba2 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1313 microversion: 2.1 time: 0.318538 Aug 06 13:11:09.099145 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1949/3889] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:08 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:10.106385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aca6c7ef-c9d5-4e50-9435-edb260aae8f1 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:10.107903 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aca6c7ef-c9d5-4e50-9435-edb260aae8f1 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:10.116577 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aca6c7ef-c9d5-4e50-9435-edb260aae8f1 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:10.117351 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aca6c7ef-c9d5-4e50-9435-edb260aae8f1 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:10.117940 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aca6c7ef-c9d5-4e50-9435-edb260aae8f1 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:10.119142 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aca6c7ef-c9d5-4e50-9435-edb260aae8f1 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:10.119752 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aca6c7ef-c9d5-4e50-9435-edb260aae8f1 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:10.120366 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aca6c7ef-c9d5-4e50-9435-edb260aae8f1 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:10.422411 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aca6c7ef-c9d5-4e50-9435-edb260aae8f1 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:10.436267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aca6c7ef-c9d5-4e50-9435-edb260aae8f1 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1313 microversion: 2.1 time: 0.334011 Aug 06 13:11:10.445657 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1941/3890] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:10 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:11.457056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-89d336c9-a6d4-4c82-82ec-9e59369a7a76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:11.458297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-89d336c9-a6d4-4c82-82ec-9e59369a7a76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:11.476281 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d336c9-a6d4-4c82-82ec-9e59369a7a76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:11.476922 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d336c9-a6d4-4c82-82ec-9e59369a7a76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:11.477379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d336c9-a6d4-4c82-82ec-9e59369a7a76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:11.478130 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d336c9-a6d4-4c82-82ec-9e59369a7a76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:11.478588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d336c9-a6d4-4c82-82ec-9e59369a7a76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:11.479014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89d336c9-a6d4-4c82-82ec-9e59369a7a76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:11.708465 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-89d336c9-a6d4-4c82-82ec-9e59369a7a76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:11.724042 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-89d336c9-a6d4-4c82-82ec-9e59369a7a76 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1313 microversion: 2.1 time: 0.270598 Aug 06 13:11:11.724793 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1950/3891] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:11 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:12.745305 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3293764d-359f-4fb7-b7b0-a2826ce1c45e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:12.745909 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3293764d-359f-4fb7-b7b0-a2826ce1c45e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:12.752023 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3293764d-359f-4fb7-b7b0-a2826ce1c45e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:12.752522 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3293764d-359f-4fb7-b7b0-a2826ce1c45e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:12.752947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3293764d-359f-4fb7-b7b0-a2826ce1c45e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:12.753624 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3293764d-359f-4fb7-b7b0-a2826ce1c45e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:12.754064 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3293764d-359f-4fb7-b7b0-a2826ce1c45e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:12.754474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3293764d-359f-4fb7-b7b0-a2826ce1c45e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:13.001818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3293764d-359f-4fb7-b7b0-a2826ce1c45e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:13.010391 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3293764d-359f-4fb7-b7b0-a2826ce1c45e tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1313 microversion: 2.1 time: 0.268954 Aug 06 13:11:13.011059 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1942/3892] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:12 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:13.738544 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-bfc27c8c-0ae8-4493-a321-aa72bffde92f req-a35f2e1c-75c4-4f1e-8ea8-736d9ef6521e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362b3178-e4ba-4ae2-a9a5-52676cb23184", "name": "network-vif-plugged", "status": "completed", "tag": "8b04cd69-4c48-4bd3-b2a3-2fb952b8066c"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:11:13.744044 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:13.753913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-bfc27c8c-0ae8-4493-a321-aa72bffde92f req-a35f2e1c-75c4-4f1e-8ea8-736d9ef6521e service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:13.754392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-bfc27c8c-0ae8-4493-a321-aa72bffde92f req-a35f2e1c-75c4-4f1e-8ea8-736d9ef6521e service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:13.754819 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-bfc27c8c-0ae8-4493-a321-aa72bffde92f req-a35f2e1c-75c4-4f1e-8ea8-736d9ef6521e service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:13.766910 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-bfc27c8c-0ae8-4493-a321-aa72bffde92f req-a35f2e1c-75c4-4f1e-8ea8-736d9ef6521e service nova] Creating event network-vif-plugged:8b04cd69-4c48-4bd3-b2a3-2fb952b8066c for instance 362b3178-e4ba-4ae2-a9a5-52676cb23184 on hv-cinder-85199 Aug 06 13:11:13.772110 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-bfc27c8c-0ae8-4493-a321-aa72bffde92f req-a35f2e1c-75c4-4f1e-8ea8-736d9ef6521e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038053 Aug 06 13:11:13.772776 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1951/3893] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 13:11:14.032182 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f1803486-ff26-48cd-b23d-974159dd15a6 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:14.032860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f1803486-ff26-48cd-b23d-974159dd15a6 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:14.041377 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:14.042705 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:14.043937 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:14.047129 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1803486-ff26-48cd-b23d-974159dd15a6 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:14.047833 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1803486-ff26-48cd-b23d-974159dd15a6 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:14.048665 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1803486-ff26-48cd-b23d-974159dd15a6 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:14.050381 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1803486-ff26-48cd-b23d-974159dd15a6 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:14.051014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1803486-ff26-48cd-b23d-974159dd15a6 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:14.051928 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1803486-ff26-48cd-b23d-974159dd15a6 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:14.225536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f1803486-ff26-48cd-b23d-974159dd15a6 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:14.235233 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f1803486-ff26-48cd-b23d-974159dd15a6 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1313 microversion: 2.1 time: 0.208055 Aug 06 13:11:14.236402 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1943/3894] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:14 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:15.258994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c688cbf8-671e-4bc9-aacc-94c293f0ae3c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:15.259574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c688cbf8-671e-4bc9-aacc-94c293f0ae3c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:15.265957 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c688cbf8-671e-4bc9-aacc-94c293f0ae3c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:15.266430 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c688cbf8-671e-4bc9-aacc-94c293f0ae3c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:15.266860 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c688cbf8-671e-4bc9-aacc-94c293f0ae3c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:15.267537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c688cbf8-671e-4bc9-aacc-94c293f0ae3c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:15.268060 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c688cbf8-671e-4bc9-aacc-94c293f0ae3c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:15.268574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c688cbf8-671e-4bc9-aacc-94c293f0ae3c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:15.400847 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c688cbf8-671e-4bc9-aacc-94c293f0ae3c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:15.408838 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c688cbf8-671e-4bc9-aacc-94c293f0ae3c tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1313 microversion: 2.1 time: 0.155057 Aug 06 13:11:15.409391 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1952/3895] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:15 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:16.429416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-82615538-5cce-4ac9-8a6b-3cc32a02e4e8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:16.430012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-82615538-5cce-4ac9-8a6b-3cc32a02e4e8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:16.436095 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82615538-5cce-4ac9-8a6b-3cc32a02e4e8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:16.437126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82615538-5cce-4ac9-8a6b-3cc32a02e4e8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:16.437550 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82615538-5cce-4ac9-8a6b-3cc32a02e4e8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:16.438221 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82615538-5cce-4ac9-8a6b-3cc32a02e4e8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:16.438664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82615538-5cce-4ac9-8a6b-3cc32a02e4e8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:16.439080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-82615538-5cce-4ac9-8a6b-3cc32a02e4e8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:16.571911 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-82615538-5cce-4ac9-8a6b-3cc32a02e4e8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:16.579307 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-82615538-5cce-4ac9-8a6b-3cc32a02e4e8 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1496 microversion: 2.1 time: 0.154074 Aug 06 13:11:16.579865 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1944/3896] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:16 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1496 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:17.138157 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1a671cfd-53e1-4756-b8ac-109e0e327a70 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:17.138689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1a671cfd-53e1-4756-b8ac-109e0e327a70 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:17.142055 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:17.147700 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a671cfd-53e1-4756-b8ac-109e0e327a70 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:17.148183 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a671cfd-53e1-4756-b8ac-109e0e327a70 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:17.148644 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a671cfd-53e1-4756-b8ac-109e0e327a70 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:17.149367 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a671cfd-53e1-4756-b8ac-109e0e327a70 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:17.149825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a671cfd-53e1-4756-b8ac-109e0e327a70 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:17.150246 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a671cfd-53e1-4756-b8ac-109e0e327a70 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:17.176773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1a671cfd-53e1-4756-b8ac-109e0e327a70 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 13:11:17.254837 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1a671cfd-53e1-4756-b8ac-109e0e327a70 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 204 len: 0 microversion: 2.1 time: 0.120335 Aug 06 13:11:17.255684 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1953/3897] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:11:17 2022] DELETE /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:11:17.264054 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-820cc767-2a40-4f56-8ce3-376e81d9f661 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:17.264675 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-820cc767-2a40-4f56-8ce3-376e81d9f661 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:17.271143 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-820cc767-2a40-4f56-8ce3-376e81d9f661 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:17.271615 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-820cc767-2a40-4f56-8ce3-376e81d9f661 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:17.272038 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-820cc767-2a40-4f56-8ce3-376e81d9f661 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:17.272775 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-820cc767-2a40-4f56-8ce3-376e81d9f661 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:17.273216 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-820cc767-2a40-4f56-8ce3-376e81d9f661 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:17.273631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-820cc767-2a40-4f56-8ce3-376e81d9f661 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:17.405647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-820cc767-2a40-4f56-8ce3-376e81d9f661 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:17.413292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-820cc767-2a40-4f56-8ce3-376e81d9f661 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1502 microversion: 2.1 time: 0.153382 Aug 06 13:11:17.413860 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1945/3898] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:17 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:18.434701 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a2486a65-69ba-4ad3-88a5-5338e418a78f tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:18.435452 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a2486a65-69ba-4ad3-88a5-5338e418a78f tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:18.441895 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2486a65-69ba-4ad3-88a5-5338e418a78f tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:18.442382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2486a65-69ba-4ad3-88a5-5338e418a78f tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:18.442813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2486a65-69ba-4ad3-88a5-5338e418a78f tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:18.443498 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2486a65-69ba-4ad3-88a5-5338e418a78f tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:18.443949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2486a65-69ba-4ad3-88a5-5338e418a78f tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:18.444400 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2486a65-69ba-4ad3-88a5-5338e418a78f tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:18.577158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a2486a65-69ba-4ad3-88a5-5338e418a78f tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:18.585517 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a2486a65-69ba-4ad3-88a5-5338e418a78f tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1502 microversion: 2.1 time: 0.155051 Aug 06 13:11:18.586080 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1954/3899] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:18 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:19.607338 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-81760412-7a8b-4746-9ef3-f2f6aca52b6b tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:19.607950 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-81760412-7a8b-4746-9ef3-f2f6aca52b6b tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:19.614882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81760412-7a8b-4746-9ef3-f2f6aca52b6b tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:19.615364 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81760412-7a8b-4746-9ef3-f2f6aca52b6b tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:19.615802 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81760412-7a8b-4746-9ef3-f2f6aca52b6b tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:19.616515 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81760412-7a8b-4746-9ef3-f2f6aca52b6b tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:19.616966 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81760412-7a8b-4746-9ef3-f2f6aca52b6b tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:19.617385 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81760412-7a8b-4746-9ef3-f2f6aca52b6b tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:19.680241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-81760412-7a8b-4746-9ef3-f2f6aca52b6b tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f71cfae23f74c96b1cf3329804f369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ba2e48caca474f860946df0c9d0baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:19.687875 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-81760412-7a8b-4746-9ef3-f2f6aca52b6b tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 200 len: 1460 microversion: 2.1 time: 0.084567 Aug 06 13:11:19.688482 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1946/3900] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:19 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 1460 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:19.695018 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-3689a685-c958-4706-86dd-909ad2f1d037 req-8070d4ed-16ed-4ec4-a1bb-d40d87586dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362b3178-e4ba-4ae2-a9a5-52676cb23184", "name": "network-vif-deleted", "tag": "8b04cd69-4c48-4bd3-b2a3-2fb952b8066c"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:11:19.707994 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3689a685-c958-4706-86dd-909ad2f1d037 req-8070d4ed-16ed-4ec4-a1bb-d40d87586dfd service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:19.708812 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3689a685-c958-4706-86dd-909ad2f1d037 req-8070d4ed-16ed-4ec4-a1bb-d40d87586dfd service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:19.709241 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3689a685-c958-4706-86dd-909ad2f1d037 req-8070d4ed-16ed-4ec4-a1bb-d40d87586dfd service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:19.720680 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-3689a685-c958-4706-86dd-909ad2f1d037 req-8070d4ed-16ed-4ec4-a1bb-d40d87586dfd service nova] Creating event network-vif-deleted:8b04cd69-4c48-4bd3-b2a3-2fb952b8066c for instance 362b3178-e4ba-4ae2-a9a5-52676cb23184 on hv-cinder-85199 Aug 06 13:11:19.725553 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-3689a685-c958-4706-86dd-909ad2f1d037 req-8070d4ed-16ed-4ec4-a1bb-d40d87586dfd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034715 Aug 06 13:11:19.726126 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1955/3901] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:11:20.710585 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:20.711200 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] [instance: 362b3178-e4ba-4ae2-a9a5-52676cb23184] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:20.717519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:20.718016 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:20.718449 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:20.719122 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:20.719567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:20.719978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:20.733287 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] HTTP exception thrown: Instance 362b3178-e4ba-4ae2-a9a5-52676cb23184 could not be found. Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Request method failure captured: Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 HTTP/1.1 Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7mhPGvCo3OLobHBryN9sQZwQBXgfy01HqDf_jjPnN3U_RcKpboswS4GM_uMunv5Za2Z4njml6moJOQSl1QWk4YuHdQSluOg2J-kAPLVN8FqTAgX6VSjnMcGeHxSjOE13rM8FFngAVoHXAW2ScERm5yoR-CKAbKWkqQ6oW6OK0AdBreM Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: b8ba2e48caca474f860946df0c9d0baa Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesActionsTest-1886370287 Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:11:20.735548 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8ba2e48caca474f860946df0c9d0baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b8ba2e48caca474f860946df0c9d0baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8ba2e48caca474f860946df0c9d0baa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b8ba2e48caca474f860946df0c9d0baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesActionsTest-1886370287 Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: b8ba2e48caca474f860946df0c9d0baa Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesActionsTest-1886370287 Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesActionsTest-1886370287-project Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 4f71cfae23f74c96b1cf3329804f369e Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesActionsTest-1886370287-project Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance 362b3178-e4ba-4ae2-a9a5-52676cb23184 could not be found. Aug 06 13:11:20.737012 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '362b3178-e4ba-4ae2-a9a5-52676cb23184'} Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362b3178-e4ba-4ae2-a9a5-52676cb23184 could not be found. Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:11:20.738617 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362b3178-e4ba-4ae2-a9a5-52676cb23184 could not be found. Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362b3178-e4ba-4ae2-a9a5-52676cb23184 could not be found. Aug 06 13:11:20.739862 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:11:20.741096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] Returning 404 to user: Instance 362b3178-e4ba-4ae2-a9a5-52676cb23184 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:11:20.741096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac95c19c-7fc9-443f-8ed2-fa261f8cd973 tempest-VolumesActionsTest-1886370287 tempest-VolumesActionsTest-1886370287-project] 10.222.0.20 "GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184" status: 404 len: 111 microversion: 2.1 time: 0.030149 Aug 06 13:11:20.741096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1947/3902] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:20 2022] GET /compute/v2.1/servers/362b3178-e4ba-4ae2-a9a5-52676cb23184 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:11:36.649627 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:36.650908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:36.655773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-521351375", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1937561453", "security_groups": [{"name": "tempest-secgroup-smoke-770491641"}], "networks": [{"uuid": "33edd50e-8316-41f2-84aa-97b39ab5d99a"}], "block_device_mapping_v2": [{"uuid": "eb68b181-85dc-4a43-8f54-2e370e5cc97e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:11:36.784141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] validate_networks() for [('33edd50e-8316-41f2-84aa-97b39ab5d99a', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 13:11:37.255100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 13:11:37.255621 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 13:11:37.256156 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 13:11:37.256663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 13:11:37.257135 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 13:11:37.266502 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:37.267205 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:37.267791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:37.268537 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:37.268989 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:37.269546 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:37.286614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Getting quotas for project 06e0dc4c7d244821bd974b0dea3fc631. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 13:11:37.290677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Getting quotas for user 2dacef0fd30a43d2b29a2eeb67884ec1 and project 06e0dc4c7d244821bd974b0dea3fc631. Resources: {'cores', 'instances', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 13:11:37.351900 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 13:11:37.354217 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb68b181-85dc-4a43-8f54-2e370e5cc97e',volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 13:11:37.505929 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4dc219c2-3221-467e-a5be-d4a59d235354 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.857597 Aug 06 13:11:37.507043 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1956/3903] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Aug 6 13:11:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 13:11:37.522153 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-01d9f09e-1d27-4f3e-9bd8-b7203d0c59fd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:37.524111 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-01d9f09e-1d27-4f3e-9bd8-b7203d0c59fd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:37.536328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=9 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:37.537832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=56 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:37.627362 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-01d9f09e-1d27-4f3e-9bd8-b7203d0c59fd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:37.638071 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-01d9f09e-1d27-4f3e-9bd8-b7203d0c59fd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1088 microversion: 2.1 time: 0.123944 Aug 06 13:11:37.638963 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1948/3904] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:37 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1088 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:38.660868 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-95f518ab-4d96-4e53-80a5-581d9284388c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:38.662528 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-95f518ab-4d96-4e53-80a5-581d9284388c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:38.670007 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95f518ab-4d96-4e53-80a5-581d9284388c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:38.670962 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95f518ab-4d96-4e53-80a5-581d9284388c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:38.671710 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95f518ab-4d96-4e53-80a5-581d9284388c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:38.673005 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95f518ab-4d96-4e53-80a5-581d9284388c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:38.673706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95f518ab-4d96-4e53-80a5-581d9284388c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:38.674209 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95f518ab-4d96-4e53-80a5-581d9284388c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:38.743920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-95f518ab-4d96-4e53-80a5-581d9284388c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:38.754237 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-95f518ab-4d96-4e53-80a5-581d9284388c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1186 microversion: 2.1 time: 0.098059 Aug 06 13:11:38.755144 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1957/3905] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:38 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1186 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:39.777180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d155cf82-777c-4b57-bcde-6690182867dd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:39.777905 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d155cf82-777c-4b57-bcde-6690182867dd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:39.786681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d155cf82-777c-4b57-bcde-6690182867dd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:39.787396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d155cf82-777c-4b57-bcde-6690182867dd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:39.788170 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d155cf82-777c-4b57-bcde-6690182867dd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:39.789130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d155cf82-777c-4b57-bcde-6690182867dd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:39.789819 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d155cf82-777c-4b57-bcde-6690182867dd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:39.790428 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d155cf82-777c-4b57-bcde-6690182867dd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:39.869772 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d155cf82-777c-4b57-bcde-6690182867dd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:39.879792 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d155cf82-777c-4b57-bcde-6690182867dd tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1192 microversion: 2.1 time: 0.107219 Aug 06 13:11:39.884346 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1949/3906] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:39 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:40.904259 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e37355ba-8060-49f2-8db9-d61d7056fceb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:40.907079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e37355ba-8060-49f2-8db9-d61d7056fceb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:40.914374 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37355ba-8060-49f2-8db9-d61d7056fceb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:40.914872 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37355ba-8060-49f2-8db9-d61d7056fceb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:40.915294 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37355ba-8060-49f2-8db9-d61d7056fceb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:40.915984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37355ba-8060-49f2-8db9-d61d7056fceb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:40.916599 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37355ba-8060-49f2-8db9-d61d7056fceb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:40.917148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e37355ba-8060-49f2-8db9-d61d7056fceb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:41.070552 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-fcc0839f-faae-4c88-ae82-00beb00cc56d req-acdeb812-5575-4f3d-b1e4-452df40ba863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45acd756-ff84-44c0-b6bb-44ae3d3249eb", "tag": "16126770-481f-4e05-ab6a-435024f7a197"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:11:41.086664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-fcc0839f-faae-4c88-ae82-00beb00cc56d req-acdeb812-5575-4f3d-b1e4-452df40ba863 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:41.087479 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-fcc0839f-faae-4c88-ae82-00beb00cc56d req-acdeb812-5575-4f3d-b1e4-452df40ba863 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:41.088222 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-fcc0839f-faae-4c88-ae82-00beb00cc56d req-acdeb812-5575-4f3d-b1e4-452df40ba863 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:41.095574 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e37355ba-8060-49f2-8db9-d61d7056fceb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:41.103348 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e37355ba-8060-49f2-8db9-d61d7056fceb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.204467 Aug 06 13:11:41.103907 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1950/3907] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:40 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:41.122148 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-fcc0839f-faae-4c88-ae82-00beb00cc56d req-acdeb812-5575-4f3d-b1e4-452df40ba863 service nova] Creating event network-changed:16126770-481f-4e05-ab6a-435024f7a197 for instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb on hv-cinder-85199 Aug 06 13:11:41.134456 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-fcc0839f-faae-4c88-ae82-00beb00cc56d req-acdeb812-5575-4f3d-b1e4-452df40ba863 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287325 Aug 06 13:11:41.135706 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1958/3908] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:11:42.131638 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e7666e27-19fa-4664-a910-ef41f1dee160 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:42.132288 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e7666e27-19fa-4664-a910-ef41f1dee160 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:42.140003 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7666e27-19fa-4664-a910-ef41f1dee160 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:42.140510 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7666e27-19fa-4664-a910-ef41f1dee160 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:42.140968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7666e27-19fa-4664-a910-ef41f1dee160 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:42.143087 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7666e27-19fa-4664-a910-ef41f1dee160 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:42.143756 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7666e27-19fa-4664-a910-ef41f1dee160 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:42.144518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7666e27-19fa-4664-a910-ef41f1dee160 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:42.287422 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e7666e27-19fa-4664-a910-ef41f1dee160 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:42.299748 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e7666e27-19fa-4664-a910-ef41f1dee160 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.172220 Aug 06 13:11:42.301080 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1951/3909] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:42 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:43.324949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-81d09de5-505a-464d-a347-7af58aefc18d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:43.326603 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-81d09de5-505a-464d-a347-7af58aefc18d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:43.339214 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81d09de5-505a-464d-a347-7af58aefc18d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:43.340098 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81d09de5-505a-464d-a347-7af58aefc18d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:43.340844 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81d09de5-505a-464d-a347-7af58aefc18d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:43.341813 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81d09de5-505a-464d-a347-7af58aefc18d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:43.342470 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81d09de5-505a-464d-a347-7af58aefc18d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:43.343107 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81d09de5-505a-464d-a347-7af58aefc18d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:43.490614 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-81d09de5-505a-464d-a347-7af58aefc18d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:43.502010 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-81d09de5-505a-464d-a347-7af58aefc18d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.180653 Aug 06 13:11:43.514153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1959/3910] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:43 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:44.527410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-53c704c6-b72b-4533-9673-100d3df65884 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:44.528199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-53c704c6-b72b-4533-9673-100d3df65884 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:44.536102 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c704c6-b72b-4533-9673-100d3df65884 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:44.537328 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c704c6-b72b-4533-9673-100d3df65884 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:44.537951 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c704c6-b72b-4533-9673-100d3df65884 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:44.538912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c704c6-b72b-4533-9673-100d3df65884 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:44.539520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c704c6-b72b-4533-9673-100d3df65884 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:44.540106 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53c704c6-b72b-4533-9673-100d3df65884 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:44.698241 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-53c704c6-b72b-4533-9673-100d3df65884 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:44.706488 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-53c704c6-b72b-4533-9673-100d3df65884 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.183291 Aug 06 13:11:44.707226 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1952/3911] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:44 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:45.729964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ea13cf88-5797-420c-8b16-08eab347599a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:45.730645 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ea13cf88-5797-420c-8b16-08eab347599a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:45.738555 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea13cf88-5797-420c-8b16-08eab347599a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:45.739288 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea13cf88-5797-420c-8b16-08eab347599a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:45.739926 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea13cf88-5797-420c-8b16-08eab347599a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:45.740795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea13cf88-5797-420c-8b16-08eab347599a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:45.741236 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea13cf88-5797-420c-8b16-08eab347599a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:45.741882 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea13cf88-5797-420c-8b16-08eab347599a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:45.933761 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ea13cf88-5797-420c-8b16-08eab347599a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:45.941949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ea13cf88-5797-420c-8b16-08eab347599a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.217697 Aug 06 13:11:45.942795 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1960/3912] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:45 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:46.967840 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1c374094-cc9f-45b7-91fa-d52090ae0112 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:46.969136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1c374094-cc9f-45b7-91fa-d52090ae0112 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:46.977363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c374094-cc9f-45b7-91fa-d52090ae0112 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:46.978002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c374094-cc9f-45b7-91fa-d52090ae0112 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:46.978499 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c374094-cc9f-45b7-91fa-d52090ae0112 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:46.979250 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c374094-cc9f-45b7-91fa-d52090ae0112 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:46.979761 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c374094-cc9f-45b7-91fa-d52090ae0112 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:46.980262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c374094-cc9f-45b7-91fa-d52090ae0112 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:47.149253 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1c374094-cc9f-45b7-91fa-d52090ae0112 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:47.157368 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1c374094-cc9f-45b7-91fa-d52090ae0112 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.195200 Aug 06 13:11:47.159631 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1953/3913] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:46 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:48.182859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2990583c-9e6d-40fa-879b-9925936b0d42 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:48.183791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2990583c-9e6d-40fa-879b-9925936b0d42 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:48.187655 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:48.188315 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:48.192350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2990583c-9e6d-40fa-879b-9925936b0d42 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:48.192858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2990583c-9e6d-40fa-879b-9925936b0d42 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:48.193366 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2990583c-9e6d-40fa-879b-9925936b0d42 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:48.194379 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2990583c-9e6d-40fa-879b-9925936b0d42 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:48.194832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2990583c-9e6d-40fa-879b-9925936b0d42 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:48.195270 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2990583c-9e6d-40fa-879b-9925936b0d42 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:48.382449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2990583c-9e6d-40fa-879b-9925936b0d42 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:48.390775 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2990583c-9e6d-40fa-879b-9925936b0d42 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.212338 Aug 06 13:11:48.391693 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1961/3914] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:48 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:49.410933 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7402805c-7305-4a07-83af-d51c99e19db2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:49.411537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7402805c-7305-4a07-83af-d51c99e19db2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:49.414601 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:11:49.418771 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7402805c-7305-4a07-83af-d51c99e19db2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:49.419186 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7402805c-7305-4a07-83af-d51c99e19db2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:49.420118 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7402805c-7305-4a07-83af-d51c99e19db2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:49.420838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7402805c-7305-4a07-83af-d51c99e19db2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:49.421285 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7402805c-7305-4a07-83af-d51c99e19db2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:49.421703 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7402805c-7305-4a07-83af-d51c99e19db2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:49.564224 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7402805c-7305-4a07-83af-d51c99e19db2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:49.571897 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7402805c-7305-4a07-83af-d51c99e19db2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.164831 Aug 06 13:11:49.572481 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1954/3915] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:49 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:50.592491 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aea4c4e5-43cc-4ea6-8568-678c70c9e70e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:50.593101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aea4c4e5-43cc-4ea6-8568-678c70c9e70e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:50.599947 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aea4c4e5-43cc-4ea6-8568-678c70c9e70e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:50.600474 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aea4c4e5-43cc-4ea6-8568-678c70c9e70e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:50.600933 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aea4c4e5-43cc-4ea6-8568-678c70c9e70e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:50.601649 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aea4c4e5-43cc-4ea6-8568-678c70c9e70e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:50.602100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aea4c4e5-43cc-4ea6-8568-678c70c9e70e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:50.602522 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aea4c4e5-43cc-4ea6-8568-678c70c9e70e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:50.738314 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aea4c4e5-43cc-4ea6-8568-678c70c9e70e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:50.748839 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aea4c4e5-43cc-4ea6-8568-678c70c9e70e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.160120 Aug 06 13:11:50.761343 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1962/3916] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:50 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:51.281978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-47bdcfdf-c857-4e21-a928-a80f18fec361 req-24219895-9462-413a-80b9-c650751a25ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45acd756-ff84-44c0-b6bb-44ae3d3249eb", "name": "network-vif-plugged", "status": "completed", "tag": "16126770-481f-4e05-ab6a-435024f7a197"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:11:51.293454 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-47bdcfdf-c857-4e21-a928-a80f18fec361 req-24219895-9462-413a-80b9-c650751a25ab service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:51.294074 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-47bdcfdf-c857-4e21-a928-a80f18fec361 req-24219895-9462-413a-80b9-c650751a25ab service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:51.295502 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-47bdcfdf-c857-4e21-a928-a80f18fec361 req-24219895-9462-413a-80b9-c650751a25ab service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:51.308679 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-47bdcfdf-c857-4e21-a928-a80f18fec361 req-24219895-9462-413a-80b9-c650751a25ab service nova] Creating event network-vif-plugged:16126770-481f-4e05-ab6a-435024f7a197 for instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb on hv-cinder-85199 Aug 06 13:11:51.314370 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-47bdcfdf-c857-4e21-a928-a80f18fec361 req-24219895-9462-413a-80b9-c650751a25ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107260 Aug 06 13:11:51.315262 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1955/3917] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:11:51.769765 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-869f4292-e3fa-4688-b0c2-6a918593704d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:51.770393 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-869f4292-e3fa-4688-b0c2-6a918593704d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:51.777297 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-869f4292-e3fa-4688-b0c2-6a918593704d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:51.777780 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-869f4292-e3fa-4688-b0c2-6a918593704d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:51.778211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-869f4292-e3fa-4688-b0c2-6a918593704d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:51.778917 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-869f4292-e3fa-4688-b0c2-6a918593704d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:51.779362 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-869f4292-e3fa-4688-b0c2-6a918593704d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:51.779778 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-869f4292-e3fa-4688-b0c2-6a918593704d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:51.936961 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-869f4292-e3fa-4688-b0c2-6a918593704d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:51.944764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-869f4292-e3fa-4688-b0c2-6a918593704d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.178782 Aug 06 13:11:51.945339 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1963/3918] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:51 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:52.966870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cb254bb8-bf6e-4d3d-b48c-98d4a35d4a04 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:52.967606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cb254bb8-bf6e-4d3d-b48c-98d4a35d4a04 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:52.974466 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254bb8-bf6e-4d3d-b48c-98d4a35d4a04 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:52.974944 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254bb8-bf6e-4d3d-b48c-98d4a35d4a04 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:52.975372 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254bb8-bf6e-4d3d-b48c-98d4a35d4a04 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:52.976050 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254bb8-bf6e-4d3d-b48c-98d4a35d4a04 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:52.976527 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254bb8-bf6e-4d3d-b48c-98d4a35d4a04 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:52.976948 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb254bb8-bf6e-4d3d-b48c-98d4a35d4a04 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:53.122180 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cb254bb8-bf6e-4d3d-b48c-98d4a35d4a04 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:53.129558 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cb254bb8-bf6e-4d3d-b48c-98d4a35d4a04 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1259 microversion: 2.1 time: 0.167423 Aug 06 13:11:53.130114 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1956/3919] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:52 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:54.150359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d22a60df-3b5a-4b8a-a411-8e7527bde051 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:54.150892 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d22a60df-3b5a-4b8a-a411-8e7527bde051 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:54.157773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d22a60df-3b5a-4b8a-a411-8e7527bde051 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:54.158248 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d22a60df-3b5a-4b8a-a411-8e7527bde051 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:54.158677 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d22a60df-3b5a-4b8a-a411-8e7527bde051 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:54.159350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d22a60df-3b5a-4b8a-a411-8e7527bde051 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:54.159802 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d22a60df-3b5a-4b8a-a411-8e7527bde051 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:54.160218 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d22a60df-3b5a-4b8a-a411-8e7527bde051 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:54.287286 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d22a60df-3b5a-4b8a-a411-8e7527bde051 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:54.295216 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d22a60df-3b5a-4b8a-a411-8e7527bde051 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1444 microversion: 2.1 time: 0.148239 Aug 06 13:11:54.295769 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1964/3920] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:54 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:54.314663 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f7d31d1a-af6d-4147-a3ba-902444bfe04c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:11:54.315276 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f7d31d1a-af6d-4147-a3ba-902444bfe04c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:11:54.321619 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d31d1a-af6d-4147-a3ba-902444bfe04c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:54.322098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d31d1a-af6d-4147-a3ba-902444bfe04c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:54.322531 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d31d1a-af6d-4147-a3ba-902444bfe04c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:54.323211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d31d1a-af6d-4147-a3ba-902444bfe04c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:54.323664 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d31d1a-af6d-4147-a3ba-902444bfe04c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:54.324089 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7d31d1a-af6d-4147-a3ba-902444bfe04c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:54.450430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f7d31d1a-af6d-4147-a3ba-902444bfe04c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:11:54.458524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f7d31d1a-af6d-4147-a3ba-902444bfe04c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1444 microversion: 2.1 time: 0.147694 Aug 06 13:11:54.459079 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1957/3921] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:11:54 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:11:56.419272 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-178addf1-aed5-40e1-9a68-072ddaa6e24e req-1f2d5a83-b6a8-4264-a52a-fe6d343898f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45acd756-ff84-44c0-b6bb-44ae3d3249eb", "tag": "16126770-481f-4e05-ab6a-435024f7a197"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:11:56.429689 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-178addf1-aed5-40e1-9a68-072ddaa6e24e req-1f2d5a83-b6a8-4264-a52a-fe6d343898f4 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:11:56.430190 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-178addf1-aed5-40e1-9a68-072ddaa6e24e req-1f2d5a83-b6a8-4264-a52a-fe6d343898f4 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:11:56.430791 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-178addf1-aed5-40e1-9a68-072ddaa6e24e req-1f2d5a83-b6a8-4264-a52a-fe6d343898f4 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:11:56.443783 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-178addf1-aed5-40e1-9a68-072ddaa6e24e req-1f2d5a83-b6a8-4264-a52a-fe6d343898f4 service nova] Creating event network-changed:16126770-481f-4e05-ab6a-435024f7a197 for instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb on hv-cinder-85199 Aug 06 13:11:56.448766 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-178addf1-aed5-40e1-9a68-072ddaa6e24e req-1f2d5a83-b6a8-4264-a52a-fe6d343898f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033212 Aug 06 13:11:56.449358 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1965/3922] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:12:24.539194 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d8a78e2a-d452-480a-ae2f-cdd703f094b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:12:24.539692 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d8a78e2a-d452-480a-ae2f-cdd703f094b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:12:24.541851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=22 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:12:24.542505 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=50 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:12:24.548390 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8a78e2a-d452-480a-ae2f-cdd703f094b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:24.548870 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8a78e2a-d452-480a-ae2f-cdd703f094b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:24.549304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8a78e2a-d452-480a-ae2f-cdd703f094b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:24.549991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8a78e2a-d452-480a-ae2f-cdd703f094b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:24.550444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8a78e2a-d452-480a-ae2f-cdd703f094b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:24.550900 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d8a78e2a-d452-480a-ae2f-cdd703f094b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:24.575480 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d8a78e2a-d452-480a-ae2f-cdd703f094b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 13:12:24.646878 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d8a78e2a-d452-480a-ae2f-cdd703f094b8 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 204 len: 0 microversion: 2.1 time: 0.111340 Aug 06 13:12:24.647562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1958/3923] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:12:24 2022] DELETE /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:12:24.654317 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:12:24.655050 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=48 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:12:24.659365 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-947a1585-3a91-4130-9fa8-93ee52e7888e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:12:24.660056 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-947a1585-3a91-4130-9fa8-93ee52e7888e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:12:24.667275 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-947a1585-3a91-4130-9fa8-93ee52e7888e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:24.667754 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-947a1585-3a91-4130-9fa8-93ee52e7888e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:24.668189 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-947a1585-3a91-4130-9fa8-93ee52e7888e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:24.668905 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-947a1585-3a91-4130-9fa8-93ee52e7888e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:24.669356 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-947a1585-3a91-4130-9fa8-93ee52e7888e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:24.669782 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-947a1585-3a91-4130-9fa8-93ee52e7888e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:24.800648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-947a1585-3a91-4130-9fa8-93ee52e7888e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:12:24.807980 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-947a1585-3a91-4130-9fa8-93ee52e7888e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1508 microversion: 2.1 time: 0.156086 Aug 06 13:12:24.808567 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1966/3924] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:12:24 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:12:25.830019 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e841df8a-01cb-47f4-81f4-bd1a7c0f6a0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:12:25.830713 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e841df8a-01cb-47f4-81f4-bd1a7c0f6a0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:12:25.837046 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e841df8a-01cb-47f4-81f4-bd1a7c0f6a0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:25.837528 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e841df8a-01cb-47f4-81f4-bd1a7c0f6a0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:25.837993 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e841df8a-01cb-47f4-81f4-bd1a7c0f6a0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:25.838677 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e841df8a-01cb-47f4-81f4-bd1a7c0f6a0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:25.839130 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e841df8a-01cb-47f4-81f4-bd1a7c0f6a0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:25.839555 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e841df8a-01cb-47f4-81f4-bd1a7c0f6a0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:25.970779 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e841df8a-01cb-47f4-81f4-bd1a7c0f6a0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:12:25.978342 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e841df8a-01cb-47f4-81f4-bd1a7c0f6a0f tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1508 microversion: 2.1 time: 0.152577 Aug 06 13:12:25.978893 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1959/3925] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:12:25 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:12:26.441685 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-adb31556-8268-4a3e-9ace-86671e11fa35 req-76e603aa-00ca-47e8-8408-7763f33965a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27", "name": "network-vif-deleted", "tag": "3caedfaf-acd7-443b-a2c4-40f8c5e04f52"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:12:26.451832 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-adb31556-8268-4a3e-9ace-86671e11fa35 req-76e603aa-00ca-47e8-8408-7763f33965a1 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:26.452320 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-adb31556-8268-4a3e-9ace-86671e11fa35 req-76e603aa-00ca-47e8-8408-7763f33965a1 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:26.452764 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-adb31556-8268-4a3e-9ace-86671e11fa35 req-76e603aa-00ca-47e8-8408-7763f33965a1 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:26.465359 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-adb31556-8268-4a3e-9ace-86671e11fa35 req-76e603aa-00ca-47e8-8408-7763f33965a1 service nova] Creating event network-vif-deleted:3caedfaf-acd7-443b-a2c4-40f8c5e04f52 for instance b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 on hv-cinder-85199 Aug 06 13:12:26.470852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-adb31556-8268-4a3e-9ace-86671e11fa35 req-76e603aa-00ca-47e8-8408-7763f33965a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032564 Aug 06 13:12:26.471450 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1967/3926] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:12:27.000603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:12:27.001124 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:12:27.007637 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:27.008126 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:27.008606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:27.009403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:27.009955 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:27.010453 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:27.044629 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:27.045115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:27.045549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:27.045996 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lazy-loading 'fault' on Instance uuid b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 13:12:27.092438 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:12:27.099416 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4a929c6e-3b74-44bb-9087-d367ed72eb4e tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 200 len: 1311 microversion: 2.1 time: 0.104765 Aug 06 13:12:27.099979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1960/3927] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:12:26 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:12:28.120758 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:12:28.121453 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:12:28.127534 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:28.128008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:28.128477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:28.129159 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:28.129610 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:28.130033 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:28.143702 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Instance b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 could not be found. Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 HTTP/1.1 Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:12:28.145328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 could not be found. Aug 06 13:12:28.146830 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27'} Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 could not be found. Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:12:28.147713 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 could not be found. Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 could not be found. Aug 06 13:12:28.148988 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:12:28.150101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 404 to user: Instance b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:12:28.150101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9e6e18bc-44b0-4245-89ec-0e15d258c568 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27" status: 404 len: 111 microversion: 2.1 time: 0.030598 Aug 06 13:12:28.150101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1968/3928] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:12:28 2022] GET /compute/v2.1/servers/b4cc4785-3eb8-4c0f-b4ee-58d1f53f5d27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:12:28.155764 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9082dc75-57df-4a9b-85ef-cb275d185b1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:12:28.156193 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9082dc75-57df-4a9b-85ef-cb275d185b1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:12:28.162565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9082dc75-57df-4a9b-85ef-cb275d185b1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:28.163040 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9082dc75-57df-4a9b-85ef-cb275d185b1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:28.163467 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9082dc75-57df-4a9b-85ef-cb275d185b1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:28.164136 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9082dc75-57df-4a9b-85ef-cb275d185b1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:28.164609 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9082dc75-57df-4a9b-85ef-cb275d185b1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:28.165027 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9082dc75-57df-4a9b-85ef-cb275d185b1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:28.188851 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9082dc75-57df-4a9b-85ef-cb275d185b1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 13:12:28.262410 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9082dc75-57df-4a9b-85ef-cb275d185b1c tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 204 len: 0 microversion: 2.1 time: 0.110315 Aug 06 13:12:28.263005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1961/3929] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:12:28 2022] DELETE /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:12:28.271686 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e0460aa4-2a5f-4b6a-b63c-89f3bb7d8b95 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:12:28.272292 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e0460aa4-2a5f-4b6a-b63c-89f3bb7d8b95 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:12:28.278938 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0460aa4-2a5f-4b6a-b63c-89f3bb7d8b95 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:28.279419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0460aa4-2a5f-4b6a-b63c-89f3bb7d8b95 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:28.279858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0460aa4-2a5f-4b6a-b63c-89f3bb7d8b95 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:28.280571 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0460aa4-2a5f-4b6a-b63c-89f3bb7d8b95 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:28.281025 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0460aa4-2a5f-4b6a-b63c-89f3bb7d8b95 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:28.281477 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e0460aa4-2a5f-4b6a-b63c-89f3bb7d8b95 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:28.412024 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e0460aa4-2a5f-4b6a-b63c-89f3bb7d8b95 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:12:28.419538 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e0460aa4-2a5f-4b6a-b63c-89f3bb7d8b95 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.151792 Aug 06 13:12:28.420094 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1969/3930] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:12:28 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:12:29.440769 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f0d94dd7-1b83-4d83-a58a-8741685750a6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:12:29.441463 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f0d94dd7-1b83-4d83-a58a-8741685750a6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:12:29.447743 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d94dd7-1b83-4d83-a58a-8741685750a6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:29.448219 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d94dd7-1b83-4d83-a58a-8741685750a6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:29.448684 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d94dd7-1b83-4d83-a58a-8741685750a6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:29.449357 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d94dd7-1b83-4d83-a58a-8741685750a6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:29.449832 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d94dd7-1b83-4d83-a58a-8741685750a6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:29.450260 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0d94dd7-1b83-4d83-a58a-8741685750a6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:29.584646 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0d94dd7-1b83-4d83-a58a-8741685750a6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c520a94e20245ca9cc898dee3ab89bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dea90217d154c2ab843c86c2a5ebb49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:12:29.593671 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f0d94dd7-1b83-4d83-a58a-8741685750a6 tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 200 len: 1522 microversion: 2.1 time: 0.157135 Aug 06 13:12:29.594474 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1962/3931] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:12:29 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:12:29.665378 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-1e69b08a-0ec1-446a-9d9c-faba3898e7f1 req-a5dea358-ad77-43dd-b602-feb3dec84b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88", "name": "network-vif-deleted", "tag": "6661d37d-f9d6-463e-aeaa-3bb99adff19b"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:12:29.676628 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-1e69b08a-0ec1-446a-9d9c-faba3898e7f1 req-a5dea358-ad77-43dd-b602-feb3dec84b68 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:29.677101 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-1e69b08a-0ec1-446a-9d9c-faba3898e7f1 req-a5dea358-ad77-43dd-b602-feb3dec84b68 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:29.677527 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-1e69b08a-0ec1-446a-9d9c-faba3898e7f1 req-a5dea358-ad77-43dd-b602-feb3dec84b68 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:29.689221 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-1e69b08a-0ec1-446a-9d9c-faba3898e7f1 req-a5dea358-ad77-43dd-b602-feb3dec84b68 service nova] Creating event network-vif-deleted:6661d37d-f9d6-463e-aeaa-3bb99adff19b for instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 on hv-cinder-85199 Aug 06 13:12:29.694987 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-1e69b08a-0ec1-446a-9d9c-faba3898e7f1 req-a5dea358-ad77-43dd-b602-feb3dec84b68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033415 Aug 06 13:12:29.695589 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1970/3932] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:12:30.614088 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:12:30.614611 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] [instance: 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:12:30.621530 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:30.622002 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:30.622430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:30.623096 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:12:30.623538 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:12:30.623973 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:12:30.636981 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] HTTP exception thrown: Instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 could not be found. Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Request method failure captured: Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 HTTP/1.1 Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.20 Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.11 Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi7l7b7jb-JG1HUKb_r1UXnMC-3OVZ3LMDjNXpVOscKrU3GA92C4mpsmlg00FjjMxgXsStZSGNBHMzOviofRKrclmCE_r_e6lqDm1nchM--eSZCkitpuQm_73W4MA9p8Oaw7r6cBx_7DNdRMXKBCzxPlXAey5cd_cjayMP9BTKhRPsimo Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 06 13:12:30.638616 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dea90217d154c2ab843c86c2a5ebb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 6dea90217d154c2ab843c86c2a5ebb49 Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523854118 Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Id: 7c520a94e20245ca9cc898dee3ab89bc Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523854118-project Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: method: > Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: exception: Instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 could not be found. Aug 06 13:12:30.640082 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88'} Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 could not be found. Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:12:30.640984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 could not be found. Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 could not be found. Aug 06 13:12:30.642329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 06 13:12:30.643536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] Returning 404 to user: Instance 3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:12:30.643536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-90f93c1c-7e94-4870-b361-7c20bffda0ce tempest-ServerRescueNegativeTestJSON-1523854118 tempest-ServerRescueNegativeTestJSON-1523854118-project] 10.222.0.20 "GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88" status: 404 len: 111 microversion: 2.1 time: 0.029788 Aug 06 13:12:30.643536 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1963/3933] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:12:30 2022] GET /compute/v2.1/servers/3e4bdf6c-d013-46cb-a3ef-caf5ef3c6d88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:13:41.118109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:13:41.118729 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 13:13:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:14:23.012772 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d650569d-681d-410a-91b9-b20dbe1e5b95] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 13:14:23.013360 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=10 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:14:23.014086 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=18 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:14:23.018494 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-af203b42-5cb1-4317-9159-20f2a771a87b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:14:23.019109 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-af203b42-5cb1-4317-9159-20f2a771a87b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:23.025920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af203b42-5cb1-4317-9159-20f2a771a87b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:23.026398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af203b42-5cb1-4317-9159-20f2a771a87b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:23.026831 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af203b42-5cb1-4317-9159-20f2a771a87b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:23.027512 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af203b42-5cb1-4317-9159-20f2a771a87b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:23.027964 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af203b42-5cb1-4317-9159-20f2a771a87b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:23.028413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af203b42-5cb1-4317-9159-20f2a771a87b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:23.050566 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-af203b42-5cb1-4317-9159-20f2a771a87b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lazy-loading 'flavor' on Instance uuid 45acd756-ff84-44c0-b6bb-44ae3d3249eb {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 13:14:23.118633 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-af203b42-5cb1-4317-9159-20f2a771a87b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "POST /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb/action" status: 202 len: 0 microversion: 2.1 time: 0.107429 Aug 06 13:14:23.119228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1971/3934] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 13:14:23 2022] POST /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:14:23.127829 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f9d1adc5-f486-4f39-ac06-daeb15defcc4 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:23.128565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f9d1adc5-f486-4f39-ac06-daeb15defcc4 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:23.130867 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:14:23.131634 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:14:23.136810 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d1adc5-f486-4f39-ac06-daeb15defcc4 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:23.137284 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d1adc5-f486-4f39-ac06-daeb15defcc4 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:23.137733 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d1adc5-f486-4f39-ac06-daeb15defcc4 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:23.138398 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d1adc5-f486-4f39-ac06-daeb15defcc4 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:23.138852 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d1adc5-f486-4f39-ac06-daeb15defcc4 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:23.139267 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f9d1adc5-f486-4f39-ac06-daeb15defcc4 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:23.425537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f9d1adc5-f486-4f39-ac06-daeb15defcc4 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:23.432859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f9d1adc5-f486-4f39-ac06-daeb15defcc4 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.309404 Aug 06 13:14:23.433403 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1964/3935] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:23 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:24.456223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c7d2863b-b150-4d21-a4c7-4ef56c6b761b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:24.456942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c7d2863b-b150-4d21-a4c7-4ef56c6b761b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:24.465406 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d2863b-b150-4d21-a4c7-4ef56c6b761b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:24.465879 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d2863b-b150-4d21-a4c7-4ef56c6b761b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:24.466335 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d2863b-b150-4d21-a4c7-4ef56c6b761b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:24.467014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d2863b-b150-4d21-a4c7-4ef56c6b761b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:24.467459 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d2863b-b150-4d21-a4c7-4ef56c6b761b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:24.467874 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7d2863b-b150-4d21-a4c7-4ef56c6b761b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:24.474266 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] [d650569d-681d-410a-91b9-b20dbe1e5b95] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54486. Aug 06 13:14:24.648966 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7d2863b-b150-4d21-a4c7-4ef56c6b761b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:24.656210 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c7d2863b-b150-4d21-a4c7-4ef56c6b761b tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.205439 Aug 06 13:14:24.656790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1972/3936] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:24 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:25.677304 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-37c30ff7-484f-49d9-b287-085aa21d05f8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:25.677912 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-37c30ff7-484f-49d9-b287-085aa21d05f8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:25.684378 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37c30ff7-484f-49d9-b287-085aa21d05f8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:25.684859 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37c30ff7-484f-49d9-b287-085aa21d05f8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:25.685292 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37c30ff7-484f-49d9-b287-085aa21d05f8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:25.685974 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37c30ff7-484f-49d9-b287-085aa21d05f8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:25.686424 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37c30ff7-484f-49d9-b287-085aa21d05f8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:25.686845 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37c30ff7-484f-49d9-b287-085aa21d05f8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:25.818491 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-37c30ff7-484f-49d9-b287-085aa21d05f8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:25.826501 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-37c30ff7-484f-49d9-b287-085aa21d05f8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.153068 Aug 06 13:14:25.827053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1965/3937] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:25 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:26.847240 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38f2601e-5398-476f-ae0d-e992d1fe37a7 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:26.847842 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38f2601e-5398-476f-ae0d-e992d1fe37a7 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:26.854662 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38f2601e-5398-476f-ae0d-e992d1fe37a7 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:26.855170 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38f2601e-5398-476f-ae0d-e992d1fe37a7 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:26.855600 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38f2601e-5398-476f-ae0d-e992d1fe37a7 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:26.856276 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38f2601e-5398-476f-ae0d-e992d1fe37a7 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:26.856746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38f2601e-5398-476f-ae0d-e992d1fe37a7 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:26.857169 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38f2601e-5398-476f-ae0d-e992d1fe37a7 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:27.002008 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-38f2601e-5398-476f-ae0d-e992d1fe37a7 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:27.009489 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38f2601e-5398-476f-ae0d-e992d1fe37a7 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.166394 Aug 06 13:14:27.010132 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1973/3938] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:26 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:28.030627 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9cf14375-056c-4ebb-a855-22910978a0cc tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:28.031228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9cf14375-056c-4ebb-a855-22910978a0cc tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:28.037567 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cf14375-056c-4ebb-a855-22910978a0cc tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:28.038039 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cf14375-056c-4ebb-a855-22910978a0cc tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:28.038473 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cf14375-056c-4ebb-a855-22910978a0cc tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:28.039148 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cf14375-056c-4ebb-a855-22910978a0cc tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:28.039595 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cf14375-056c-4ebb-a855-22910978a0cc tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:28.040014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9cf14375-056c-4ebb-a855-22910978a0cc tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:28.166400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9cf14375-056c-4ebb-a855-22910978a0cc tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:28.173920 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9cf14375-056c-4ebb-a855-22910978a0cc tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.147036 Aug 06 13:14:28.174483 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1966/3939] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:28 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:14:29.195128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2be9df26-b8da-4abd-bba2-933482ab0571 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:29.195663 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2be9df26-b8da-4abd-bba2-933482ab0571 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:29.201974 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be9df26-b8da-4abd-bba2-933482ab0571 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:29.202447 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be9df26-b8da-4abd-bba2-933482ab0571 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:29.202883 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be9df26-b8da-4abd-bba2-933482ab0571 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:29.203558 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be9df26-b8da-4abd-bba2-933482ab0571 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:29.204003 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be9df26-b8da-4abd-bba2-933482ab0571 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:29.204449 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2be9df26-b8da-4abd-bba2-933482ab0571 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:29.331944 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2be9df26-b8da-4abd-bba2-933482ab0571 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:29.339269 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2be9df26-b8da-4abd-bba2-933482ab0571 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.148013 Aug 06 13:14:29.339822 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1974/3940] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:29 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:30.360512 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0eecbfae-fa5f-40dc-8f5c-1ffdf53310d1 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:30.361115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0eecbfae-fa5f-40dc-8f5c-1ffdf53310d1 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:30.367386 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0eecbfae-fa5f-40dc-8f5c-1ffdf53310d1 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:30.367855 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0eecbfae-fa5f-40dc-8f5c-1ffdf53310d1 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:30.368278 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0eecbfae-fa5f-40dc-8f5c-1ffdf53310d1 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:30.368984 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0eecbfae-fa5f-40dc-8f5c-1ffdf53310d1 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:30.369915 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0eecbfae-fa5f-40dc-8f5c-1ffdf53310d1 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:30.370331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0eecbfae-fa5f-40dc-8f5c-1ffdf53310d1 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:30.499158 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0eecbfae-fa5f-40dc-8f5c-1ffdf53310d1 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:30.506487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0eecbfae-fa5f-40dc-8f5c-1ffdf53310d1 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.149899 Aug 06 13:14:30.507037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1967/3941] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:30 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:31.526785 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b39de126-1dc0-4112-88d0-bd6dbf60f78f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:31.527392 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b39de126-1dc0-4112-88d0-bd6dbf60f78f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:31.533733 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39de126-1dc0-4112-88d0-bd6dbf60f78f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:31.534211 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39de126-1dc0-4112-88d0-bd6dbf60f78f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:31.534641 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39de126-1dc0-4112-88d0-bd6dbf60f78f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:31.535328 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39de126-1dc0-4112-88d0-bd6dbf60f78f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:31.535779 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39de126-1dc0-4112-88d0-bd6dbf60f78f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:31.536201 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b39de126-1dc0-4112-88d0-bd6dbf60f78f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:31.666920 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b39de126-1dc0-4112-88d0-bd6dbf60f78f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:31.674333 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b39de126-1dc0-4112-88d0-bd6dbf60f78f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.151334 Aug 06 13:14:31.674907 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1975/3942] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:31 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:32.695957 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8d5cb047-675e-4a42-a8da-91084a153c55 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:32.696524 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8d5cb047-675e-4a42-a8da-91084a153c55 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:32.702924 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5cb047-675e-4a42-a8da-91084a153c55 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:32.703404 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5cb047-675e-4a42-a8da-91084a153c55 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:32.703839 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5cb047-675e-4a42-a8da-91084a153c55 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:32.704549 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5cb047-675e-4a42-a8da-91084a153c55 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:32.705005 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5cb047-675e-4a42-a8da-91084a153c55 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:32.705455 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d5cb047-675e-4a42-a8da-91084a153c55 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:32.831606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8d5cb047-675e-4a42-a8da-91084a153c55 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:32.839556 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8d5cb047-675e-4a42-a8da-91084a153c55 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.147509 Aug 06 13:14:32.840117 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1968/3943] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:32 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:33.860746 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e15c7ca7-65ca-4b2a-b48d-7cc2a1243512 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:33.861331 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e15c7ca7-65ca-4b2a-b48d-7cc2a1243512 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:33.867790 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e15c7ca7-65ca-4b2a-b48d-7cc2a1243512 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:33.868263 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e15c7ca7-65ca-4b2a-b48d-7cc2a1243512 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:33.868717 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e15c7ca7-65ca-4b2a-b48d-7cc2a1243512 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:33.870035 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e15c7ca7-65ca-4b2a-b48d-7cc2a1243512 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:33.870572 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e15c7ca7-65ca-4b2a-b48d-7cc2a1243512 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:33.870901 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e15c7ca7-65ca-4b2a-b48d-7cc2a1243512 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:34.013488 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e15c7ca7-65ca-4b2a-b48d-7cc2a1243512 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:34.020928 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e15c7ca7-65ca-4b2a-b48d-7cc2a1243512 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.164075 Aug 06 13:14:34.021495 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1976/3944] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:33 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:35.042228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ed179481-c4ec-47a7-822e-1770646836eb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:35.042822 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ed179481-c4ec-47a7-822e-1770646836eb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:35.049217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed179481-c4ec-47a7-822e-1770646836eb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:35.049687 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed179481-c4ec-47a7-822e-1770646836eb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:35.050115 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed179481-c4ec-47a7-822e-1770646836eb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:35.050784 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed179481-c4ec-47a7-822e-1770646836eb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:35.051228 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed179481-c4ec-47a7-822e-1770646836eb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:35.051643 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed179481-c4ec-47a7-822e-1770646836eb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:35.179508 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ed179481-c4ec-47a7-822e-1770646836eb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:35.187440 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ed179481-c4ec-47a7-822e-1770646836eb tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.149093 Aug 06 13:14:35.187991 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1969/3945] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:35 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:36.208077 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-87081346-e060-4bfc-ae1a-8193c0b4937f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:36.208648 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-87081346-e060-4bfc-ae1a-8193c0b4937f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:36.215508 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-87081346-e060-4bfc-ae1a-8193c0b4937f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:36.216009 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-87081346-e060-4bfc-ae1a-8193c0b4937f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:36.216468 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-87081346-e060-4bfc-ae1a-8193c0b4937f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:36.217133 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-87081346-e060-4bfc-ae1a-8193c0b4937f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:36.217584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-87081346-e060-4bfc-ae1a-8193c0b4937f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:36.217998 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-87081346-e060-4bfc-ae1a-8193c0b4937f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:36.347454 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-87081346-e060-4bfc-ae1a-8193c0b4937f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:36.355053 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-87081346-e060-4bfc-ae1a-8193c0b4937f tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1570 microversion: 2.1 time: 0.150887 Aug 06 13:14:36.355618 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1977/3946] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:36 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:36.376128 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-48b22805-be24-4757-aafc-75c49d5fd4e9 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:14:36.376747 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-48b22805-be24-4757-aafc-75c49d5fd4e9 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:36.383037 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48b22805-be24-4757-aafc-75c49d5fd4e9 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:36.383519 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48b22805-be24-4757-aafc-75c49d5fd4e9 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:36.383953 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48b22805-be24-4757-aafc-75c49d5fd4e9 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:36.384662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48b22805-be24-4757-aafc-75c49d5fd4e9 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:36.385763 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48b22805-be24-4757-aafc-75c49d5fd4e9 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:36.386192 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-48b22805-be24-4757-aafc-75c49d5fd4e9 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:36.426066 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-48b22805-be24-4757-aafc-75c49d5fd4e9 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117824) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 13:14:36.492719 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-48b22805-be24-4757-aafc-75c49d5fd4e9 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "POST /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb/action" status: 202 len: 0 microversion: 2.1 time: 0.120289 Aug 06 13:14:36.493417 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1970/3947] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Aug 6 13:14:36 2022] POST /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:14:36.501747 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d8c292d5-a52f-4538-9cdf-19a9343e653a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:36.502350 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d8c292d5-a52f-4538-9cdf-19a9343e653a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:36.508322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8c292d5-a52f-4538-9cdf-19a9343e653a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:36.508810 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8c292d5-a52f-4538-9cdf-19a9343e653a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:36.509243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8c292d5-a52f-4538-9cdf-19a9343e653a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:36.510515 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8c292d5-a52f-4538-9cdf-19a9343e653a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:36.510967 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8c292d5-a52f-4538-9cdf-19a9343e653a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:36.511412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8c292d5-a52f-4538-9cdf-19a9343e653a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:36.651277 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d8c292d5-a52f-4538-9cdf-19a9343e653a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:36.658574 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d8c292d5-a52f-4538-9cdf-19a9343e653a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1518 microversion: 2.1 time: 0.160683 Aug 06 13:14:36.659128 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1978/3948] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:36 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 13:14:37.680084 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c920c6d5-7e66-4ce3-9ee5-2e78b01dcc63 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:37.680662 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c920c6d5-7e66-4ce3-9ee5-2e78b01dcc63 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:37.686444 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c920c6d5-7e66-4ce3-9ee5-2e78b01dcc63 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:37.686968 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c920c6d5-7e66-4ce3-9ee5-2e78b01dcc63 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:37.687400 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c920c6d5-7e66-4ce3-9ee5-2e78b01dcc63 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:37.688077 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c920c6d5-7e66-4ce3-9ee5-2e78b01dcc63 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:37.688565 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c920c6d5-7e66-4ce3-9ee5-2e78b01dcc63 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:37.688986 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c920c6d5-7e66-4ce3-9ee5-2e78b01dcc63 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:37.823090 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c920c6d5-7e66-4ce3-9ee5-2e78b01dcc63 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:37.831331 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c920c6d5-7e66-4ce3-9ee5-2e78b01dcc63 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1520 microversion: 2.1 time: 0.155587 Aug 06 13:14:37.831885 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1971/3949] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:37 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:38.852771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-994b0505-ff46-484e-a2cf-c00dd4b62989 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:38.854137 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-994b0505-ff46-484e-a2cf-c00dd4b62989 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:38.860565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-994b0505-ff46-484e-a2cf-c00dd4b62989 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:38.861163 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-994b0505-ff46-484e-a2cf-c00dd4b62989 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:38.861715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-994b0505-ff46-484e-a2cf-c00dd4b62989 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:38.864014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-994b0505-ff46-484e-a2cf-c00dd4b62989 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:38.864014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-994b0505-ff46-484e-a2cf-c00dd4b62989 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:38.864014 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-994b0505-ff46-484e-a2cf-c00dd4b62989 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:39.009089 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-994b0505-ff46-484e-a2cf-c00dd4b62989 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:39.016595 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-994b0505-ff46-484e-a2cf-c00dd4b62989 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1576 microversion: 2.1 time: 0.167597 Aug 06 13:14:39.017158 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1979/3950] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:38 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:39.904569 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-30eec05a-9f60-4304-9b5e-42d34119ed65 req-aef081c2-3748-437f-b1bb-338996106816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45acd756-ff84-44c0-b6bb-44ae3d3249eb", "name": "network-vif-unplugged", "status": "completed", "tag": "16126770-481f-4e05-ab6a-435024f7a197"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:14:39.914837 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-30eec05a-9f60-4304-9b5e-42d34119ed65 req-aef081c2-3748-437f-b1bb-338996106816 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:39.915396 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-30eec05a-9f60-4304-9b5e-42d34119ed65 req-aef081c2-3748-437f-b1bb-338996106816 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:39.915824 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-30eec05a-9f60-4304-9b5e-42d34119ed65 req-aef081c2-3748-437f-b1bb-338996106816 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:39.929607 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-30eec05a-9f60-4304-9b5e-42d34119ed65 req-aef081c2-3748-437f-b1bb-338996106816 service nova] Creating event network-vif-unplugged:16126770-481f-4e05-ab6a-435024f7a197 for instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb on hv-cinder-85199 Aug 06 13:14:39.934581 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-30eec05a-9f60-4304-9b5e-42d34119ed65 req-aef081c2-3748-437f-b1bb-338996106816 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034146 Aug 06 13:14:39.935098 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1972/3951] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:14:40.037973 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-41d4a3f3-ce9b-469b-b81d-07feb1a22513 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:40.038584 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-41d4a3f3-ce9b-469b-b81d-07feb1a22513 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:40.044942 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d4a3f3-ce9b-469b-b81d-07feb1a22513 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:40.045419 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d4a3f3-ce9b-469b-b81d-07feb1a22513 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:40.045852 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d4a3f3-ce9b-469b-b81d-07feb1a22513 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:40.046531 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d4a3f3-ce9b-469b-b81d-07feb1a22513 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:40.046983 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d4a3f3-ce9b-469b-b81d-07feb1a22513 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:40.047410 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41d4a3f3-ce9b-469b-b81d-07feb1a22513 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:40.174588 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-41d4a3f3-ce9b-469b-b81d-07feb1a22513 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:40.181963 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-41d4a3f3-ce9b-469b-b81d-07feb1a22513 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1576 microversion: 2.1 time: 0.147865 Aug 06 13:14:40.182524 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1980/3952] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:40 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:41.203786 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3e17b491-a420-41f4-a3bf-fad276057ee2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:41.204497 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e17b491-a420-41f4-a3bf-fad276057ee2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:41.210490 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e17b491-a420-41f4-a3bf-fad276057ee2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:41.210960 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e17b491-a420-41f4-a3bf-fad276057ee2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:41.211387 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e17b491-a420-41f4-a3bf-fad276057ee2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:41.212053 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e17b491-a420-41f4-a3bf-fad276057ee2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:41.212518 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e17b491-a420-41f4-a3bf-fad276057ee2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:41.213471 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e17b491-a420-41f4-a3bf-fad276057ee2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:41.343552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3e17b491-a420-41f4-a3bf-fad276057ee2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:41.351326 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3e17b491-a420-41f4-a3bf-fad276057ee2 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1576 microversion: 2.1 time: 0.152214 Aug 06 13:14:41.351880 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1973/3953] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:41 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:42.373154 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0bec9d3f-140c-4473-ae6f-e8aa6ef1b504 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:42.373760 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0bec9d3f-140c-4473-ae6f-e8aa6ef1b504 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:42.380087 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bec9d3f-140c-4473-ae6f-e8aa6ef1b504 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:42.380665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bec9d3f-140c-4473-ae6f-e8aa6ef1b504 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:42.381097 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bec9d3f-140c-4473-ae6f-e8aa6ef1b504 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:42.381773 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bec9d3f-140c-4473-ae6f-e8aa6ef1b504 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:42.382223 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bec9d3f-140c-4473-ae6f-e8aa6ef1b504 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:42.382639 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0bec9d3f-140c-4473-ae6f-e8aa6ef1b504 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:42.508357 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0bec9d3f-140c-4473-ae6f-e8aa6ef1b504 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:42.515679 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0bec9d3f-140c-4473-ae6f-e8aa6ef1b504 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1576 microversion: 2.1 time: 0.147005 Aug 06 13:14:42.516234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1981/3954] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:42 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:43.536811 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-42a306e0-f63d-44df-86bd-e544a68eca40 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:43.537407 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-42a306e0-f63d-44df-86bd-e544a68eca40 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:43.543744 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42a306e0-f63d-44df-86bd-e544a68eca40 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:43.544217 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42a306e0-f63d-44df-86bd-e544a68eca40 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:43.544672 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42a306e0-f63d-44df-86bd-e544a68eca40 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:43.545341 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42a306e0-f63d-44df-86bd-e544a68eca40 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:43.545783 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42a306e0-f63d-44df-86bd-e544a68eca40 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:43.546199 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42a306e0-f63d-44df-86bd-e544a68eca40 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:43.677363 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-42a306e0-f63d-44df-86bd-e544a68eca40 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:43.685325 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-42a306e0-f63d-44df-86bd-e544a68eca40 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1576 microversion: 2.1 time: 0.152419 Aug 06 13:14:43.685879 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1974/3955] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:43 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:44.706533 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-02f78756-4872-4af9-a111-56cb59653ace tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:44.707141 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-02f78756-4872-4af9-a111-56cb59653ace tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:44.714355 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f78756-4872-4af9-a111-56cb59653ace tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:44.714850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f78756-4872-4af9-a111-56cb59653ace tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:44.715279 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f78756-4872-4af9-a111-56cb59653ace tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:44.715948 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f78756-4872-4af9-a111-56cb59653ace tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:44.716490 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f78756-4872-4af9-a111-56cb59653ace tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:44.716908 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-02f78756-4872-4af9-a111-56cb59653ace tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:44.846949 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-02f78756-4872-4af9-a111-56cb59653ace tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:44.854809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-02f78756-4872-4af9-a111-56cb59653ace tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1576 microversion: 2.1 time: 0.152149 Aug 06 13:14:44.855361 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1982/3956] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:44 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:45.876794 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-37f24a06-b082-4547-ba7f-3a871a92a61e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:45.877388 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-37f24a06-b082-4547-ba7f-3a871a92a61e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:45.883661 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37f24a06-b082-4547-ba7f-3a871a92a61e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:45.884145 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37f24a06-b082-4547-ba7f-3a871a92a61e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:45.884605 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37f24a06-b082-4547-ba7f-3a871a92a61e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:45.885286 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37f24a06-b082-4547-ba7f-3a871a92a61e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:45.885734 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37f24a06-b082-4547-ba7f-3a871a92a61e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:45.886152 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37f24a06-b082-4547-ba7f-3a871a92a61e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:46.026109 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-37f24a06-b082-4547-ba7f-3a871a92a61e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:46.034203 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-37f24a06-b082-4547-ba7f-3a871a92a61e tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1576 microversion: 2.1 time: 0.161550 Aug 06 13:14:46.034796 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1975/3957] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:45 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:47.055582 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-508a8c04-33cc-4cff-bba1-342c9714fa71 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:47.056846 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-508a8c04-33cc-4cff-bba1-342c9714fa71 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:47.063234 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508a8c04-33cc-4cff-bba1-342c9714fa71 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:47.063715 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508a8c04-33cc-4cff-bba1-342c9714fa71 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:47.064149 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508a8c04-33cc-4cff-bba1-342c9714fa71 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:47.064858 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508a8c04-33cc-4cff-bba1-342c9714fa71 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:47.065312 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508a8c04-33cc-4cff-bba1-342c9714fa71 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:47.065732 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-508a8c04-33cc-4cff-bba1-342c9714fa71 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:47.197150 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-508a8c04-33cc-4cff-bba1-342c9714fa71 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:47.204545 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-508a8c04-33cc-4cff-bba1-342c9714fa71 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1576 microversion: 2.1 time: 0.153524 Aug 06 13:14:47.205100 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1983/3958] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:47 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:48.226055 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2c7837ed-d7a0-41b3-b982-f7b9e22746e8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:14:48.226603 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2c7837ed-d7a0-41b3-b982-f7b9e22746e8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:14:48.232921 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c7837ed-d7a0-41b3-b982-f7b9e22746e8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:48.233395 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c7837ed-d7a0-41b3-b982-f7b9e22746e8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:48.233818 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c7837ed-d7a0-41b3-b982-f7b9e22746e8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:48.234487 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c7837ed-d7a0-41b3-b982-f7b9e22746e8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:48.234929 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c7837ed-d7a0-41b3-b982-f7b9e22746e8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:48.235345 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2c7837ed-d7a0-41b3-b982-f7b9e22746e8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:48.366520 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2c7837ed-d7a0-41b3-b982-f7b9e22746e8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:14:48.374647 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2c7837ed-d7a0-41b3-b982-f7b9e22746e8 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1563 microversion: 2.1 time: 0.152451 Aug 06 13:14:48.375211 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1976/3959] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:14:48 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:14:49.892061 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-b1acc3be-1fb8-4d19-a51b-efcd4fe8b14d req-0fe4551e-f649-4538-b402-fd6f7b4f1a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45acd756-ff84-44c0-b6bb-44ae3d3249eb", "name": "network-vif-plugged", "status": "completed", "tag": "16126770-481f-4e05-ab6a-435024f7a197"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:14:49.903398 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-b1acc3be-1fb8-4d19-a51b-efcd4fe8b14d req-0fe4551e-f649-4538-b402-fd6f7b4f1a02 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:14:49.903876 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-b1acc3be-1fb8-4d19-a51b-efcd4fe8b14d req-0fe4551e-f649-4538-b402-fd6f7b4f1a02 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:14:49.904341 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-b1acc3be-1fb8-4d19-a51b-efcd4fe8b14d req-0fe4551e-f649-4538-b402-fd6f7b4f1a02 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:14:49.915219 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-b1acc3be-1fb8-4d19-a51b-efcd4fe8b14d req-0fe4551e-f649-4538-b402-fd6f7b4f1a02 service nova] Creating event network-vif-plugged:16126770-481f-4e05-ab6a-435024f7a197 for instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb on hv-cinder-85199 Aug 06 13:14:49.920829 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-b1acc3be-1fb8-4d19-a51b-efcd4fe8b14d req-0fe4551e-f649-4538-b402-fd6f7b4f1a02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032375 Aug 06 13:14:49.921664 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1984/3960] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:15:16.802964 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:15:16.803535 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 13:15:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:16:25.592202 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:16:25.592979 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:16:25.596665 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=28 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:16:25.597478 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 13:16:25.601568 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-f6004a2e-985f-4b5e-a4aa-2ad6f2b127b9 req-52e08d7e-cb08-4624-b9d5-88354c4945a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45acd756-ff84-44c0-b6bb-44ae3d3249eb", "tag": "16126770-481f-4e05-ab6a-435024f7a197"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:16:25.608552 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de55dfee-80f9-47de-82b2-934e9a5aeb2c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:16:25.609041 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-de55dfee-80f9-47de-82b2-934e9a5aeb2c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:16:25.616247 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de55dfee-80f9-47de-82b2-934e9a5aeb2c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:25.616668 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de55dfee-80f9-47de-82b2-934e9a5aeb2c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:25.617072 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de55dfee-80f9-47de-82b2-934e9a5aeb2c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:25.617767 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de55dfee-80f9-47de-82b2-934e9a5aeb2c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:25.618153 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f6004a2e-985f-4b5e-a4aa-2ad6f2b127b9 req-52e08d7e-cb08-4624-b9d5-88354c4945a4 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:25.618300 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de55dfee-80f9-47de-82b2-934e9a5aeb2c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:25.618606 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de55dfee-80f9-47de-82b2-934e9a5aeb2c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:25.618751 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f6004a2e-985f-4b5e-a4aa-2ad6f2b127b9 req-52e08d7e-cb08-4624-b9d5-88354c4945a4 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:25.619229 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f6004a2e-985f-4b5e-a4aa-2ad6f2b127b9 req-52e08d7e-cb08-4624-b9d5-88354c4945a4 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:25.633861 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-f6004a2e-985f-4b5e-a4aa-2ad6f2b127b9 req-52e08d7e-cb08-4624-b9d5-88354c4945a4 service nova] Creating event network-changed:16126770-481f-4e05-ab6a-435024f7a197 for instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb on hv-cinder-85199 Aug 06 13:16:25.639850 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-f6004a2e-985f-4b5e-a4aa-2ad6f2b127b9 req-52e08d7e-cb08-4624-b9d5-88354c4945a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045056 Aug 06 13:16:25.640626 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1985/3961] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:16:25.646736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-de55dfee-80f9-47de-82b2-934e9a5aeb2c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 13:16:25.727825 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-de55dfee-80f9-47de-82b2-934e9a5aeb2c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "DELETE /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 204 len: 0 microversion: 2.1 time: 0.136704 Aug 06 13:16:25.731430 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1977/3962] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Aug 6 13:16:25 2022] DELETE /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 13:16:25.741475 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c638542-30e2-433b-bdc1-072e1bbd21e3 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:16:25.742382 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c638542-30e2-433b-bdc1-072e1bbd21e3 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:16:25.751261 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c638542-30e2-433b-bdc1-072e1bbd21e3 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:25.751744 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c638542-30e2-433b-bdc1-072e1bbd21e3 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:25.752173 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c638542-30e2-433b-bdc1-072e1bbd21e3 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:25.752885 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c638542-30e2-433b-bdc1-072e1bbd21e3 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:25.753332 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c638542-30e2-433b-bdc1-072e1bbd21e3 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:25.753749 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c638542-30e2-433b-bdc1-072e1bbd21e3 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:25.883692 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8c638542-30e2-433b-bdc1-072e1bbd21e3 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:16:25.891235 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c638542-30e2-433b-bdc1-072e1bbd21e3 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.157706 Aug 06 13:16:25.891809 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1986/3963] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:16:25 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:16:26.912367 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-95a0582e-4e1c-43e1-b7af-1ddcac043415 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:16:26.913057 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-95a0582e-4e1c-43e1-b7af-1ddcac043415 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:16:26.919415 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a0582e-4e1c-43e1-b7af-1ddcac043415 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:26.919889 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a0582e-4e1c-43e1-b7af-1ddcac043415 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:26.920329 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a0582e-4e1c-43e1-b7af-1ddcac043415 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:26.921014 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a0582e-4e1c-43e1-b7af-1ddcac043415 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:26.921457 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a0582e-4e1c-43e1-b7af-1ddcac043415 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:26.921871 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95a0582e-4e1c-43e1-b7af-1ddcac043415 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:27.052883 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-95a0582e-4e1c-43e1-b7af-1ddcac043415 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:16:27.060978 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-95a0582e-4e1c-43e1-b7af-1ddcac043415 tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1569 microversion: 2.1 time: 0.152884 Aug 06 13:16:27.061736 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1978/3964] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:16:26 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:16:28.082413 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8d9d0747-0fad-4693-9c9d-51aabdd8057c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:16:28.083036 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8d9d0747-0fad-4693-9c9d-51aabdd8057c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:16:28.089771 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d9d0747-0fad-4693-9c9d-51aabdd8057c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:28.090255 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d9d0747-0fad-4693-9c9d-51aabdd8057c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:28.090691 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d9d0747-0fad-4693-9c9d-51aabdd8057c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:28.092083 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d9d0747-0fad-4693-9c9d-51aabdd8057c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:28.092565 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d9d0747-0fad-4693-9c9d-51aabdd8057c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:28.092992 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d9d0747-0fad-4693-9c9d-51aabdd8057c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:28.192143 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8d9d0747-0fad-4693-9c9d-51aabdd8057c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dacef0fd30a43d2b29a2eeb67884ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e0dc4c7d244821bd974b0dea3fc631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 13:16:28.201857 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8d9d0747-0fad-4693-9c9d-51aabdd8057c tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 200 len: 1383 microversion: 2.1 time: 0.122155 Aug 06 13:16:28.203228 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1987/3965] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:16:28 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 1383 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 13:16:28.238681 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-e946dd93-bc62-4038-9d57-008b25fc78b6 req-a06afc7e-899d-4316-b18c-c308b073fbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45acd756-ff84-44c0-b6bb-44ae3d3249eb", "name": "network-vif-deleted", "tag": "16126770-481f-4e05-ab6a-435024f7a197"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 13:16:28.252806 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-e946dd93-bc62-4038-9d57-008b25fc78b6 req-a06afc7e-899d-4316-b18c-c308b073fbf9 service nova] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:28.253356 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-e946dd93-bc62-4038-9d57-008b25fc78b6 req-a06afc7e-899d-4316-b18c-c308b073fbf9 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:28.254009 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-e946dd93-bc62-4038-9d57-008b25fc78b6 req-a06afc7e-899d-4316-b18c-c308b073fbf9 service nova] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:28.272576 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-e946dd93-bc62-4038-9d57-008b25fc78b6 req-a06afc7e-899d-4316-b18c-c308b073fbf9 service nova] Creating event network-vif-deleted:16126770-481f-4e05-ab6a-435024f7a197 for instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb on hv-cinder-85199 Aug 06 13:16:28.277946 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-e946dd93-bc62-4038-9d57-008b25fc78b6 req-a06afc7e-899d-4316-b18c-c308b073fbf9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042815 Aug 06 13:16:28.278641 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1979/3966] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Aug 6 13:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 13:16:29.225152 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:16:29.225741 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] [instance: 45acd756-ff84-44c0-b6bb-44ae3d3249eb] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 13:16:29.232851 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:29.233322 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:29.233748 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:29.234423 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Acquiring lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 13:16:29.234866 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 13:16:29.235290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Lock "061923a9-3e0d-4e1d-84a5-ebe9694ea1ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 13:16:29.248716 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] HTTP exception thrown: Instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb could not be found. Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Request method failure captured: Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb HTTP/1.1 Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.20 Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.11 Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi7mhiKFYNAfxswueBcMvH6G9uqIvPxAitDH9ahmzDs6CmZlCCDjbeXJjwLbaahhlrTdKHGkBOHlEWLnKmaqZvXp66cE3WLGkuxIFqMNfCAMvV8oA5rZnzGN2GaETIY9ysQ3kBdlYurtuq3KLOsGlRD1JlbHwn3VHzUPNjbfy7AlU6HEc Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 06e0dc4c7d244821bd974b0dea3fc631 Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestShelveInstance-343507412 Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 06 13:16:29.250412 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06e0dc4c7d244821bd974b0dea3fc631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_06e0dc4c7d244821bd974b0dea3fc631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06e0dc4c7d244821bd974b0dea3fc631"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/06e0dc4c7d244821bd974b0dea3fc631"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestShelveInstance-343507412 Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 06e0dc4c7d244821bd974b0dea3fc631 Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestShelveInstance-343507412 Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User: tempest-TestShelveInstance-343507412-project Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Id: 2dacef0fd30a43d2b29a2eeb67884ec1 Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestShelveInstance-343507412-project Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: method: > Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: exception: Instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb could not be found. Aug 06 13:16:29.251913 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '45acd756-ff84-44c0-b6bb-44ae3d3249eb'} Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb could not be found. Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 13:16:29.252859 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb could not be found. Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb could not be found. Aug 06 13:16:29.254195 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 06 13:16:29.255251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Returning 404 to user: Instance 45acd756-ff84-44c0-b6bb-44ae3d3249eb could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 13:16:29.255251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bbffd11d-0d9d-4cd4-9bea-ff5afa51e25d tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb" status: 404 len: 111 microversion: 2.1 time: 0.031969 Aug 06 13:16:29.255251 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1988/3967] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Aug 6 13:16:29 2022] GET /compute/v2.1/servers/45acd756-ff84-44c0-b6bb-44ae3d3249eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 13:16:29.411146 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0e27697f-f202-44c1-a025-ea058d93797a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] Calling method '.version_select at 0x7f541aa890d0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 13:16:29.435923 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0e27697f-f202-44c1-a025-ea058d93797a tempest-TestShelveInstance-343507412 tempest-TestShelveInstance-343507412-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1937561453" status: 202 len: 0 microversion: 2.1 time: 0.029333 Aug 06 13:16:29.437562 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1980/3968] 10.222.0.20 () {58 vars in 1254 bytes} [Sat Aug 6 13:16:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1937561453 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 13:16:57.766653 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:16:57.767290 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:16:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:17:01.126947 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:17:01.127537 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 13:17:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:17:03.585724 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:17:03.586243 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:19:02.388825 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:19:02.389549 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:19:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:20:17.774740 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:20:17.775417 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:20:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:20:21.135324 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:20:21.135838 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 13:20:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:20:23.593624 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:20:23.594637 dv-cinder-851996-3-iscsi devstack@n-api.service[117825]: Sat Aug 6 13:20:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 13:21:56.814882 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 13:21:56.815464 dv-cinder-851996-3-iscsi devstack@n-api.service[117824]: Sat Aug 6 13:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!